Project
For COP28, the UAE entrusted Tellart with a significant redesign of its pavilion to showcase the nation's dedication to sustainability. My role was central to integrating advanced technology and ensuring the creative vision was maintained throughout two key immersive interactives.
Responsibilities
Over the course of a year, our project went through numerous iterations involving prototyping and concept development. I joined the team during the initial stages, playing a pivotal role in the creation and evolution of several interactive displays. Notably, I spearheaded the development of two major projects: "Dinner in 2050" and "Cross Walks," among a total of 15 interactive installations.
Challenges
Collaboration was critical, as I worked closely with various international AV and hardware vendors to ensure our innovative ideas were feasible. The redesigned pavilion spanned over 1000 square meters of exhibition space, operated for a month, and attracted thousands of global leaders and delegates, making it a cornerstone of environmental discourse at COP28.
Dinner In 2050
Role:
Lead Creative Technology and Design
"Dinner in 2050" is an AI-powered game by Tellart, transforming how we view food in relation to climate action. This immersive installation encourages sustainable eating through a playful experience. Guests use a microphone to share their favorite meal, and Tellart's AI then revises it using ingredients with lower carbon footprints, like substituting lamb with grasshoppers. The experience highlights the environmental impact of food choices, focusing on water and energy use, carbon emissions, and nutrition.
Responsibilities
- Ensured the creative vision was maintained throughout the project.
- Coordinated the installation setup, which included three servers, Kinect, projection mapping, audio systems, and presence detection technology.
- Applied prompt engineering techniques to optimize AI performance, using methods like Chain-of-Thought for identifying food ingredients from text transcriptions, and Self-consistency to ensure ingredient safety.
- Advance projection mapping and calibration
- Show control design
Challenges
- Managed the complex integration of various technologies, including AI, projection mapping, and presence detection systems.
- Collaborated with multiple teams to ensure seamless operation and delivery of the interactive experience.
- Troubleshot AI model performance issues through prompt engineering and fine-tuning.
- Filtering out unsafe or irrelevant ingredients to ensure accurate and safe representations in the AI-generated meals by prompt engineering and post processing responses. Using Chain-of-Thought to help the LLM identify food ingredients from transcriptions and Self-consistency to verify ingredient safety.
Implementing advanced techniques like LoRA and ControlNet for specific needs, such as generating consistent plate designs.
Our Resilience
"Our Resilience" is an audiovisual projection mapping project, designed to subtly evoke the presence of animals in desert environments, specifically within the UAE. As guests walk by, the tracks of camels, beetles, spiny-tailed lizards, oryx, and snakes are projected onto the dunes, playfully integrating the variety of animals inhabiting these landscapes. This random display of animal tracks, each distinct and unique in appearance, creates an immersive experience where visitors feel as though they are 'walking' alongside these creatures.
Responsibilities
- Led the creative process of selecing and generating over 25 unique footprint animations.
- Randomized play back of these animations and synchronized them with spatial audio using a custom Max application.
- Advanced projection mapping.
- Managed the logistical aspects of setting up and maintaining the installation.