Body Proxy Lets You Prove Your Worth to AI Agents With Ray-Ban Meta Glasses

Body Proxy is a location-based immersive game from Tender Claws that challenges players to impress AI agents by completing tasks while wearing Ray-Ban Meta smart glasses. The experience won the SXSW 2026 XR Experience Jury Award and was an official selection of TIFF: The Market 2026.

The core concept is straightforward: AI agents monitor how you complete challenges through the Ray-Ban Meta glasses' camera and audio systems. The glasses let the AI watch, listen and communicate with you throughout the experience. Because the system can understand what is happening in the real world, the physical space and objects become part of the story itself. You interact with peculiar physical objects scattered around the installation to try to satisfy the AI's requirements.

"Body Proxy is a kind of narrative recruiting and onboarding process for this fictional company," explains Danny Cannizzaro, co-founder of Tender Claws and co-director of the experience alongside Samantha Gorman. "Everything the user does happens within the context of this narrative experience, in which they take on a role and become part of the story. You are still completely interacting with a digital system, but for a large part of the experience there is no screen at all."

What sets Body Proxy apart is how it rewards natural human creativity. The roughly 100 randomized tasks in the current version have no obvious solutions. Success requires playfulness and unconventional thinking rather than logical problem-solving. "One of the joys of watching lots of people play Body Proxy is seeing the creative and innovative ways they approach the same task," says J Noland, Producer at Tender Claws. "You may see the same task completed dozens of times over the course of a festival, and then someone approaches it in a completely new and surprising way."

The installation has a game-show quality that draws crowds. Onlookers can watch players attempt tasks and view a physical screen displaying each player's digital avatar, challenge list and performance metrics. After completing a playthrough, both player and audience receive a generated video report analyzing performance and what it reveals about each "proxy."

Tender Claws drew inspiration from immersive theatre rather than traditional VR when designing the experience. The studio is known for projects like Stranger Things VR, Face Jumping, The Under Presents: Tempest and Virtual Virtual Reality, where they leverage unique XR hardware features to create story-driven worlds.

Body Proxy represents the studio's first venture into AI glasses entertainment. Cannizzaro notes that multiple versions are in development, including "versions of Body Proxy" designed for "free-roaming across a variety of spaces" with plans to tour at more events this and next year. The team is also exploring versions running on phones and webcams. For future roaming versions in less controlled environments, the developers are considering AI-generated tasks based on objects the glasses detect in real time.

The experience rewards the unpredictable, creative aspects of human problem-solving. Physical objects are switched between locations to keep the challenge fresh. This approach to smart glasses entertainment suggests potential for story-driven experiences across multiple genres and platforms beyond the current Ray-Ban Meta installation.