Me and You vs. AI
You and a friend use your voices to interact with Gaya, an AI goddess who challenges you with puzzles while you journey to uncover the mystery of a submerged world.
"Me and You versus AI" is an innovative Master thesis project, created over the span of 5 months, that delves into the intersection of mythology, artificial intelligence, and cooperative gaming. Inspired by Hindu mythology and the cultural practice of scattering ashes in the River Ganges, the game presents a poignant narrative of two estranged siblings on a journey to honor their deceased parent. This journey, however, is complicated by Gaya, an AI deity embodying the river, who has her own enigmatic motives. In a world where faith and technology often clash, this project reimagines AI as both a companion and a challenge, reflecting society’s complexities and our evolving relationship with technology. Through advanced natural language processing (NLP), the game enables real-time dialogue and role-playing, making AI a central element of the gameplay. This project aims to explore the potential of AI not just as a tool, but as an engaging partner in cooperative gaming experiences.
This project was the recipient of the Hessen Abschlussförderung (HAB) scholarschip and a final perfect grade of 1.0.
The solution presented by "Me and You versus AI" is a groundbreaking cooperative gaming experience that integrates advanced AI technologies to create a deeply interactive and personalized adventure. By leveraging state-of-the-art NLP, speech recognition, text and image generation, and speech synthesis, the game enables players to engage in meaningful conversations with Gaya, the AI deity. Gaya's interactions are not merely for show; they are integral to the gameplay, guiding the players through puzzles that require cooperation and relationship-building techniques. The AI adapts to the players' dialogue, interests, and actions, making each playthrough unique. This complex game architecture allows for a seamless and immersive experience, where AI not only mediates and influences the game world but also challenges the players' perceptions and decisions. By testing and refining these interactions through a robust prototype, the project demonstrates the potential of AI to transform cooperative gaming, highlighting the indispensable role of human developers in crafting these dynamic and engaging virtual spaces.
Technologies used range from OpenAI's Whisper and GPT modules, ControlNET via Stable Diffusion API, LipSync Plugin, and more. Please read the following articles for more information.
Read More: Colloquium | Research Abstract | AI-driven puzzle design | Conversational AI Framework Development inside Unreal Engine
%20(1).gif)
%20(1).gif)
