Gesture-based games using camera phones
We have developed a collection of mobile phone games that incorporate physical gesture interactions. Users interact with the game by physically moving the phone in free space. For example, in Pong, a user moves the phone left and right to control the paddle. The games do not rely on special motion sensors. Instead, they use the mobile phone's camera as the 'motion detector.' By using computer vision techniques like motion blur detection and optical flow it is possible to detect up to 6 degrees of freedom. We have developed three entertainment applications to explore this application domain. The first is a simple single player 'Pong' game. The second is a 'Doodle' application that demonstrates the various degrees of freedom. The third is a multiplayer version of the 'Pong' game that leverages the Bluetooth capabilities available on many camera phones.
Telegotchi is an electronic pet based game for your mobile device. However, unlike tradition e-pet games, the emotional state of your pet is linked to the physiological state of other players. There are two types of players in this game, ``Pets'' and ``Adopters''. Pets wear a small, wireless sensor that measure physical/physiological responses and have a corresponding e-pet persona. Adopters are the caregivers for the e-pets. An e-pet personality is based on the stress and activity levels of the corresponding pet player. Adopters can interact with their e-pet in one of two ways: (1) SMS with the pet player directly; (2) interact with e-pet within your mobile device (allowing the pet player to influence the e-pet persona, but not be directly involved in the adopters game). Adopters should play with their e-pet when it is bored, tell the e-pet jokes when it is sad, and take the e-pet for walks when it is feeling lazy. At the end of the day, adopters can rate how they like their e-pet, and have the option to exchange them for a new e-pet. Likewise, interactive pets can rate their owner and have the option to stay with them or run away. Thus, players can compete to be the most loved pet and/or adopter.
Camera Luminarium is a free-form, mixed reality puzzle game played with a camera-equipped mobile phone. The player enters a room with a number of objects and a locked box. By taking pictures of special barcodes on the objects, the player reveals elements of game's storyline which display on the phone. Clues in the story help players discover how the
player can interact with the objects, how various objects can interact with each other, and how new barcodes can be revealed or unscrambled. The goal of the game is to gather all of the necessary clues to unlock the box and claim the prize inside.
Pixelation:: Visit the site ::
Pixelation is similar to the parlor game Telephone, where an original sentence is whispered around a circle of friends and radically changes its meaning over time. The difference is, with Pixelation, you're taking pictures with your cell phone, and sending them across a continent.
Operation Clyde :: Game Documentation ::
Operation Clyde is a multiplayer video game, where the players control their ghost avatars through their cell phones. By calling the game's telephone number, and using the number pad as a controller, players move their ghost through the Pac Man maze, hunting down the elusive pellet gobbler.
Cell Phone Scavenger Hunt:: Game Documentation ::
On Saturday, October 23, 2004, the Mobile Technologies Group held its first cell-phone based scavenger hunt. Several teams competed and solved clues scattered throughout the Georgia Tech campus. Clues were delivered in the form of text messages and cryptic phone calls.
The game lasted approximately two hours. Clues inspired players to dive into fountains, run miles between various clues stations, interact with local merchants, scour the library, and discover the hidden relics and monuments of Georgia Tech.
Mobile Omega Battle:: Game Documentation ::
The Mobile Omega Battle took place on Saturday, November 6, 2004.
return to top
News! This project has officially been selected for and funded by the Art in Freedom Park public art exhibition, and will be exhibited in Atlanta beginning May 1, 2005.
Storyscape is an unique urban experiment in community storytelling. From October through December, 2004, hundreds of orange stickers bearing the question "You are here... Why?" were placed throughout the city of Atlanta, from coffeehouses to park benches to public restrooms.
We invite the greater Atlanta community to share their stories with us using their cellular phones, either via SMS or voicemail. By dialing in, you will be contributing to a unique, dynamically growing collection of stories being generated by hundreds of people all over the city of Atlanta.
:: Visit the Storyscape Web site ::
Location-based Audio Narrative Generator (LANG)
LANG is a system for creating locative audio experiences for use with any cellphone. Audio is first recorded by the designer and then organized for interactivity via an XML file structure. A computer running the Skype voice-over-IP (VOIP) program can then automatically and interactively drive the user experiences. The XML structure that defines the interactivity allows for quick and flexible setup of these experiences by non-programmers. For purposes of demonstration, we have translated the augmented-reality experience "Voices of Oakland" into a LANG experience, highlighting both the power and the flexibility of this system.
return to top
InterVis Phone Interface
The InterVis Phone Interface is a program that allows applications to use cellular telephones as controllers without forcing the user to download software to their phone. Using DTMF and other audio cues users can interact with remote programs. For this demonstration the interface is used to control a simple music visualization program written in Java.
Citizen Dispatch is a software application for soliciting and organizing media (photos, audio, video, etc.) from the general populace for news agencies. News editors add requests for content, which are accessible via mobile phone based on the user's current location. The system handles all archiving and tagging, enabling seamless integration into the publication and media library.
return to top