in this blog post we want to spend some time updating you on a lot of what is happening on the project.
Since our first group meeting (basically the day we met and formed the group) we have been thinking about possible ideas we would like to work on this semester. Naturally, this idea has to be possible to implement and within the limits of our resources. On the one hand, we thought about modifying existing systems into their respective multimodal version. We would achieve this by adding several input and output modalities (check our 2nd blog post for a more detailed description of the project work). For example, we thought about creating a multimodal version of a calculator by adding several different ways of input possibilities as well as output possiblities. This was one possible way on taking on this project but in the end modality was not the key feature of these kind of ideas. That is why we decided to keep on trying to come up with something more nice and sublime. Then Linh came up with a great idea where we all instantly thought “this has to be the one”.
So basically, we want to implement different short, simple and challenging games, so called minigames. The style of the minigames varies because of different input modalities we will choose for this system.
This is a work in progress idea so we still haven’t finalized our decisions but for now we would like to implement games which are based on simple touching/tactile inputs by using a Nintendo Wii Remote (10 easiliy accesable buttons, probably the Plus version) and possibly even trying to find use of the accelerometer. In addition, the Microsoft Kinect would serve as a visual input. We still haven’t decieded on what kind of visual recognition we would like to implement (e.g. full body recognition, face recognition, gaze tracking). Interestingly, we also thought about some kind of pulse meter for another optional input. On of our ideas was that as soon as your pulse rises, the difficulty or speed of the game will rise too (but still, just an optional thought). The output will be visual and sonic, so graphic generation (display) and sound generation (maybe some fancy things like 3D sound generation and or playing of simple sounds).
In the following, you can see wip titles of games which are listed on our “possible-to-implement list”:
Catch Me If You Can – Catching a moving point using certain buttons
Duck Hunt – Shooting objects, which are moving on the screen
Hit The Ball Back – Basically baseball, maybe with some kind of speed recognition
Don’t Touch The Objects – Evading moving objects
Draw Something – Drawing by gesturing
Different Sport Activities
There is still room for more ideas but this is what we initially came up with. For now, we try to get more familiar with our input choices and try to see if these devices can do everything we want them to do or rather how we would like them to function.
That’s all for today, see you next week!