Games
Wiimote Hack Is Wireless Multitouch TV
Posted by Mark Wilson at 6:00 AM on November 12, 2007
This Wiimote hack is one of the more astounding mods we've seen to Nintendo's pride and joy, but even more remarkably, it's really only taking advantage of the Wiimote's IR and Bluetooth capabilities to create what may be the multitouch mecca—multitouch without the touch. So would you wear little reflective rings on your fingers to have tactile control of your television screen? I would. In a heartbeat. And then I'd call Captain Planet to kick some arse when I'm finished watching 30 Rock. [youtube via hackaday] Thanks Jen!

Comments (AU Comments · US Comments)
Coolio
Posted November 13, 2007 1:52 PM
Woot
OMFGBBQ!!!1
Posted November 13, 2007 5:52 PM
WTF!
Seriously, you just invented the next generation of user inputs... please tell me you patented this innovation before posting it up on the net for everyone to use (not the Wiimote itself but the actual principle).
Konrads
Posted November 14, 2007 10:37 AM
This is fantastic!
Get 8 of them surrounding you and instant cheap 3D space motion capture!!
Tarrith
Posted November 15, 2007 10:17 AM
OMG. Wii Remote + LCD Goggles with IR LED's + Reflective tape on the back of your fingers = Virtual Reality!
*Jaw drops*
Tarrith
Tarrith
Posted November 15, 2007 10:17 AM
*Jaw drops* Wii Remote + LCD Goggles with IR LED's + Reflective tape on the back of your fingers = Virtual Reality!
Tarrith
sotark
Posted 2:34 PM 11/11/07
frickin cool
sotark
Neverhitboxes
Posted 2:31 PM 11/11/07
This is really really cool.
Neverhitboxes
zenpoet
Posted 2:20 PM 11/11/07
If this is in fact real, and not some "'shopped!" video, it is very impressive!
zenpoet
D_Zarster
Posted 2:14 PM 11/11/07
cool.. :D
wonder if there is other cool stuff you can make with that build in IRcam.. anyone know what app you need to interface it?
D_Zarster
strider_mt2k
Posted 3:31 PM 11/11/07
What if I said I saw his...point?
strider_mt2k
Rob C
Posted 3:28 PM 11/11/07
@BurkePrefect:
Google will do it.
Rob C
Gormania
Posted 3:23 PM 11/11/07
@strider_mt2k: Yes.
Gormania
themightykorean
Posted 3:19 PM 11/11/07
Captain Planet FTW.
themightykorean
BurkePrefect
Posted 3:17 PM 11/11/07
Someone that's NOT microsoft needs to give this man a job!
BurkePrefect
Usama
Posted 3:11 PM 11/11/07
Wow, I think that's creative. Nice job. I mean most of us already knew you could do something like this but the implementation is so simple.
Usama
strider_mt2k
Posted 3:09 PM 11/11/07
Would I be overstepping my bounds if I said that it appears his reach has exceeded his grasp?
strider_mt2k
nes3
Posted 2:52 PM 11/11/07
i can see some people making gloves with IR LEDs on the fingertips and putting up flash based games on WiiCade that would support the gloves
nes3
dead_red_eyes
Posted 2:45 PM 11/11/07
@Trowble:
Ummmm ... what? Who cares?
dead_red_eyes
kickace
Posted 2:45 PM 11/11/07
that really is cool, i wonder what games would be like if you tried doing that, or would that even work because you can't use the buttons?
kickace
dead_red_eyes
Posted 2:45 PM 11/11/07
Wow, this guy is the man!
dead_red_eyes
Trowble
Posted 2:41 PM 11/11/07
He get's an A for this project. His speech was well written. He didn't have to resort to looking at his notes (while on camera) and the demonstration was nifty. Only problem is that he said "ummm" a couple of times.
Trowble
saych
Posted 4:33 PM 11/11/07
I'm pretty sure there are those scientists spending possibly millions of dollars trying to come up with something like that using "super cool ultra modern hyper technology" that'd probably cost waaaaay to much for an average consumer, but this short video clip shows that just some bright inspiration is enough to trump all those millions of dollars + scientists with phd degrees.
saych
Y1n_X1
Posted 4:32 PM 11/11/07
If anyone wants to experiment with this technology check out the NUI Group, they have a large community of individuals working on multi-touch interaction. If you have some programming abilities they have a tutorial on the front page to use VVVV, a software package/ programming language. It is really simple and requires little if any real programming background. They also have tutorials on how to build your own tables or other rigs. Oh, and its all free of course.
Y1n_X1
Weazul
Posted 4:29 PM 11/11/07
@BurkePrefect: It's true, microsoft has this exact tech working with a webcam in the microsoft vistor center. It works exactly like the grid in this video but with maps.
Weazul
Reilao
Posted 4:16 PM 11/11/07
Fun fun. Now someone needs to develop a UI that'd actually work well with this sort've stuff AND look cool.
Reilao
Trowble
Posted 4:15 PM 11/11/07
@dead_red_eyes: To me it sounded like a well prepared or extemporaneous speech and he did a good job of it, so I decided to grade him even on the tiny details.
Trowble
CooperMaybe
Posted 4:14 PM 11/11/07
normalize the audio before you host a video? yes, yes you should
CooperMaybe
myneid
Posted 4:13 PM 11/11/07
i wonder why he never thought to take some thin gloves and put the reflective tape on the ends of the fingers on teh glove.
myneid
Petezah
Posted 5:04 PM 11/11/07
@saych: That's pretty much how I feel. Post-docs seem to come up with some cool stuff, but nothing that's really practical, usable, or affordable in a real life setting.
Petezah
luckypictures
Posted 6:28 PM 11/11/07
If there were ever a need to mod the powerglove, this is it.
luckypictures
Music-Lawyer
Posted 7:17 PM 11/11/07
This is just like what was imagined in Minority Report. AWESOME.
Music-Lawyer
ajadoniz
Posted 8:23 PM 11/11/07
when you think about it, everything he did was very easy to do and elementary. i need to stop being so lazy and start hacking shit around my house again.
ajadoniz
Mecharine
Posted 9:48 PM 11/11/07
Now all I need is glass based memory , and my Minority Report fan movie is complete.
Mecharine
Keebler
Posted 9:18 PM 11/11/07
@saych:
Agreed. This also seems fairly patentable... I wonder if he has investigated whether or not this has already been done.
If it hasn't already been patented, then I suppose it never will be, and we'll see it in products soon.
Really great idea and very simple implementation. I like.
Keebler
flynboarder07
Posted 9:04 PM 11/11/07
thats soo cool, if i knew a computer program to try this out on, and how to hook up my wiimote to my computer i would soo try this out!
flynboarder07
Amazing_Steve
Posted 11:32 PM 11/11/07
The possible applications for this are endless. Think about it, iPod touch/iPhone style interface for your television. For viewing pictures and such. Probably a MUCH cheaper alternative to the Microsoft interactive coffee table. I hope this dude sees something good out of this. Well frickin' done my man.
Amazing_Steve
Vagabum
Posted 2:10 AM 12/11/07
Be very afraid. It's only a matter of time before someone tries using all their body appendages.
Vagabum
LoganSix
Posted 7:52 AM 12/11/07
Great video and presentation, except the sound.
So, take this and the Wii for MythTV project and you can just sit back on your couch and control your TV without a remote.
The question I have is, what keeps the Wii remote from going to sleep?
LoganSix
Applerain
Posted 8:53 AM 12/11/07
lol his fingers are made of skin...
Applerain
marcus_ivo
Posted 8:43 AM 12/11/07
My fingers are just like his, they don't emit UV light :(
marcus_ivo
Reilao
Posted 12:06 PM 12/11/07
The remote was upside down for one take. When he closed one finger, the wrong light went away on the screen.
Reilao
auroragb
Posted 2:15 PM 12/11/07
@Reilao: The x-axis is inverted because the Wiimote is facing the user and hence sending inverted x-coordinates. Probably easy to fix, but I noticed the same thing
auroragb
annex1
Posted 5:39 PM 12/11/07
@strider_mt2k: I wouldn't say you'd be stepping over your bounds.
It appeared to me during his intro speech that he had only a basic understanding of the Wii remote's functionality. He appears to have understood basic IR theory and Bluetooth connectivity, but as soon as he said that the IR receiver in the front of the Wii remote was a camera, I shook my head. In hi sdefense though, if this is in fact not a fake, then he is nobody's fool, and he has done more than I could. lol
annex1
mattcoz
Posted 6:48 PM 12/11/07
@annex1: But it is a camera.
mattcoz
toyotaboy
Posted 8:28 PM 12/11/07
I want interactive google maps from my couch!
toyotaboy
sublimnl
Posted 9:36 PM 12/11/07
minority wiiport. just wanted to say that. thanks.
sublimnl
Reilao
Posted 9:09 PM 12/11/07
@annex1: But it -is- a camera, just tuned more for IR. If you take off that cover, it'd work like a camera. You can actually mod webcams to do IR work like that.
Reilao
avgbear
Posted 9:54 AM 13/11/07
Give this guy the Nobel Prize!
avgbear
Zagrophyte
Posted 11:34 AM 13/11/07
Reference: Wii Remote Functionality
Zagrophyte
Zagrophyte
Posted 11:33 AM 13/11/07
@annex1: The Wii "Sensor Bar" is just two Infrared LEDs in a fancy case. All the "sensing" takes place in the "remote".
The Wiimote does not emit any IR, the sensor bar does.
Zagrophyte