RSS Feeds
Computers
Apple Multi-Touch Data Fusion Adds Camera, Voice, Force Sensors
Posted by Jesus Diaz at 7:53 PM on September 4, 2008
Apple has been working in new multi-touch technology that combines touch interfaces with input from the camera and the microphone. For example: this will allow you to select text in the iPhone, say "copy," go to another application and say "paste" to make this task really easy. The most intriguing part, however, is the use of a camera in laptops and desktops.
This will require two cameras, one for video chat and the other for the "hand reading," but it opens a lot of possibilities. To start with, the entire keyboard can become a gesture control pad without even having to touch the surface. In addition to that, it can be combined with actual touch technology to identify single fingers on the surface, with the possibility of assigning specific functions to them.
The system even contemplates combining all this with accelerometers and force sensors, so the touch action can generate secondary data. One example of this may be applying a deformation effect to an image or a sound effect to a music track, giving it more or less strength depending on the force you use in your action. [USPTO via Unwired View]
Comments (AU Comments · US Comments)
There are currently no AU comments for this post.
Stacky Botrus
Posted 8:30 PM 4/9/08
Is this all really necessary? Maybe I am a deaf mute and cannot copy and paste because of this? Boy, apple really mean to the deaf-mutes.
Stacky Botrus
Git Em SteveDave is starlost
Posted 8:07 PM 4/9/08
Force sensors? So rather then beep, does it go "This is not the document you are looking for, move along"?
Git Em SteveDave is starlost
cobaltage
Posted 8:05 PM 4/9/08
I'm going to fly to the nearest Apple store using my water-powered, zero carbon-footprint jetpack as soon as this computer is available.
cobaltage
cobaltage
Posted 8:43 PM 4/9/08
@xanderbeedle: I don't know when I'm being sarcastic anymore.
cobaltage
takashimiike Ultimate
Posted 8:42 PM 4/9/08
Hah look who's playing catch up now!!
takashimiike Ultimate
xanderbeedle
Posted 8:41 PM 4/9/08
@cobaltage: You'll probably just have to use your petrol-powered car like the rest of us...
xanderbeedle
xanderbeedle
Posted 8:39 PM 4/9/08
If no-one ever said stuff like this was necessary we'd all still be typing on the command line with a yellow/black monitor...
Imagine 20 years in the future -
"Reply to : Apple announces new iPsy, the computer interface of the future"
"I'm not sure I want to plug my mind into my mac thanks, I'm perfectly happy with my sense interface, who out is too lazy to actually use their hands? The tried and true video/touch/feedback combination is good enough for me : ) "
xanderbeedle
taciturnforsale
Posted 8:59 PM 4/9/08
wouldn't this set up the iphone to be able to copy and paste from it to a notebook or desktop? maybe transfer the information over wireless. now that is a feature I've been wanting for a long time. I might even be willing to go mac for it. I'd still stick with a PC workstation though.
taciturnforsale
PollockRoc
Posted 9:25 PM 4/9/08
@cobaltage: I prefer to take my go-kart, powered by my own sense of self-satisfaction
PollockRoc
tridtaei
Posted 9:47 PM 4/9/08
this is the reason i hate most DS games. I don't like to talk to my electronics
tridtaei
billy-g
Posted 9:43 PM 4/9/08
Imagine... flipping in front of your screen and the mac does all the cursing for you. That makes life a whole lot easier.
billy-g
billy-g
Posted 9:42 PM 4/9/08
They could also use this for "non surface" or "in air" interactions. Just like in minority report.
billy-g
chizelord
Posted 9:41 PM 4/9/08
@cobaltage: I can fly...
chizelord
ps61318
Posted 10:33 PM 4/9/08
I mean haloed.
ps61318
ps61318
Posted 10:33 PM 4/9/08
@Ayeco: Blasphemer! Enough with the crazy talk.
@billy-g: I worry most about what happens if I scratch my nose in the middle of something important - does some poor innocent schlub get holoed?
ps61318
rb4dv
Posted 10:30 PM 4/9/08
@Ayeco: [www.apple.com]
rb4dv
Ayeco
Posted 10:20 PM 4/9/08
Multitouch? What next, a mouse with more than one button!?
Ayeco
Zarian
Posted 10:47 PM 4/9/08
Seems interesting but how much horse power does it actually use?
Zarian
hakubak
Posted 10:41 PM 4/9/08
Wait, what?
Oooohhh! Now I get it. They left copy/paste off of the iPhone so that you could get it with this thingy.
hakubak
Git Em SteveDave is starlost
Posted 10:37 PM 4/9/08
@Ayeco: No one could operate a mouse with more than one button. No-one can live at that speed! What? The Dutch have five buttons a, a scroll wheel, and smoke marijuana? Yes, but they're cheating!
Git Em SteveDave is starlost
billy-g
Posted 11:16 PM 4/9/08
@Mayor McRib: Just do a fapping gesture and it'll open safari in "private mode." Me needs one.
billy-g
Mayor McRib
Posted 11:14 PM 4/9/08
Pron will never be the same.
Mayor McRib
billy-g
Posted 11:13 PM 4/9/08
@ps61318: It'll be the new generation of typos =D
billy-g
DisposableInterloper
Posted 10:58 PM 4/9/08
So basically, they're taking run-of-the-mill voice control software and, for the Macs, are tossing in Toshiba's air gestures?
If this does reach market, Apple might just be the first to really pull it off.
DisposableInterloper
Mayor McRib
Posted 11:21 PM 4/9/08
@billy-g:
You sir, are a genius.
Mayor McRib
snowy_coke
Posted 12:37 AM 5/9/08
@Mayor McRib: LOLZ
snowy_coke
iscangel
Posted 1:13 AM 5/9/08
Ohh boy maybe really soon we will see a Minority Report OS !!!! maybe on OSX 12??
iscangel
Mark 2000
Posted 1:26 AM 5/9/08
Why does anyone bother with voice control? its idiotic. You can't have 20 people in a library/office/cafe/airplane/bedroom all giving voice commands to their computers. It would be audio anarchy and pollution.
Mark 2000
skanko
Posted 1:42 AM 5/9/08
i think you mean
iANARCHY!
skanko
Kevin
Posted 1:40 AM 5/9/08
Ha, I see Apple hired an illustrator that can draw hands
Kevin
TonyTriple
Posted 1:39 AM 5/9/08
C'mere boy! C'mere Apple! Now..Copy.
Good Laptop!
Now..Paste!
Very good.
Ok, you want my money, boy? Huh? You want the money?
Drop the price, boy. Drop it!
I said drop the price Apple! Drop the price for my money.
No?
Damn this breed is stubborn.
TonyTriple
Tastic7
Posted 2:51 AM 5/9/08
@billy-g: The first thing that popped into my head after reading this was Minority Report. I've always wanted the ability to interact with a computer using mid-air hand gestures.
This is exciting!
Tastic7
barkolounger
Posted 2:48 AM 5/9/08
I believe Apple become the first to bring gestural interface into mainstream with the iPhone. HP's touch replicates much of the iPhones model into a touchscreen computer.
Apple had best be ready to bring gestural interface to a tablet or touchscreen computer and do so with a rock solid UI experience.
That said, Apple won't do so before they can determine that there exists a viable market for such computers.
Oddly, as sexy a device as a touchscreen tablet seems to be, netbooks are proving to have greater demand.
I think a touchscreen netbook size-factor might be the best niche for Apple. Touchscreens are overkill on systems with physical inputs, keyboards, mice, cameras, trackpads, buttons etc... And touchscreens are not cheap.
A 10 inch high-resolution wafer-thin UMPC-like form factor with minimal physical buttons and a iPhone-esque gestural interface and a $599-$799 range price point could be an instant category killer for Apple.
Who knows what Apple will do or when, but from patent filings it seems like they are poising themselves to enter this category in the foreseeable future.
barkolounger
Git Em SteveDave is starlost
Posted 3:04 AM 5/9/08
@Mark 2000: And you know since it's Apple, at least one person will be doing a Scotty impression, which then makes more people do one, and then it's total anarchy.
+ Watch video
Git Em SteveDave is starlost
jp.rider63
Posted 7:21 AM 5/9/08
What happens when you want to copy/paste when you can't talk? Ex. in class...
jp.rider63
videoCWK
Posted 11:55 PM 5/9/08
Well what are you donna do when you can't leave the house without hearing someone copying and pasting?
videoCWK
Xenocide
Posted 4:14 AM 6/9/08
Why would you want gesture control in the area above your keyboard when you already have all those useful keys right there? I don't get it.
Xenocide