Regulars
Giz Explains: The Magic Behind Touchscreens
Posted by Matt Buchanan at 4:00 AM on August 14, 2008
Touchscreens. They're everywhere, as if electronics makers aren't cool unless their phones or media players have them, and soon that will be true for laptops as well. Touchscreens aren't going to completely replace the mouse and keyboard in the next year or two, but we're hurtling toward a future where they're the dominant way we interact with devices. The catch is that "touchscreen" can describe a few very different technologies that all perform a similar function. Here's a breakdown of the most popular techniques for making touchscreen magic happen—and the crazy new techniques that will succumb to your caresses in years to come.
At a basic level, they all perform the same function--sensing a disturbance in the force when your finger or stylus or whatever pointy object you've got touches the screen, and then extrapolating that into knowing where you're touching it and relaying that to the software. The differences lie in how each screen detects a touch.
Resistive touchscreens are the ones you've probably put your greasy fingers on more than any other kind, mostly because they're the cheapest and oldest. They're in most touchscreen mobile phones, many tablets and the Nintendo DS, to name a very few.
How it works: On the bottom you've got a layer of glass, and on top of that, you've got two more: a conductive and a resistive layer. They've got a sliver of space between them. And on top of that you've got one more layer, which is the one you touch. So, when you push down on the screen, the conductive and resistive layer touch each other, which changes the electrical current running through 'em, and the device can tell from that where your finger or stylus is touching.
Good and bad: While resistive is a good deal cheaper to manufacture at the moment, one downside is that it's hard to do multitouch, because of the constraints and shortcomings of a pressure-based system. Another problem is that the multiple layers of touch technology on top of the LCD block an awful lot of light—think of how much dimmer the DS's bottom screen is than the top one.
Capacitive touchscreens are a bit fancier. They used to be really expensive, but the costs are coming down, so you're seeing them in more stuff, like this touchscreen phone from Apple you might have read about, or Dell's Latitude XT tablet.
How it works: At its most basic level, you've got a layer on top of the actual display panel that has an electrical charge running through it. Since you've got your own electrical mojo going on, when you touch the screen (presumably with your finger), it registers an electrical change. By measuring how much you're mucking up the electrical field and where the biggest disturbances are, the device can determine where you're touching it.
Good and bad: It's far easier to do multitouch with capacitive, and fewer added layers mean more light comes through for a brighter display. Still, because it's all about electrical fields interacting and conductivity and stuff, a hand with a mitten on it will have a hard time making stuff happen, and if you wanna use a stylus, you'll need a special one.
Infrared touch sensing, currently most famously used by Microsoft's Surface table, takes a slightly different approach. Because it works well with larger products, you might end up seeing this one quite a bit, especially from Microsoft.
How it works: Basically, the image on the surface is projected from underneath it, along with infrared light. Also underneath are infrared cameras that can see when the light is reflected by objects (like your fingers or mobile phones or whatever), and those images are processed and translated as you move and gesture with pictures and virtual objects.
Good and bad: The good thing about this is that it uses existing technologies that come very cheap; the bad news is that the apparatus itself can be bulky, hence the need for Surface to be hidden inside a table, or at least a large globe. Also, it's sensitive to light, so flash photography or strong sunlight can throw off its game.
More, more, more!! There are some \way more advanced touchscreen technologies that aren't yet in wide use. The surface wave acoustic system uses tranducers and reflectors that detect if the ultrasonic waves being sent between them are disturbed (absorbed, actually), meaning something is touching it. Upside is that no metal crap in the panel means 100 percent brightness and awesome clarity. But apparently dust and crud can affect it, so not good for anywhere dirty.
Sharp and others have released prototype touchscreens with optical sensing tech built directly into the display. They are sensitive enough to detect your finger rubs right down to the pixel. Besides making multitouch easy, it can also double as a scanner because of the whole optical deal. Right now it's for small screens like phones—it can scale to notebook size, but not any larger. Of course, they, like infrared, can be affected by undesired light fluxuations.
Mary Lou Jepsen—the engineering honcho behind OLPC's original XO Laptop and founder of the Pixel Qi LCD development firm—told us recently she is pushing for in-cell touchscreen tech, which would make touchscreens cost the same as regular LCDs and be the same thickness, since touch sensitivity would be part of the LCD's own matrix. The issue is that it'll only work with devices specifically coded to use it; it's not a plug-and-play touchscreen like you could order online for your home DIY fake iPhone. If you're wagering that this secret sauce will help achieve the impossibly low pricetag on OLPC's next baby, the XO-2, you win a cookie.
And that's just about everything you need to know about touchscreens to get by. Resistive and capacitive are the major two to know for now, though you might start hearing a lot more about the other ones soon enough.
Something you still wanna know? Send any questions about touching, feeling or screening to tips@gizmodo.com, with "Giz Explains" in the subject line. Top image from David Nguyen, featured in this Giz Photoshop contest.

Comments (AU Comments · US Comments)
There are currently no AU comments for this post.
Number_41
Posted 4:28 AM 14/8/08
@Kaveh: @Ajax:
Actually we're talking about screens here. Whenever apple talks about their "multi-touch" technology they always refer it to how their glass screen technology enables it. However, that is the wrong term associated with it. Sure the technology may enable you to play a game with 2-3 fingers, but that doesnt change the fact that the technology used for your "3 finger game" is known as dual touch and not the commonly known name, multi touch.
Number_41
matt buchanan
Posted 4:28 AM 14/8/08
@Noobs-R-Us: Who are you?
matt buchanan
lilaliendog
Posted 4:27 AM 14/8/08
@Kaveh: thats what I was wondering must be some sort of alien math.
lilaliendog
Cliff_Dangers
Posted 4:25 AM 14/8/08
I'm all over touch screens... It's become so second nature to me now that last week when a friend gave me his non-touch phone to use because my battery crapped out... i started touching the screen without thinking.. then i discovered that going through menus without a touch screen really sucks!
Cliff_Dangers
reddingofish
Posted 4:25 AM 14/8/08
That explains why the industrial 19" touch screens I bought earlier this year cost $2200 ea.
reddingofish
Ariel_Wollinger
Posted 4:24 AM 14/8/08
@jcrockerman: LOL
Ariel_Wollinger
Ariel_Wollinger
Posted 4:23 AM 14/8/08
@Number_41: well said!
Ariel_Wollinger
jcrockerman
Posted 4:22 AM 14/8/08
@Ajax:
Where I'm from...we call the three fingers....THE SHOCKER..
jcrockerman
Kaveh
Posted 4:19 AM 14/8/08
@Number_41: Are you saying "Multiple" can't describe "Two?"
Kaveh
clockradio
Posted 4:17 AM 14/8/08
What's with all these red balloon quote boxes lately? Is Perez Hilton working over there now? Are we going to be seeing drool and other bodily fluids leaking out people's openings?
clockradio
xaflatoonx
Posted 4:15 AM 14/8/08
Good article!
xaflatoonx
Ajax
Posted 4:15 AM 14/8/08
@Number_41: I downloaded a game that knows the difference between two fingers and three. So, you're wrong. It's called Cubicman, and it uses two finger touches to zoom in, and three to zoom out. Or the other way around, I don't remember, but you're still wrong.
Ajax
karasu is my homeboy
Posted 4:13 AM 14/8/08
This was such an awesome article.
Thanks for it.
karasu is my homeboy
Scott
Posted 4:12 AM 14/8/08
This may be news to some but touchscreens have been around a lot longer than the damn iPhone :)
Scott
Waka in Japan
Posted 4:11 AM 14/8/08
@DUOPHONIX.com: I don't think it does.
Waka in Japan
Noobs-R-Us
Posted 4:10 AM 14/8/08
Hey Matt, thanks for stealing my idea from the post about possible touch screen Macbooks. You're welcome!
Noobs-R-Us
DUOPHONIX.com
Posted 4:06 AM 14/8/08
What about the DS having pressure sensitivity, it knows how hard you are pushing.
DUOPHONIX.com
Number_41
Posted 4:06 AM 14/8/08
Um the iphone isn't multi-touch, its actually Dual-Touch...
Number_41
Log1c
Posted 4:05 AM 14/8/08
-sensing a disturbance in the force
That's right kids, touchscreens all run on midichlorians.
Log1c
rockntrumpet
Posted 4:53 AM 14/8/08
So there is already a solution to using capacitive touchscreens when it's chilly outside.
[webworkerdaily.com]
rockntrumpet
hebrewbacon
Posted 4:53 AM 14/8/08
@VideoVampire: The problem with your idea is that it still requires devices that you have to hold. The obvious future solution is a contact-lens like display device that goes over both eyes. It would be able to go completely transparent when not in use, and provide a 2D or 3D view when needed. It would presumably work by streaming data wirelessly in real-time back and forth from extremely powerful back-end computers, which do all the number crunching. So it could sense where you're looking possibly by tracking your eyeball's acceleration, since it would actually be attached to it.
Or should I just go patent that idea before some rich person steals it?
hebrewbacon
Number_41
Posted 4:53 AM 14/8/08
@kellygeorge:
Alright bud..alright :)
Number_41
wvv
Posted 4:49 AM 14/8/08
I hope that touchscreens don't dominate laptops and desktops :(. They are nice for small devices like the iPhones of this world since the only alternative is a button based system, and they are nice for things like in-store interaction (such as what the Surface wants to do) and for things like ATMs, since again the only alternative is buttons. However, for full computers, what's wrong with a mouse? It is so much more efficient, and you only have to make small hand movements to do things that require large movements on a touch screen...
wvv
sammich!
Posted 4:49 AM 14/8/08
@Gizmometer: That workaround is a hoot! I suppose a Robert Barone style chin touch would work too. :-)
sammich!
Flynn_is_my_user
Posted 4:46 AM 14/8/08
I think you forgot the Frustrated Total Internal Reflection device that NYU started showing a while back. Maybe it is still sort of experimental so you left it out. Anyway it works similarly but slightly different from some of the other light detecting type devices.
Flynn_is_my_user
ninjamurf
Posted 4:42 AM 14/8/08
@Scott: "This may be news to some but touchscreens have been around a lot longer than the damn iPhone :)"
Um...yeah? That's why he went over resistive touch screens (past) and infrared, surface wave acoustic (future) touch screens AS WELL AS the iPhones capacitive system. Or are you just an Apple hater looking for an outlet?
ninjamurf
VideoVampire
Posted 4:42 AM 14/8/08
I HATE TOUCHSCREENS! Anyone putting their greasy ass paw prints on my shit better look out for the old baseball bat cranium kiss. I want an eyepiece that can read where I am looking to select items on screen and click with an extended blink. They had a similar thing on some attack helicoptors and I know they can do it, but I will NEVER like touchscreens.
VideoVampire
Gizmometer
Posted 4:40 AM 14/8/08
Nice summary of the different technologies.
"Still, because it's all about electrical fields interacting and conductivity and stuff, a hand with a mitten on it will have a hard time making stuff happen"
At least there's a workaround. :-)
Gizmometer
kellygeorge
Posted 4:34 AM 14/8/08
@Number_41: Incorrect. The iPhone is capable of registering more than 2 touches, the majority of apps just don't require more than 2 points. If you run something like PhotoBoard you can load multiple photos on the screen and grab and move them around simultaneously.
kellygeorge
swpoison
Posted 4:33 AM 14/8/08
Someone was bored...
Lol good article, very informative gwiz info
swpoison
sammich!
Posted 4:31 AM 14/8/08
Good informative stuff on the tech behind the touch.
Rewording the bubble-text in the photo: "It's only a touchscreen...Get over it."
sammich!
parliamentpoet
Posted 5:18 AM 14/8/08
good/job*
parliamentpoet
parliamentpoet
Posted 5:18 AM 14/8/08
Very informative, I never knew the differences and I liked how you broke down the goo/bad. Good Job.
parliamentpoet
Tex1961
Posted 5:16 AM 14/8/08
Thanks, good info, You even got the haters worked up to a lather!
Tex1961
chetho
Posted 5:11 AM 14/8/08
Heres a thought: What evidence is there that touchscreens are better than having keyboard or mouse? I think its just a fad right now. Yea, touchscreens are cool technology, but are they better? the world will never know.....
chetho
fredcadete
Posted 5:11 AM 14/8/08
Cookie, cookie!
I want my cookie.
fredcadete
RiceBandit
Posted 5:10 AM 14/8/08
Although I see touchscreens as a nice evolution to interacting, I doubt it will become as dominant as the standard keyboard. At least not until someone figures out a way to give it tactile feedback.
I actually see a foreseeable future where touchscreens replace Wacom tablets, though. Wacom needs to pick up the ball (in a much larger way than they have, so far anyway).
RiceBandit
djeror
Posted 5:07 AM 14/8/08
You didn't explain how the new HP touchscreen computer works with the IR transmitters and receivers positioned around the outside of the screen and registering touches by blocking the signal between the transmitter and receiver. You might want to update and add it to the article to really flesh it out.
djeror
l4crosse
Posted 5:01 AM 14/8/08
@hebrewbacon:
i agree with the eye thing i was typing while you posted my bad
l4crosse
Reilaos~
Posted 5:01 AM 14/8/08
That's it! Sharp and the Optical Sensing stuff! This is closer and closer to what I want: a tablet PC with wacom-style eraser/pressure sensing, multitouch without special stuff, and a screen which doubles as a scanner. Fantastic.
Reilaos~
GeekyNerdGuy
Posted 5:00 AM 14/8/08
I like the touchscreen on my iPhone. I HATE touchscreens on cameras!!!
I think touchscreens on cameras should be banned by the US government.
GeekyNerdGuy
l4crosse
Posted 5:00 AM 14/8/08
ahaha @ "like this touchscreen phone from Apple you might have read about" just maybe people know about it.
But I think americans want to do less and less work even if it looks cool at first. For example if in a few years if everyone has 30 inch multitouch monitor, after 5 minutes fat joe wont be able to reach up to the top of the screen to close out of some annoying ad on ie. and pass out from getting too much of a workout. They should have some cursor that moves wherever you look with your eyes, that would be the only think that could top the mouse and keyboard in this country.
l4crosse
yogibimbi
Posted 4:56 AM 14/8/08
and now, please, where did haptic end up?
yogibimbi
Glaiel-Gamer
Posted 5:45 AM 14/8/08
@stryder100:
That's this new fangled technology we call ink and paper.
Glaiel-Gamer
Kaveh
Posted 5:42 AM 14/8/08
@Kaveh: Sorry, I suck at posting... here's a link:
[en.wikipedia.org]
Kaveh
Kaveh
Posted 5:42 AM 14/8/08
@Number_41: Multitouch.
Kaveh
Tank
Posted 5:32 AM 14/8/08
Thanks Giz. I've had intentions of looking up the magic that allows the iPhone to register touches behind a screen protector, another sheet of plastic and a sheet of paper but I've been too lazy to google it.
Tank
FredicvsMaximvs
Posted 5:28 AM 14/8/08
@clockradio: You must be the new guy.
FredicvsMaximvs
stryder100
Posted 5:23 AM 14/8/08
How 'bout the 150 foot "touch" LCD at the Beijing opening ceremonies? What kind of touch did that use? I noticed at one point that one guy's body wasn't doing anything to the surface but when he swung his hand around it drew a line. Anyone know how that worked?
stryder100
frigg
Posted 5:46 AM 14/8/08
@stryder100: My guess is it was some kind of scanner activated by someone else with the mutual reference of the music. So, for example, the choreography has the painter-dancer swing his body around to make a circle starting at the downbeat of measure 64. While the system is in bypass in measure 63, at the downbeat of measure 64 it engages to capture and paint his motion. Kind of like punching in an audio track in a DAW. /guess
frigg
Noobs-R-Us
Posted 6:22 AM 14/8/08
@matt buchanan: Who am I?!? Is that anyway to treat someone who has given the Giz so many ideas?
[gizmodo.com]
See my reply to @lpranal: and my link from [en.wikipedia.org] Look familiar???
Noobs-R-Us
HBR
Posted 4:28 AM 14/8/08
"Touch-Screen" has to be one of the biggest oxymorons in the history of technology. Your're interacting with a featureless two-dimensional surface; it's a purely visual medium with hardly any feeling of touch involved. It's also been around for 35+ years.
HBR
GadgetPlay
Posted 6:54 AM 14/8/08
@Tex1961: "You even got the haters worked up to a lather!"
Like that's hard to do...
@frigg: "While the system is in bypass in measure 63, at the downbeat of measure 64 it engages to capture and paint his motion. Kind of like punching in an audio track in a DAW."
Not that the Chinese would ever fake anything, but wouldn't it be easier just to have everything on the screen pre-programmed and just have the dancers follow along? Maybe a controller to resync the system if it gets out of wack, or have it all based on numbered cues like stage lighting. Similar to what you're suggesting, but eliminating the touchscreen all together.
GadgetPlay
llryuujinll
Posted 6:39 AM 14/8/08
I've seen touch screens where they setup 4 camera's right above the screen acting as an invisible plane. it was like 10ft by 10ft multi-touch. the 4 cameras had to be calibrated precisely so it could triangulate anything that broken the camera's plane.
llryuujinll
chasema
Posted 7:39 AM 14/8/08
@Glaiel-Gamer: Actually, I think it was a touchscreen. If it wasn't, the announcers were wrong. Which could be possible, but they made a pretty big deal about pointing out how it was all touchscreen and LEDs.
chasema
kanon
Posted 7:55 AM 14/8/08
@wvv: I agree. Touchscreens will be useful only where space is at a premium and there is no real room for a full-size input device like a keyboard or a mouse. I see touchscreens being used for phones, wristpads, Ogg players, car dashboards, and server-rack diagnostics. Anything that requires serious input, like typing in text-boxes online, will still be keyboard- and mouse-driven.
Can you imagine playing your favorite FPS with only a touchscreen? How would you switch between guns? Move? Chat?
Yes, my colleagues, the keyboard is here to stay.
@Glaiel-Gamer: If you looked closely and paid attention, the dancers had ink-soaked sponges attached to one of their hands. The canvas was lifted up and replaced multiple time, and the large roll-out screen was underneath the canvas. Watch the footage again.
kanon
hamandcheeseUK
Posted 8:37 AM 14/8/08
@HBR: All that being said. You're touching the screen.. why over complicate things?
hamandcheeseUK
BiZarRroBALlmeR
Posted 8:15 AM 14/8/08
@jcrockerman: too funny, that would be multi touch right?
BiZarRroBALlmeR
gravitation
Posted 9:15 AM 14/8/08
Giz, thanks for the explanation on touchscreens. Before I read your little skinny, I thought it was just magic. I still think it's magic but now I know how the magician does it!
gravitation
ShampaHorae
Posted 10:37 AM 14/8/08
wow this article is "hurtling"
ShampaHorae
matt buchanan
Posted 12:58 PM 14/8/08
@Noobs-R-Us: Hahahaha.
matt buchanan
DUOPHONIX.com
Posted 5:20 PM 14/8/08
@Waka in Japan: Thats nice, but it does.
Someone even made a homebrew app where the harder you push the colour changed on a paint app.
DUOPHONIX.com
clockradio
Posted 5:42 PM 14/8/08
@FredicvsMaximvs: On my third alias ... the others get banned for trolling the likes of Julia Allison on Gawker.
I... hate... her... so... much...
Dang.. I probably gots to gets me a new alias now.
clockradio
HollywoodLeo
Posted 7:07 AM 17/8/08
I think I see the future in the porn industry...
Touchscreen porn!
HollywoodLeo
jtwaverly
Posted 9:47 AM 17/8/08
Am I the only one that likes to use my fingernail on a touchscreen? When I first used an iPod Touch, I was shocked to discover that it did not work. Boo capacitive touchscreens. Yay nature's stylus, the fingernail.
jtwaverly