Speculation about the Apple Tablet mostly focuses on what the device is, not how it works. Text input, more than anything else, is the problem Apple needs to solve to make this work. So how will they do it?
CES was rotten with new tablets, some Android, some not, some with fascinating screens, and again, some not. But one thing they all had in common was that they hadn’t quite figured out the text input problem: How do you create text without a keyboard?
We’ve been comfortably typing without physical keyboards for years now, and this is largely Apple’s doing. One of the great triumphs of the iPhone was to make onscreen keyboards bearable, something that, even if you hate the concept of virtual keys out of principal, you have to admit they accomplished. This works:
Solution 1: A Giant iPhone
Apple has made mistakes before, but to only have a simple onscreen keyboard would qualify as an outright screw-up. QWERTY-style, thumb-actuated onscreen keyboards work on screens up to about five inches, with the 4.3-inch-screened HTC Touch HD2‘s keyboard straining even the most unsettlingly long thumbs. But to assume that this won’t work is to assume that the tablet is to be held a certain way, with hands at four and eight o-clock, more or less like a touchscreen phone in landscape mode. This may not be the case.
What if the tablet is meant to be held with one hand, and controlled with the other? What if it has some kind of kickstand or mount, so you can actually type with both hands, a la a regular keyboard. What if it’s intended to only work in portrait mode, where it would be just about narrow enough to be usable?
Either way, a single, iPhone-esque keyboard really shouldn’t be the primary input method. It could be a supplementary input method, but to have two separate text input mechanisms seems messy and distinctly un-Apple-y. Lame, half-baked input seems like the kind of thing Steve Jobs might fitfully shitcan a tablet for, actually, but that’s getting awfully speculative, even for a piece about a product that doesn’t officially exist at all.
Solution 2: Voice Control
Apple’s been on covert voice input crusade since it introduced Spoken Interface for OS X which, if you care to look (System Preferences>Speech>Speakable Items “On”) is still there. As it stands, it’s rudimentary – the iPhone’s Voice Control speech recognition is much more accurate – and though there are quite a few customisation options, it’s really just a command system, not a full text input system.
That said, Apple is very proud of Voice Control on the iPhone, and they haven’t removed voice commands from OS X in over five years. It’s likely that there will be some kind of voice input for the tablet, but that it’ll be relegated to the same job it’s held in the past, taking care of the odd command and initiating the occasional script, and not much else.
Solution 3: The Dreaded Stylus
Styli! The very thing the iPhone was so dedicated to murdering could be the saviour of the Apple tablet! Just ask Microsoft.
See, the only other
tablet booklet device that’s garnering remotely comparable hype is the Courier, Microsoft’s dual-screen concept device leaked to us back in September. The Courier concept is very different from the blurry image we’ve assembled of the Apple tablet, it doesn’t have a keyboard.
Handwriting. Apple staked an entire device line on handwriting recognition – the Newton – over 15 years ago, so isn’t it conceivable that they’ve, you know, figured it out by now? Before taking another detour back to the patent office, let’s take a moment to recall Steve Jobs’ original iPhone keynote:
Oh, a stylus, right? We’re going to use a stylus. No. Who wants a stylus? You have to get ‘em and put ‘em away, and you lose ‘em. Yuck. Nobody wants a stylus. So let’s not use a stylus. We’re going to use the best pointing device in the world. We’re going to use a pointing device that we’re all born with – born with ten of them. We’re going to use our fingers. We’re going to touch this with our fingers.
This wasn’t a dismissal of styli. This was a dickish, public obsoleting of styli. If I were a stylus, I would refuse to work with Steve Jobs, on the basis of him being a jerk.
And yet, in November of 2009, an Apple patent, this time describing stylus input and clearly showing a tablet-like device, went public. If you have the will and patience to parse a little techno-legalese, go for it:
Upon the occurrence of an ink phrase termination event, the ink manager notifies the handwriting recognition engine and organizes the preceding ink strokes into an ink phrase data structure…The present invention, in large part, relates to the observation that client applications and handwriting recognition software in pen-based computer systems can make far more accurate ink-related decisions based on entire ink phrases, rather than individual ink strokes.
If not, you’ll have to take my word for it: This is basically the Newton’s Rosetta, updated for 2009.
Solution 4: A New Style of Keyboard
The safest bet for how Apple will handle the text input problem is not coincidentally the broadest. Any onscreen keyboard would have to be different than the iPhone’s somehow, but to say that Apple’s tablet will have a new style of keyboard is to say that it will have pretty much any kind of onscreen keyboard that is unlike the iPhone’s. This is not very useful! Luckily, we have guidance from other companies and even from Apple.
Split onscreen keyboards are neither new nor common, which makes them kind of perfect: the map has been charted, so Apple needs only to explore it.
The most public of the alternatives is an actual, available product called DialKeys. Co-opted by Microsoft a few years ago, this tech, which splits the keyboard into two crescent-shaped virtual keyboards, shipped with a handful of touchscreen UMPCs, a category of devices that died off before it had the time to truly solve the onscreen keyboard problem. It wasn’t very good. But the concept had potential, maybe.
FingerWorks, a company specialising in touch interfaces and gesture concepts, was forcefully drawn into the Apple family about five years ago. A lot of their touch gestures actually made their way to the iPhone, albeit adapted from touchpad to screen use, according to FingerWorks employees:
The one difference that’s actually quite significant is the iPhone is a display with the multi-touch, and the FingerWorks was just an opaque surface. That’s all I’m going to say there. There’s definite similarities, but Apple’s definitely taken it another step by having it on a display
Interestingly. FingerWorks had a physical product with a split keyboard, which sat over Apple laptops’ regular keyboards, and which promptly disappeared after their acquisition. From the press release, which, mind you, hit the wires in 2003:
The MacNTouch Gesture Keyboard is a complete user interface that serves as mouse, standard keyboard, and powerful multi-finger gesture interpreter. Mouse operations like point, click, drag, scroll, and zoom are combined seamlessly with touch-typing and multi-finger gesture everywhere on the MacNTouch’s surface. Proprietary hardware and software allows pointing right over the keys, thus eliminating the frequent movement of the hand between the keyboard and the touchpad. The MacNTouch has been designed to minimize stress and it gives users unprecedented control of their computer using hand gestures.
For all the evidence about the tablet’s possible input methods, there’s no standout answer. Apple’s got a thing for voice input, and history with onscreen keyboards, a patent trail and strong lineage of stylus input, and a pattern of suspicious behaviour with and towards new keyboard types. We’ve got a handful of cases here, all compelling and all conflicting. And the takeaway, if you haven’t picked it up yet, is that nobody really knows.
For my money, though, an adapted, possibly split onscreen keyboard is the best bet, and assuming the learning curve isn’t too steep, the most appealing option. But of the options laid out here, it’s by far the most vague – its FingerWorks ancestor is nearly a decade old, conceived in a time before multitouch screens – so the only truly safe bet is that whatever Apple comes up with, it’s going to surprise us.