Why Siri is like skeuomorphic UIs: the magic is just skin deep
By now you've probably heard of the widely reported case of Siri's alleged pro-life stance. Walking the dogs this morning, I thought through what I hoped would be an interesting blog post about what I feel this means about Apple and our relationship to technology. I see an interesting link here between Siri and the heavy-on-the-texture UIs of Apple apps like iCal and Find My Friends.
Even before the response from Apple was published, it seemed more likely to me that this wasn't so much a case of Apple pushing a political agenda as it was a limitation of Siri making it look that way. Indeed, if anything Apple seems to have a a liberal, rather than conservative, political agenda -- for example, it donated $100,000 to the campaign to keep gay marriage legal in California in 2010. But, really, all this is incidental to what I was thinking of writing.
Then Adam Engst wrote a great post at TidBITS that stole my thunder by pre-empting most of what I had to say! The gist of his argument is as follows: that the problem with Siri is that, although it looks very much like sorcery at first glance (and although Apple carefully presents it that way in its advertising), it really isn't. It's just another computer program like all the rest -- and like all the rest it comes with limitations and drawbacks and bugs and issues. It doesn't help that the chattery nature of Siri -- the jokey responses, the easter eggs, the sly film references -- create a substantial facade that it really is a facsimile of a real person. But that's all it is: a facade.
Sometimes that facade cracks. For example, we've seen problems because of cloud failures -- or, indeed, if you have no data signal on your phone to communicate with the Siri data centre then it simply stops working. In the case of the searches for abortion-related matters, the problem appears to simply be a lack of information in the backing databases that Siri draws upon, like Yelp and Wolfram Alpha. I'm sure that this is only one of many such gaps in Siri's knowledge, albeit a highly politically charged one. For example, Siri's address lookups are resolutely US only, despite it being supported in many other countries (such as my native UK) and Yelp having a perfectly reasonable database for it to use.
Where I'd like to go further than Engst does is by drawing comparisons between Siri and Apple's recent trend towards so-called "skeuomorphic" UIs. This is the extensive use of real-world textures and imagery to underpin an app's functionality. Think of iCal on Lion, Calendar on the iPad, Game Center on iOS, or Find My Friends on the iPhone -- with leather bits, and little torn edges, and faux piles of poker chips, and stacks of pages in the corner of the screen.
I have a vehement aesthetic objection to the look-and-feel of most of these apps; I find them pointless, distracting and, frankly, a bit twee. This is merely my own tastes, though. Thinking more objectively I also have a practical objection. I believe that skeuomorphic UIs create false models of interaction. For example, in iBooks there is a stack of pages on the corner of the screen; a swipe across that stack turns the page. Seems logical enough, right? But the same stack of pages in Calendar for iPad on iOS 4 was not swipeable. It looked the same -- and clearly a real-world stack of pages can be turned -- but Apple seemingly just missed this feature out.
You might think that it's no big deal for Apple to implement that, and indeed the feature turned up in iOS 5 -- but I would humbly suggest that this is a hole with no bottom. The same stack-of-pages decoration still isn't swipeable in Contacts, for example. Look at iCal for Lion -- look at those little torn edges across the top of the page, where the virtual remains of last months page are seemingly left behind. Why can't I tear them off with my mouse and clean them up? That's exactly what I'd do with a real calendar that looked like that.
And even if Apple somehow made a UI that has almost every interaction a reasonable human being might expect of it -- a tall order, but let's suppose -- it's still only going to feel like a sheet of glass. As Bret Victor's fantastic essay on interaction design brillianty demonstrates, "pictures under glass" are never going to be anything more. If you can't smell the leather, or feel the grain, why make it look like leather in the first place?
Getting back to my original point, I see a link here. Skeuomorphic UIs resemble physical objects, but they cannot hope to emulate the myriad ways we have to emulate physical objects -- so they are always doomed to disappoint on some level if we let ourselves be fooled. Siri presents itself as a real person, a sort of "auditory skeuomorphism" if you will. But short of passing a Turing test one day that, too, is doomed to always disappoint. Sure, it looks like magic -- but so did the Wizard of Oz until Toto pulled back the curtain. Never forget that there's wires and gears back there making it work, or you'll be surprised when the abstractions leak.
Footnote: let's look again at Apple spokesperson Natalie Kerris's statement to the New York Times. She said "[t]hese are not intentional omissions meant to offend anyone. It simply means that as we bring Siri from beta to a final product, we find places where we can do better, and we will in the coming weeks."
I think it is interesting for two reasons. Firstly, I'm rather cynical about Siri's "beta" nature; I agree with Macworld senior contributor Glenn Fleishman, who wrote, "If you're advertising Siri as a feature, it's not beta." On iPhone 4S launch day, I spent ten minutes in an Apple Store enduring a low impact sales pitch from a Genius and he didn't mention the "beta" word once. Nor does it appear in Apple's TV spot. But then again, Gmail was in beta for six years; I'm not even sure I know what beta is supposed to mean any more, and I write software for a living.
Still, though, it seems to be that Apple are suggesting that as long as Siri has "places where we can do better" it'll be in beta. Well, hmmm. As I mentioned above, I'm not sure how -- short of some sort of Skynet-level breakthrough in AI tech -- Siri will ever be finished. With a field as complex as natural language processing, there's simply too much that can go wrong -- too many ways for humans to innocently throw a spanner in the works with their rich and wonderful languages. I do wonder if perhaps that statement to the Times was just a teensy bit rushed so Apple could nip the story in the bud. Not that I'd blame it for that, but it struck me as an interesting point nevertheless.
Share
Source: http://www.tuaw.com/
Categories
By now you've probably heard of the widely reported case of Siri's alleged pro-life stance. Walking the dogs this morning, I thought...
Add a Comment
I've been following this debate on skeuomorphic UI design and I see merit on both sides. I don't think the rationale being making iCal look Ike a calendar is that it is supposed to mimic the physical sensations of a calendar. I think it is simply about the app being more approachable from the perspective of the general user.
I was at an Apple store in Modesto yesterday and I was observing a Going Further workshop. Each of the participants was at least 50 years old and had an iPad 2. They were delving into iCal. The very first response that came from one of the ladies at the session was, "Oh, how beautiful." Then she talked about how it looked just like the desk calendar she bought every single year for nearly 20 years.
The first part of her statement is subject to opinion. People are either going to appreciate the aesthetic value of the design or not. The second part is unmistakable, that iCal's look and feel immediately resonated with her in a way that made her feel more at home on the device.
All UI design is arbitrary to the extent that it is design. You can choose for your app to look however you want it to. What matters, then, is first a functional sense which should tie in closely with both human behavior (unless you're designing interfaces for dolphins to poke at) and aesthetic value. My argument in favor of well-executed skeuomorphic design (the kind that allows you to swipe pages whenever there's a stack, for example) is why not have an element that most users can immediately relate to?
You, as a developer, may not immediately relate to iCal the way this woman did—but then I highly doubt you would ever find yourself part of a basic iPad workshop either (unless you were teaching it). I think Apple's design does favor these users, but then it also takes the stance of having chosen a design that is perfectly reasonable for all users nonetheless. But here's the real kicker: I would bet that for the first time in 20 years that lady decides to skip the desk calendar.
Sorry for the auto-type induced typo above.
In other news, I always chuckle a little when I see bloggers of certain sites (not necessarily this one) knock skeuomorphs in favor of a more supposedly functional or less visually cluttered aesthetic, but then when I look at their sites and see dozens of ads, columns packed with tertiary content, junk fonts and typesetting, and all manner of other things that take away from the reading experience of the user.
Without those ads, you would have no reading experience...
December 06 2011 at 11:59 AM Report abuse Permalink rate up rate downJachyn: I am aware of the business rationale. But I am also guessing that you are aware that there is a balance between the reason people visit (the content) and how the information is presented to them (the experience). Surely you've been to a site that's so inundated that the core message is lost. And you'll probably never go back.
The experience should never come at the expense of advertising, particularly if you hope your product will be taken seriously in the long run. The solution might lie in relevance. That is, tailoring the business need to cater to the overall experience by making monetization points as relevant and useful to the audience as possible. Coming to an Apple enthusaist site and seeing ads for Windows only software isn't as powerful an experience as rewarding your readers with a special discount on, for example, a really great productivity app that syncs between OS X and iOS. Ads like this are valuable.
But splatter 500 of even the most helpful ads around a single article that's broken up between 8 pages or a ridiculous slideshow and you can see where the benefit is lost.
I'm amazed that there is so much over-thinking about Siri's abilities or lack thereof. The software is good at present, but not as good as it can be and will be in the future when more software refinements are made and more entries are available in its database. It's also primarily US and UK centric right now and doesn't work well in other parts of the world (see previous sentence). All this is to be expected and this should really be the end of the story. However, technology has become so amazingly amazing on a daily basis that our expectations are very high. We're like kids at Christmas who are in a delicious frenzy to open our presents.
Should Apple call it a beta release? Technically, no because beta has always meant the testing phase where a limited number of people put it through its paces and submit feedback of their results, prior to the broad scale public release. However, Google has blurred the line on this, and beta is starting to take on a more marketing type of meaning of "it's pretty good now but just you wait--it'll be even more terrific soon."
Siri is groundbreaking in its current form. It blows away any other voice interface I've experienced in real life, and shows promise of eventually morphing into something like the computer interface shown on Star Trek and HAL on "2001, A Space Odyssey" (but without the evil bits). It's not there yet, so have a little patience. As Apple's programmers continue to develop the technology, it will be a game changer.
You are being far too complex in your presumptions. Nothing is actually ever finished it is always being upgrade and developed to the day it is put onto the rubbish heap and indeed that is true of nature itself even if our experience of it is too short to actually witness it. And then the comment that siri is skin deep but then in many ways so is human intelligence itself it appears a lot more unique and unfathomable than it actually is even if it is millenium beyond siri it self at this stage. And that's the point as Turing himself new well, it will take continuous development to achieve true mimicking of human interactivity but it has come along way from what we were used to before and be assured that once its usefulness is fully appreciated the capabilities will develop at a pace. what is required now that the actual interface has been cracked is a whole series of back up technologies to enhance its memory and IQ. like apps on the iphone that will happen and I suspect its growth will be rather quicker than a childs to adulthood and eventually it and similar incarnations will serve to show us (other than the religous zealots) just how relatively ordinary human intelligence actually is even if it isnt all crammed into a brain the size of our skulls. And remember Turing expected that to happen rather earlier than it presently has but then only with the potential of the cloud could it actually do so. Like a plane simply imitating a bird doesnt work for us and so expecting siri to simply imitate a human's version of intelligence is simply naive. Many animals out there are considerably more intelligent than us in very specific areas so try to think different.
December 02 2011 at 1:57 PM Report abuse Permalink rate up rate down ReplyI find these sorts of arguments vastly amusing. It comes down to the difference in aesthetic between hardcore geeks or design purists... and real people. Geeks and purists can theorise all they like about why "skeuomorphic" (what a ridiculously silly geek word... why not call it "real-like" or something, that normal people will understand?) are ideologically sub-optimal (or you don't ilke them, in real-speak).
The fact is that ordinary people prefer them. They feel familiar. They help intuitive understanding, not in an abstract user-interaction-paradigm way, but in the way that normal people think..
And as usual, Apple is on the side of the ordinary person, rather than the up-their-own-fundament geek purist. I've as much sympathy with this argument as with the tech-bores who think that having lots of mega-cycles and whizz-functions is "better" than a device that most people can pick up and use.
As usual, Apple 2, Geeks 0.
what a poor analogy. the skeuomorphic design gets in the way because the analogy breaks down and it ads visual clutter where it's not needed.
that doesn't mean physical analogies have no place in interface design. the springs, momentum, and damping that show up in iOS enable a better intuition of how to interact with, and what the current state is of the interface is. natural language enhances the interface with siri and is one reason it's more popular than the previous version of iOS voice interaction.
In fact, my favorite programs, like omnifocus allow natural *fuzzy* input which enhances the usability. Is it somehow a thin superficial veneer allowing someone to interact naturally with technology?
I've found Siri very useful and I think I'm not in the minority on this one.
There is yet another problem with skeuomorphic interfaces. They impose a metaphor that limits our imagination as to what we can do with it. If it looks like paper, too many people will treat it as if it really were paper. Since there are many things that one can do with a digital object that cannot be done with a non-digital object, these digital extras are less evident to us. Thought precedes action. If we don't think (imagine) of it, we won't make use of it.
Is Siri really skeuomorphic? In the attempt to say "yes" we also have to consider Siri being an androgynous and nearly omniscient servant who exists only to provide the information we need. That doesn't square very well with my concept of "human being" so, no, I don't think that Siri is aurally skeuomorphic. Siri is a digital being who speaks my language and knows a lot about my world but is otherwise unlike any person I know.
I believe that you are off base with the skeuomorphic argument and that most GUI designers would agree that it is an essential part of any interface. The way we comprehend new interfaces is through comparison to similar past experiences. In the case of calender, making the interface look like a calender informs us to the app's function and helps guide us in how to use it. Now, I agree that I'm also not a huge fan of the torn edges and would probably prefer not having the leather so dominant at the top, but to a new user, the look is inviting simply because it looks like something they know. And no, I don't believe that means that it has to behave exactly like the real world counterpart and I honestly don't think anyone's really too confused because you can't tear off the scrappy edges.
The same applies to Siri. It is a usable technology because it mimics our natural interaction with another person. If it sounded like a robot, it would be off-putting because we like to talk to people; it's what's natural to us. I don't think that anyone is fully forgetting that we're interacting with a set of databases and algorithms, but if you can easily put that aside while interacting with the technology, it's easier to use.
That's the same reason we have folders, files and beveled edges in our computer UIs; it makes a complex machine understandable, natural and usable. Without metaphors we would still be using punch cards or assembly code to interact with these machines. And if you take the metaphor too far, Siri would get moody at times, we'd have to spend time tearing paper out of calender, and the bookmark would fall out of iBook if you tilted it too much. Despite these interfaces having strong metaphoric links, none of us expect any of those three things to happen and because of that, the interfaces work.
I seldom comment on any of the topics here on TUAW, although I admit I'm a regular and an avid reader. I just have to give props to whom it is due. "Maccles" and "Claustin", I have to commend you both for your very well thought out and, more so, very well written comments. You both should consider a career in writing, if you aren't already in one. Thank you both for your assessment and insight. I totally agree with you both. "Maccles", your writing is impeccable. No disrespect to the author of this article.
December 02 2011 at 5:16 AM Report abuse Permalink +1 rate up rate down ReplyI disagree with much of what you say.
Servers go. Batteries die. And some days it rains when you wanted sun. So what?
Siri is whatever Apple says it is. THey say it is in beta. Are you the arbiter of Apple's product classification policies?
Forget your angst over the beta thing, for a first iteration of a potentially paradigm-changing UI/UX idea, Siri (via Apple) is an exemplar of how to launch something that is more than good enough for now, while at the same time openly acknowledging (with the beta classification (a first for Apple I think))m that you ain't seen nothing yet. Any Dynamic UI/UX phenomenon like Siri, can evolve by further development sure, but it can only achieve robustness and completeness as it is used and thereby stretched, by millions of people in thousands of places around the world.
Methinks therefore, that you protest far too much.
Have a little patience whydontcha?
After many years of trying, which other company has done better?
Hmmm?
I enjoyed reading this article, I think you do a very good job of putting that whole situation in perspective.
Also, I absolutely agree with you about the fake leather look. It's childish, chintzy, and useless.
Deals of the Day
more deals- Acoustic Research Digital Photo Frame with iPod Dock for $50 + free shipping
- Apple iPhone 4 8GB for Verizon, AT&T, or Sprint for $50 + pickup at Best Buy
- Unlocked iPhone 4S 16GB for GSM (AT&T, T-Mobile) for $619 + free shipping
- Apple iMac Core i7 Quad 3.4GHz 27" w/ 24GB RAM, 2TB HDD for $2,677 + $29 s&h
- Used Apple Magic Mouse for $36 + $4 s&h
- Skullcandy Riot Earbud Headphones for $10 + free shipping
21 Comments