There’re are a few articles popping up about this “study,” so here is the press release verbatim:
QWERTY Texters Demonstrated Drop in Efficiency When Texting on iPhone
August 8, 2007 – In late July, Chicago-based usability consultancy User Centric, Inc. tested the iPhone’s touch keyboard in comparison with conventional QWERTY and numeric phone keyboards. In an earlier baseline study, User Centric had identified texting as potentially problematic for new iPhone customers. The goal of the current study was to determine how easy it was for conventional mobile phone users to text using the iPhone.
Participants Texted using Both Conventional Phones and iPhones
A total of 20 participants were brought in for one-on-one usability sessions with a moderator. All sent text messages at least 15 times per week. Ten of the participants owned a phone with a QWERTY keypad, and ten of the participants owned a phone with a numeric keypad. Those who owned a numeric keypad used the “multitap” method of entering text messages rather than predictive text. To multitap, a user must press a particular key on the numeric keypad multiple times to get the desired character to appear.
During each session, participants were required to use their own phones. In addition, they were provided with an iPhone for use during the study. None of the participants were iPhone owners, and all participants were compensated for their time.
Standardized Messages Were Provided for Texting
Every participant entered six messages using their own phone and six messages on the iPhone. In their sessions, participants were asked to copy 12 standard messages created for this study. Each message was between 104-106 characters in length (including spaces). Six of the messages each contained 8-10 instances of proper capitalization and punctuation, while the remaining six messages contained no capitalization or punctuation but had some abbreviations. Message configuration and phone order were counterbalanced across participants.
Participants Were Novice iPhone Users
We were aware that participants’ prior familiarity with their own phones meant that there would likely be a learning curve associated with text messaging on the iPhone. (None of the participants had used an iPhone prior to the study). Although participants were given one minute to familiarize themselves with the iPhone’s touch keyboard, their texting abilities on the iPhone were still at the novice level. Throughout the study, we did notice limited improvements in keyboard comfort as users progressed through the tasks on the iPhone. Overall, the findings in the study can be taken as a good representation of what iPhone text messaging is like for a customer who has just bought an iPhone and is using it for the first time.
“It’s important to consider the changes a person has to make when they switch to the iPhone,” said Gavin Lew, Managing Director at User Centric. “It should be easy for people to do common tasks, such as text messaging, using the iPhone’s less traditional touch interface.”
Texting on iPhone Took Twice as Long as Texting on QWERTY Phones
In general, participants took longer to enter text messages on the iPhone than on their own phone. Despite the keyboard similarities, QWERTY phone users took nearly twice as long to enter comparable messages on the iPhone compared to their own phone. On the other hand, multitappers did not experience a significant difference in the time it took them to type messages on the iPhone. (Multitap text entry usually takes about 2 times as long as QWERTY text entry). Participants also made more typing errors on the iPhone. This phenomenon was expected since users had much more experience with their own phones.
Detailed Observations of User Text Entry on the iPhone Ergonomic Issues
• Most participants felt that their fingertips were too large for the iPhone’s touch keyboard.
• Most QWERTY phone users initially used the iPhone by holding it with both hands and typing with their two thumbs. However, by the end of the session, most had decided that it was easier for them to use one index finger to type.
• Over half of the participants stated that they would have preferred the feel of an actual key to the iPhone’s touch keypad.
• Most participants noticed that there was no tactile feedback on the iPhone keypad.
• Some mentioned that the feel of the key on conventional phones helps them locate the desired key without having to focus on the actual keypad.
General Interface Issues
• Participants expressed a great deal of frustration with the sensitivity of the iPhone touch keypad.
• Participants made an average of 11 errors per message on the iPhone compared to an average of 3 errors per text message on their own phone. Although the error rate was alleviated somewhat by the iPhone’s self-correction feature, participants were still frustrated.
• In particular, participants struggled when they were trying to type using the Q & W keys or the O & P keys on the iPhone.
• 5 out of 20 participants asked if the iPhone came with a stylus. They indicated that they could be more accurate with the stylus rather than their fingers due to the sensitivity of the screen.
• One female participant tried to interact with the iPhone keypad using her fingernail and was unsuccessful.
• The space bar, return, and backspace keys presented issues for many participants because these keys were spaced so closely to each other.
• No one discovered the drag and lift feature of the keyboard, which reduces errors.
• Many participants said they could not see themselves attempting text entry on the iPhone in distracting conditions.
• Specifically, participants did not think they could text message on the iPhone safely while driving.
Predictive & Corrective Text Issues
• Only a few participants discovered and correctly learned to use the predictive and/or corrective text features on the iPhone. QWERTY phone users in particular had a tendency to backspace when they were correcting mistakes.
• Participants did not understand how the predictive / corrective text bubbles worked.
• 6 out of 20 participants tried to touch the bubble to get the word in the text bubble to appear.
• Three participants tried hitting the backspace key because they associated the ‘x’ on it with the ‘x’ in the bubble.
• It was especially frustrating for participants when they attempted to place the cursor in the middle of a word.
• None of the participants discovered the magnifying glass feature while text messaging.
• During a follow-up task that involved correcting a note in the iPhone’s Notes application, 6 out of 20 did discover the magnifying glass feature. However, not all participants realized that the feature helps place the cursor in addition to enlarging the text.
Real World Implications
Based on our study’s findings, it appears that QWERTY phone users are likely to suffer some initial decrease in efficiency when switching to the iPhone touch keyboard. However, multitap texters may see an eventual increase in text entry efficiency when switching to the iPhone.
Our study indicates that both QWERTY and multi-tap users are likely to have some level of initial frustration with the iPhone’s touch keyboard and corrective text features. Although our analysis suggests that both types will eventually adapt to the iPhone’s features, the learning curve for texting on iPhones will be steeper for QWERTY phone users than multi-tappers.
If you would like an excerpt of this study including graphs and pictures, please email: pstoffregen@usercentric.com
About User Centric, Inc.
User Centric is a global consulting firm that focuses on improving user experience. We apply our expertise to projects involving handhelds, Web sites, software, medical devices, print, packaging, and telephony services. Experience, quality, value, global reach and outstanding client services set us apart. Fortune 500 companies and other organizations trust us to make their products and services better. Client satisfaction is our #1 measure of success: 95% of our revenue comes from repeat business. Learn more about us at http://www.UserCentric.com
Source: http://www.usercentric.com/news.asp?ID=386
This is so interesting that we decided to conduct a similar study of our own!
MacDailyNews took a total of 20 participants who had watched golf on TV, but never played the game. 10 of the participants had played field hockey. The other 10 had played ice hockey. Participants were give a bag of clubs, many balls, and were driven out to the first tee and told to begin play.
We recorded these detailed observations:
• Most participants felt either that the ball was too small or the clubs were too long to hit accurate shots.
• Most felt it was easier to watch golf on TV than to actually play the game.
• Most participants noticed that the sand hindered their shots.
• Most ice hockey players initially held the club like an ice hockey stick.
• All ice hockey players believed playing ice hockey to be easier than playing golf.
• Most field hockey players intitally held the club like a field hockey stick.
• All field hockey players believed playing field hockey to be easier than playing golf.
• Participants made an average of 11 strokes per hole higher than actual golfers (18 handicap).
• In particular, participants struggled with driving, approach shots, chipping, putting, sand shots, and general etiquette.
• One female field hockey participant tried to jump her golf cart over a stream, but was unsuccessful.
• 5 out of 20 participants asked if the golf tees could be used for every shot.
• Participants expressed a great deal of frustration with the game of golf.
Based on our study’s findings, it appears that non-golfers are likely to eventually increase their level of play with practice, hence actually becoming golfers.
Our study indicates that people who have never played golf are likely to have some level of initial frustration with the game. Although our analysis suggests that both types will eventually adapt to the game with practice, the learning curve for golf will be slightly steeper for field hockey players than for ice hockey players based mainly on that unfortunate golf cart and stream episode.
Learning to use Apple’s iPhone expertly is immeasurably easier than learning how to play golf at its most basic.
MDN. Thank you for doing that “similar study” Loved it.
” width=”19″ height=”19″ alt=”grin” style=”border:0;” />
Anal-yst Anal people trying to act like they know something.
” width=”19″ height=”19″ alt=”grin” style=”border:0;” />
en
MDN take:
“• One female participant tried to jump her golf cart over a stream, but was unsuccessful.”
OK, it’s probably not PC, but ROFLMAO!! As Triump used to say, I keed, I keed…
MW: “drive”!!!
Careful MDN…I don’t think you really want to compare the iPhone to golf!!! That’s like comparing chewing gum to building your own yacht!
Oh puh-leeze. I used a Treo for over 3 years, and it took me just over a week to be faster using my iPhone’s text entry than I ever was on my Treo. I tried using a friend’s treo recently to type an email and it was downright painful. Silly article.
And MDN, nice study you did yourselves. You might want to add in a study of people who’ve used a broom before too. I’m sure they will have frustration switching to using a golf club too
” width=”19″ height=”19″ alt=”wink” style=”border:0;” />
One minute of practice w2ith a new interface then into the frying pan? What would the results have been had they been allowed 30 minutes of practice with the iPhone?
My daughter has been texting on her RAZR for nearly two years. I can’t keep up with her at all on my iPhone (had it since June 29). Gee, I wonder why that is?
This “test” was too poorly constructed to be of value.
“One female field hockey participant tried to jump her golf cart over a stream, but was unsuccessful.”
And you’ll know it’s a woman from the steady whistling noise on her way back down.
“• Many participants said they could not see themselves attempting text entry on the iPhone in distracting conditions.
• Specifically, participants did not think they could text message on the iPhone safely while driving.”
You shouldn’t be texting while driving any way.
You could text much faster in Morse Code.
Well after about a week I was typing close to 45 words a minute on my iphone. that is with one finger.
“Specifically, participants did not think they could text message on the iPhone safely while driving.”
God, I hope not! There are enough people yapping on cell phones and weaving back and forth across the lanes on the interstates. Texting would be an unbelievable hazard.
This result sums up the whole article, if you ask me:
“• Specifically, participants did not think they could text message on the iPhone safely while driving.”
Just bask in the absolute hilarity of that statement for a sec.
Another dumbfuk corporate shill MDN take. Pathetic. Seriously, are you idiots (MDN) at least on Apple’s payroll, or do you toss Apple’s salad for free?
The iPhone has some great features, and some lousy ones–particularly text entry. The touch screen is an upgrade over multitapping, but crap compared qwerty keyboards. The iPhone is a trade off–ditching the qwerty keyboard gives you most of the front surface to use as a screen, and flexibility for adjusting the user interface application by application, but text entry is slow, error prone, frustrating, and the magnifying glass is the most unintuitive interface Apple’s had since monitor ROM.
Landscape text entry across all applications has to be one of the most-needed features for the next iPhone software update–a well designed landscape keyboard would go a long way to addressing the issue, although the inability to touch type will always be a problem. (I sure as hell don’t want someone texting while driving, but there are other times I’d like to be able to text message without having to stare religously at the screen.)
Another thought — compare this fact (iPhone users are not instant experts) to the fact that analysts are instant experts on whatever they study. Someone should do a long-term study on accurately predicting the future by comparing psychics, televangelists, and analysts. It would be fun to see who got closest to the truth.
You could also send text messages faster with decent voice recognition.
Just a thought.
I think that the inability of the iPhone to text while driving is a bonus and should make me eligible for a reduction in my auto insurance policy.
OpJ:
I get the feeling you’re missing the point of MDN’s take… lol Chill.
Clearly, MDN thinks this is hilarious, but the point of the study is NOT that people don’t know how to use the device.
It’s a measure of INTUITIVE operation. How often did things that people tried to do (with no instruction) actually work? OSX is an example of a VERY intuitive interface. The iPhone is clearly less so. Whether it turns out to be better or worse or change the standard (thus changing intuition) remains to be seen.
• Most participants noticed that there was no tactile feedback on the iPhone keypad.
They noticed? Unbelievable…they have fingers.
This is crazy, what did they expect?
You give someone brand new piece of equipment that they have never used and do comparision to how good they are working on something they have used for weeks or months?
Let’s see, let’s put a Cessna pilot behind controls of 787 and see how good he does, they are both planes, right?
Typical problems for an Apple product:
– Steep learning curve,
– Difficult to use,
– Decreased efficiency
Is anyone surprised? On the other hand my Zune was up and running in no time flat, and I was squirting my friends right away through Microsoft’s intuitive and pleasant interface, much like the Windows Vista on my Dell. I don’t know why you MAC lemmings put up with this stuff.
Your potential. Our passion.™
PC Apologist –
Anyone would LOVE to prove that an iPhone is non-intuitive.
Just because this seems like an effort to do so, doesn’t make it a good study. (good as in USEFUL)
MDN’s point is that this study is useless to those who love the iPhone, and useless to those who haven’t bought one yet. And from what we’ve seen, people who BOUGHT them (not pulled into a room to try them for market research money) LOVE them.
In fact, one can only assume someone is paying big bucks for this. I’m sure a few competitors would love to create a cloud of uncertainty.
Oh, one more thing, the first time I used iPhone, I became proficient within minutes, discovered how to move insertion cursor, correct my mistakes and drag-release, what kind of idiots did they use for the study? And I am 40 so not as snappy as some teenagers.
It’s NEVER safe to text message while you’re driving!!
” . . .and I was squirting my friends right away . . .”
Hey, hey. Settle down there, Hugh Hefner.
“let’s put a Cessna pilot behind controls of 787”
WOW! Sounds like you’ve got quite a weekend planned. Please post that to YouTube if you can.
I routinely text and talk on the phone when driving. I am such a hyper, aggressive driver that doing these things actually make me drive slower and more calmly. Otherwise, I would be doing 70 on Kelly Drive rather than my usual 50.
P.S. The speed limit on that road is 35.
@PC Apologist
It’s a measure of INTUITIVE operation. How often did things that people tried to do (with no instruction) actually work? OSX is an example of a VERY intuitive interface. The iPhone is clearly less so. Whether it turns out to be better or worse or change the standard (thus changing intuition) remains to be seen.
I must be way smarter than you or the people in this study because within about five minutes, I could type faster on an iPhone than on my own cell phone. It was easy. Period.
MDN – I sure hope the iPhone is easier to learn than golf, given my experience with golf thus far…
One thing about this study was fishy though: “Those who owned a numeric keypad used the “multitap” method of entering text messages rather than predictive text.”
This is totally unrealistic. Who actually uses the horrid multitap option to send SMS’s? I would shoot myself when trying to text if my phone was not set to predictive text mode.
In a parallel universe, a study has found that people familiar with the iPhone’s conventional touch keyboard had trouble adjusting to the new QWERTY and numeric phone keyboards.
The study, with it’s sample of 20 users that are proficient on other types of input keypads is totally useless.
You would just have to see who funded the study to see why they got the results they published. A study can be designed to get any results you wish to find.
If they were up against iPhone owners with a month’s worth of typing experience, they would have been beaten badly and still the study would have proven nothing.
I’ve had an iPhone for 3 days, never texted on my old phone – too painful on a numeric keypad. My own experience pretty much echos the experience of the testers, tried to use fingernail, started using index finger, I am getting much better – a real pain to enter passwords when you first start.
I watched Apple’s intro video tape and it was a big help- never would have figured out to use space bar to accept predictive text. Still haven’t mastered magnifying glass.
Do I love my iPhone? Yes!!. And so does everyone I’ve showed it too.
It’s a new tool with a learning curve. That’s life!
What is the point of SMS? It sole purpose is so high school girls can communicate to one another from a quiet classroom without getting caught passing notes. Hell, it IS passing notes. There are plenty of other ways to communicate these days. I will eventually get an iPhone (maybe Rev 2) but I certainly won’t use it to text. I don’t text with my current phone. Most adults don’t need texting. If I’m in a meeting and I need to communicate with someone, I’ll either walk OUT and call them, or I’ll turn off my phone and wait until afterward. It’s simple courtesy.
Hi.
I found it very strange that anyone could expect to be able to have full typing speed on a completely new keyboard with only 30 minutes of learning time. They only got 30 minutes. And to base a trial on that? If they had any morals they would let the participants use the iPhone for two weeks and then measure the results….
Sponsored by: ???
Verizon? M$? Dell?
“Most participants noticed that there was no tactile feedback on the iPhone keypad.”
most did, huh? who were the others?
i can’t help but think about the picture of Rove. i wonder if he is smart enough to notice?
heheh.
i suspect that the study is sponsored by RIM. i notice they have “full real key keyboard” and “any network” ads on darn every web page around today.
i wonder how many users they have lost?
From their FAQ on the subject:
“For the general mobile phone user, any new device will have a transition period. However, in terms of the text input system, what this study found was that there was NO difference in text messaging efficiency between a mobile phone (non-QWERTY) compared to the iPhone’s touch keyboard. This is compelling because it suggests that users will have the same texting efficiency on the iPhone as they do today.”
Wow. Man, the people who pay this company to do studies and draw conclusions from it are really getting ripped off. With thinking like that, these guys could be financial analysts. Don’t they think that users will get better & better at typing on a touch screen? Nope. They think that someone who only gets 60 seconds to experience the touch screen before the tests begin will just remain at that level of proficiency for forever.
Idiots Gone Wild, is what it is.
OK, I just emailed the managing director of media relations, rschumacher@UserCentric.com at UserCentric.
I just read your survey about texting proficiency on an iPhone. While I seldom use language such as this, all I can say is that you guys must be a bunch of fucking idiots.
-Richard
PC Apologist,
How long do you think it took those people to learn to text on a normal phone? I remember learning that… I took forever to be even somewhat efficient. This test is total BS.
OpJ,
I bet you don’t have an iPhone.
Great MDN Take.
Marty, if you think I don’t have an iPhone you are an idiot. I was a few people in line behind Mayor Street here in Philadelphia, and went to the Apple Store in KoP the next day to pick up a second one, so my wife and I both have one.
A good survey, would be to find 30 people who had never used cell phones for text messaging, broke it up into 3 groups, and at the end of the time, see who was doing better
“…participants did not think they could text message on the iPhone safely while driving.”
As noted above, this statement is fucking ridiculous. However, keep in mind that at least one person posted this on MDN as a negative about the iPhone before the release and one “tech-writer” said parents should warn their children they cannot text while driving with the iPhone.
Seriously.
MY TAKE: The iPhone’s non-keyboard sucks, plus there’s no cut and paste feature on the iPhone. The use of a real keyboard with a cut and paste feature is the only thing I miss about my treo. I’d love it if Apple came out with an iPhone with a slide out keyboard a-la’-Samsung. Apple gota lot right with the iPhone, but the keyboard SUCKS.
Hey OpJ,
Who’s the friggen’ idiot here. You buy something that just came out that you haven’t used, and then go back the next day and buy another one? Sounds to me like you and your wife aren’t exactly on the brilliant side yourselves. Idiot indeed.
>Sponsored by: ???
>Verizon? M$? Dell?
MOTOROLA paid for the “study”.
Hey Lord–kiss my hairy jew ass. Text entry on the iPhone sucks compared to keys you can feel. Text entry on the iPhone is at least as good as multitap–pretty much exactly as the article states. The magnifying glass is not intutive, nor is touching bubbled text to indicate you DON’T want that text, and hitting the space bar to indicate that you DO want that text. The rest of the iPhone is fantastic–that’s why I said the iPhone touchscreen is a tradeoff.
The hardware problem with the keyboard–the lack of any tactile feedback–is on the balance worth the tradeoff of having the controls in software. The software Apple has used to implement text entry, on the other hand, needs improvement.
Unlike MDN I don’t feel the need to constantly tounge Steve’s balls so I think the third-grade parody MDN take is retarded.
When Apple’s business is producing intutive products and a study shows that some aspects of Apple’s new product aren’t so intuitive then the study accurately points out some things Apple might want to consider modifying.
It isn’t like User Centric has pointed out the problems with the touch keyboard for the first time ever–this has been the reaction of reviewer after reviewer.
MDN: Fuuuunny (and very good) analysis!
It sounds like they just got a bunch of dumbasses.
Lol @ MDN take. Hilarious!. So true.
It’s like putting individuals who have just learnt to ride a bicycle on the seat of a Ducati and ask them to ride, and then take a survey on how they feel.
One should not be texting while driving on any phone. It is irresponsible for them to even mention the possibility. Five teenagers were killed a few weeks ago in a collision with a truck. The driver had sent a text message 3 seconds before the fatal collision.
Get off the phone and drive. Or better yet, take transit so you can enjoy your wonderful iPhone
I’ve been using the same goddamn crappy Nokia for 2 years and I still have problems using the device. iPhone can NOT be worse, never.
Well you can’t send the same SMS to more than one number at once, but i think they’ll fix it before it’s on the shelf in Finland.
I really haven’t had much of a problem typing on the iPhone keyboard. I’m faster on this keyboard than I’ve been on any other phone typing method. It’s got its oddities, to be sure. The magnifying glass, yeah… Ya gotta be pretty skilled with that thing.
@OpJ,
I don’t think it’s any more fair to simply declare that the iPhone keyboard sucks than it is for MDN and the fanboys to blindly claim its superiority. It seems to simply suit some better than others.
I’m sure someone can dig out some comparative, narrowly focused analyses about the mac interface and using a mouse (I do remember how much we used to hear “Where are the function keys? Who would make a computer without function keys?” Until the mac got function keys–so some other equally clueless rhubarbs were substituted.) I’m equally sure all those disappeared the minute MS introduced Windows 3.0.
Just thinkin…
“Thank you for doing that “similar study” Loved it.”
Yes, it made so much sense. After all who doesn’t expect to get a new consumer electronic device with the same qwerty keyboard layout as you’re using today and face a huge learning curve to use it.
“Let’s see, let’s put a Cessna pilot behind controls of 787 and see how good he does, they are both planes, right?”
Right, I guess that blows the apple myth of ease of learning and use right out of the water. Apparently learning to use Apple products should be at least as hard as learning to play Golf or fly a 787.
Anyone with a brain who had used both technologies prior to the iPhone launch knew the touch keyboard would suck compared to a tactile mini qwerty keyboard. People should just accept the device’s strengths and limitations rather than trying to pretend the device is a dessert topping AND a floor wax.
OpJ
You know what you can kiss….. A true test of what interface is more intuitive would be to take users who have used NEITHER multi tap, a crappy small blackberry QWERTY and the iPhone.
Lets see how they would do from ground zero square one on three different devices, all of which they have no experience on. That would be a true test.
“Lets see how they would do from ground zero square one on three different devices, all of which they have no experience on. That would be a true test.”
A true test of what?
That would be like saying you’ve designed a car with new controls and only want to test it with people who have never driven cars before, not you target market, people who have driven other cars for some time.
With over 230 million cellphone subscribers in the US (3 out of 4 people including children), do you seriously think many iPhones will sell to people who have never had a cellphone?
You’re going to be doing your test with a group of 7 year olds, grannys and technophobes.
I have been somewhat critical of the “MDN Take” lately, so I wanted to take this opportunity to say that this is fantastic!
” width=”19″ height=”19″ alt=”smile” style=”border:0;” />
Very funny, right on topic and generally very, very good.
I love my iphone. Just sayin. It’s great for music and web.
But the iphone keyboard took longer to get used to than I expected. That loop thing? Took me a couple weeks to figure out! Never came across a feature so hidden in OS X. (If we’re allowed to compared OS X to the iphone)
Also distracting that I can’t look away from my iphone when writing. I could do that with my old Treo – glance away while finishing a word. But can’t do it with the iphone. If my fingers shifted a little when I used the Treo, I’d know they shifted because I could feel the tiny bumps (so called keys) under my fingers. They were tiny, but I could still feel them.
Wonder why everyone is so worked up about this study? It’s not as if User Centric said the whole iphone was bad. Just the keyboard interface!