There’re are a few articles popping up about this “study,” so here is the press release verbatim:
QWERTY Texters Demonstrated Drop in Efficiency When Texting on iPhone
August 8, 2007 – In late July, Chicago-based usability consultancy User Centric, Inc. tested the iPhone’s touch keyboard in comparison with conventional QWERTY and numeric phone keyboards. In an earlier baseline study, User Centric had identified texting as potentially problematic for new iPhone customers. The goal of the current study was to determine how easy it was for conventional mobile phone users to text using the iPhone.
Participants Texted using Both Conventional Phones and iPhones
A total of 20 participants were brought in for one-on-one usability sessions with a moderator. All sent text messages at least 15 times per week. Ten of the participants owned a phone with a QWERTY keypad, and ten of the participants owned a phone with a numeric keypad. Those who owned a numeric keypad used the “multitap” method of entering text messages rather than predictive text. To multitap, a user must press a particular key on the numeric keypad multiple times to get the desired character to appear.
During each session, participants were required to use their own phones. In addition, they were provided with an iPhone for use during the study. None of the participants were iPhone owners, and all participants were compensated for their time.
Standardized Messages Were Provided for Texting
Every participant entered six messages using their own phone and six messages on the iPhone. In their sessions, participants were asked to copy 12 standard messages created for this study. Each message was between 104-106 characters in length (including spaces). Six of the messages each contained 8-10 instances of proper capitalization and punctuation, while the remaining six messages contained no capitalization or punctuation but had some abbreviations. Message configuration and phone order were counterbalanced across participants.
Participants Were Novice iPhone Users
We were aware that participants’ prior familiarity with their own phones meant that there would likely be a learning curve associated with text messaging on the iPhone. (None of the participants had used an iPhone prior to the study). Although participants were given one minute to familiarize themselves with the iPhone’s touch keyboard, their texting abilities on the iPhone were still at the novice level. Throughout the study, we did notice limited improvements in keyboard comfort as users progressed through the tasks on the iPhone. Overall, the findings in the study can be taken as a good representation of what iPhone text messaging is like for a customer who has just bought an iPhone and is using it for the first time.
“It’s important to consider the changes a person has to make when they switch to the iPhone,” said Gavin Lew, Managing Director at User Centric. “It should be easy for people to do common tasks, such as text messaging, using the iPhone’s less traditional touch interface.”
Texting on iPhone Took Twice as Long as Texting on QWERTY Phones
In general, participants took longer to enter text messages on the iPhone than on their own phone. Despite the keyboard similarities, QWERTY phone users took nearly twice as long to enter comparable messages on the iPhone compared to their own phone. On the other hand, multitappers did not experience a significant difference in the time it took them to type messages on the iPhone. (Multitap text entry usually takes about 2 times as long as QWERTY text entry). Participants also made more typing errors on the iPhone. This phenomenon was expected since users had much more experience with their own phones.
Detailed Observations of User Text Entry on the iPhone Ergonomic Issues
• Most participants felt that their fingertips were too large for the iPhone’s touch keyboard.
• Most QWERTY phone users initially used the iPhone by holding it with both hands and typing with their two thumbs. However, by the end of the session, most had decided that it was easier for them to use one index finger to type.
• Over half of the participants stated that they would have preferred the feel of an actual key to the iPhone’s touch keypad.
• Most participants noticed that there was no tactile feedback on the iPhone keypad.
• Some mentioned that the feel of the key on conventional phones helps them locate the desired key without having to focus on the actual keypad.
General Interface Issues
• Participants expressed a great deal of frustration with the sensitivity of the iPhone touch keypad.
• Participants made an average of 11 errors per message on the iPhone compared to an average of 3 errors per text message on their own phone. Although the error rate was alleviated somewhat by the iPhone’s self-correction feature, participants were still frustrated.
• In particular, participants struggled when they were trying to type using the Q & W keys or the O & P keys on the iPhone.
• 5 out of 20 participants asked if the iPhone came with a stylus. They indicated that they could be more accurate with the stylus rather than their fingers due to the sensitivity of the screen.
• One female participant tried to interact with the iPhone keypad using her fingernail and was unsuccessful.
• The space bar, return, and backspace keys presented issues for many participants because these keys were spaced so closely to each other.
• No one discovered the drag and lift feature of the keyboard, which reduces errors.
• Many participants said they could not see themselves attempting text entry on the iPhone in distracting conditions.
• Specifically, participants did not think they could text message on the iPhone safely while driving.
Predictive & Corrective Text Issues
• Only a few participants discovered and correctly learned to use the predictive and/or corrective text features on the iPhone. QWERTY phone users in particular had a tendency to backspace when they were correcting mistakes.
• Participants did not understand how the predictive / corrective text bubbles worked.
• 6 out of 20 participants tried to touch the bubble to get the word in the text bubble to appear.
• Three participants tried hitting the backspace key because they associated the ‘x’ on it with the ‘x’ in the bubble.
• It was especially frustrating for participants when they attempted to place the cursor in the middle of a word.
• None of the participants discovered the magnifying glass feature while text messaging.
• During a follow-up task that involved correcting a note in the iPhone’s Notes application, 6 out of 20 did discover the magnifying glass feature. However, not all participants realized that the feature helps place the cursor in addition to enlarging the text.
Real World Implications
Based on our study’s findings, it appears that QWERTY phone users are likely to suffer some initial decrease in efficiency when switching to the iPhone touch keyboard. However, multitap texters may see an eventual increase in text entry efficiency when switching to the iPhone.
Our study indicates that both QWERTY and multi-tap users are likely to have some level of initial frustration with the iPhone’s touch keyboard and corrective text features. Although our analysis suggests that both types will eventually adapt to the iPhone’s features, the learning curve for texting on iPhones will be steeper for QWERTY phone users than multi-tappers.
If you would like an excerpt of this study including graphs and pictures, please email: pstoffregen@usercentric.com
About User Centric, Inc.
User Centric is a global consulting firm that focuses on improving user experience. We apply our expertise to projects involving handhelds, Web sites, software, medical devices, print, packaging, and telephony services. Experience, quality, value, global reach and outstanding client services set us apart. Fortune 500 companies and other organizations trust us to make their products and services better. Client satisfaction is our #1 measure of success: 95% of our revenue comes from repeat business. Learn more about us at http://www.UserCentric.com
Source: http://www.usercentric.com/news.asp?ID=386
This is so interesting that we decided to conduct a similar study of our own!
MacDailyNews took a total of 20 participants who had watched golf on TV, but never played the game. 10 of the participants had played field hockey. The other 10 had played ice hockey. Participants were give a bag of clubs, many balls, and were driven out to the first tee and told to begin play.
We recorded these detailed observations:
• Most participants felt either that the ball was too small or the clubs were too long to hit accurate shots.
• Most felt it was easier to watch golf on TV than to actually play the game.
• Most participants noticed that the sand hindered their shots.
• Most ice hockey players initially held the club like an ice hockey stick.
• All ice hockey players believed playing ice hockey to be easier than playing golf.
• Most field hockey players intitally held the club like a field hockey stick.
• All field hockey players believed playing field hockey to be easier than playing golf.
• Participants made an average of 11 strokes per hole higher than actual golfers (18 handicap).
• In particular, participants struggled with driving, approach shots, chipping, putting, sand shots, and general etiquette.
• One female field hockey participant tried to jump her golf cart over a stream, but was unsuccessful.
• 5 out of 20 participants asked if the golf tees could be used for every shot.
• Participants expressed a great deal of frustration with the game of golf.
Based on our study’s findings, it appears that non-golfers are likely to eventually increase their level of play with practice, hence actually becoming golfers.
Our study indicates that people who have never played golf are likely to have some level of initial frustration with the game. Although our analysis suggests that both types will eventually adapt to the game with practice, the learning curve for golf will be slightly steeper for field hockey players than for ice hockey players based mainly on that unfortunate golf cart and stream episode.
Learning to use Apple’s iPhone expertly is immeasurably easier than learning how to play golf at its most basic.
I routinely text and talk on the phone when driving. I am such a hyper, aggressive driver that doing these things actually make me drive slower and more calmly. Otherwise, I would be doing 70 on Kelly Drive rather than my usual 50.
P.S. The speed limit on that road is 35.
@PC Apologist
It’s a measure of INTUITIVE operation. How often did things that people tried to do (with no instruction) actually work? OSX is an example of a VERY intuitive interface. The iPhone is clearly less so. Whether it turns out to be better or worse or change the standard (thus changing intuition) remains to be seen.
I must be way smarter than you or the people in this study because within about five minutes, I could type faster on an iPhone than on my own cell phone. It was easy. Period.
MDN – I sure hope the iPhone is easier to learn than golf, given my experience with golf thus far…
One thing about this study was fishy though: “Those who owned a numeric keypad used the “multitap” method of entering text messages rather than predictive text.”
This is totally unrealistic. Who actually uses the horrid multitap option to send SMS’s? I would shoot myself when trying to text if my phone was not set to predictive text mode.
In a parallel universe, a study has found that people familiar with the iPhone’s conventional touch keyboard had trouble adjusting to the new QWERTY and numeric phone keyboards.
The study, with it’s sample of 20 users that are proficient on other types of input keypads is totally useless.
You would just have to see who funded the study to see why they got the results they published. A study can be designed to get any results you wish to find.
If they were up against iPhone owners with a month’s worth of typing experience, they would have been beaten badly and still the study would have proven nothing.
I’ve had an iPhone for 3 days, never texted on my old phone – too painful on a numeric keypad. My own experience pretty much echos the experience of the testers, tried to use fingernail, started using index finger, I am getting much better – a real pain to enter passwords when you first start.
I watched Apple’s intro video tape and it was a big help- never would have figured out to use space bar to accept predictive text. Still haven’t mastered magnifying glass.
Do I love my iPhone? Yes!!. And so does everyone I’ve showed it too.
It’s a new tool with a learning curve. That’s life!
What is the point of SMS? It sole purpose is so high school girls can communicate to one another from a quiet classroom without getting caught passing notes. Hell, it IS passing notes. There are plenty of other ways to communicate these days. I will eventually get an iPhone (maybe Rev 2) but I certainly won’t use it to text. I don’t text with my current phone. Most adults don’t need texting. If I’m in a meeting and I need to communicate with someone, I’ll either walk OUT and call them, or I’ll turn off my phone and wait until afterward. It’s simple courtesy.
Hi.
I found it very strange that anyone could expect to be able to have full typing speed on a completely new keyboard with only 30 minutes of learning time. They only got 30 minutes. And to base a trial on that? If they had any morals they would let the participants use the iPhone for two weeks and then measure the results….
Sponsored by: ???
Verizon? M$? Dell?
“Most participants noticed that there was no tactile feedback on the iPhone keypad.”
most did, huh? who were the others?
i can’t help but think about the picture of Rove. i wonder if he is smart enough to notice?
heheh.
i suspect that the study is sponsored by RIM. i notice they have “full real key keyboard” and “any network” ads on darn every web page around today.
i wonder how many users they have lost?
From their FAQ on the subject:
“For the general mobile phone user, any new device will have a transition period. However, in terms of the text input system, what this study found was that there was NO difference in text messaging efficiency between a mobile phone (non-QWERTY) compared to the iPhone’s touch keyboard. This is compelling because it suggests that users will have the same texting efficiency on the iPhone as they do today.”
Wow. Man, the people who pay this company to do studies and draw conclusions from it are really getting ripped off. With thinking like that, these guys could be financial analysts. Don’t they think that users will get better & better at typing on a touch screen? Nope. They think that someone who only gets 60 seconds to experience the touch screen before the tests begin will just remain at that level of proficiency for forever.
Idiots Gone Wild, is what it is.
OK, I just emailed the managing director of media relations, rschumacher@UserCentric.com at UserCentric.
I just read your survey about texting proficiency on an iPhone. While I seldom use language such as this, all I can say is that you guys must be a bunch of fucking idiots.
-Richard
PC Apologist,
How long do you think it took those people to learn to text on a normal phone? I remember learning that… I took forever to be even somewhat efficient. This test is total BS.
OpJ,
I bet you don’t have an iPhone.
Great MDN Take.
Marty, if you think I don’t have an iPhone you are an idiot. I was a few people in line behind Mayor Street here in Philadelphia, and went to the Apple Store in KoP the next day to pick up a second one, so my wife and I both have one.
A good survey, would be to find 30 people who had never used cell phones for text messaging, broke it up into 3 groups, and at the end of the time, see who was doing better
“…participants did not think they could text message on the iPhone safely while driving.”
As noted above, this statement is fucking ridiculous. However, keep in mind that at least one person posted this on MDN as a negative about the iPhone before the release and one “tech-writer” said parents should warn their children they cannot text while driving with the iPhone.
Seriously.
MY TAKE: The iPhone’s non-keyboard sucks, plus there’s no cut and paste feature on the iPhone. The use of a real keyboard with a cut and paste feature is the only thing I miss about my treo. I’d love it if Apple came out with an iPhone with a slide out keyboard a-la’-Samsung. Apple gota lot right with the iPhone, but the keyboard SUCKS.
Hey OpJ,
Who’s the friggen’ idiot here. You buy something that just came out that you haven’t used, and then go back the next day and buy another one? Sounds to me like you and your wife aren’t exactly on the brilliant side yourselves. Idiot indeed.
>Sponsored by: ???
>Verizon? M$? Dell?
MOTOROLA paid for the “study”.
Hey Lord–kiss my hairy jew ass. Text entry on the iPhone sucks compared to keys you can feel. Text entry on the iPhone is at least as good as multitap–pretty much exactly as the article states. The magnifying glass is not intutive, nor is touching bubbled text to indicate you DON’T want that text, and hitting the space bar to indicate that you DO want that text. The rest of the iPhone is fantastic–that’s why I said the iPhone touchscreen is a tradeoff.
The hardware problem with the keyboard–the lack of any tactile feedback–is on the balance worth the tradeoff of having the controls in software. The software Apple has used to implement text entry, on the other hand, needs improvement.
Unlike MDN I don’t feel the need to constantly tounge Steve’s balls so I think the third-grade parody MDN take is retarded.
When Apple’s business is producing intutive products and a study shows that some aspects of Apple’s new product aren’t so intuitive then the study accurately points out some things Apple might want to consider modifying.
It isn’t like User Centric has pointed out the problems with the touch keyboard for the first time ever–this has been the reaction of reviewer after reviewer.
MDN: Fuuuunny (and very good) analysis!
It sounds like they just got a bunch of dumbasses.
Lol @ MDN take. Hilarious!. So true.
It’s like putting individuals who have just learnt to ride a bicycle on the seat of a Ducati and ask them to ride, and then take a survey on how they feel.
One should not be texting while driving on any phone. It is irresponsible for them to even mention the possibility. Five teenagers were killed a few weeks ago in a collision with a truck. The driver had sent a text message 3 seconds before the fatal collision.
Get off the phone and drive. Or better yet, take transit so you can enjoy your wonderful iPhone