Comparing apples with bicycles – reviewing the big picture experience
Posted in UCD, UXD, User-Centred Design, intranet, web on January 29th, 2010 by The Long Dog
I firmly believe the true user’s / customer’s / audience’s / whatever’s experience is that of ‘the big picture’ – or at least that the big picture has a direct impact on a user’s experience. Just because it’s a Norwegian Blue with beautiful plumage doesn’t make up for the fact the parrot is dead. Clear as mud? Thought so.
The user experience (UX) isn’t just about websites. Working out whether the buttons are labelled correctly or the journey through the content is smooth and direct is core to interaction design (IXD) but only part of the UX big picture.
Ok. If you’re booking flights on a budget airline’s website your tolerance for mistakes or a lumpy UX is going to be much higher than for booking a week’s sojourn on The Orient Express. Why? Because you’re human and your expectations of the website performance are based on your perception of the brand. The budget airline possibly spending five times more than the luxury travel option on their website means nothing – budget airlines are acceptably rubbish while the Orient Express is luxury, sophistication and service second to none. End of story.
An agency once commissioned me to review the customer experience of the top five UK multichannel retailers – organisations who sell across multiple channels – in this case online, in-store, catalogue and phone.
I’ve often heard someone isn’t ‘comparing apples with apples’, in other words unfairly comparing different things, but that’s exactly what I was asked to do here. I might as well have been trying to compare apples with bicycles. I had no idea how to do it so I invented a way. As a starting point I used Jakob ‘self styled usability guru’ Nielsen’s ten general principles for user interface design and bent them to my will – or rather converted them to blend across all channels, applying a simple five point measurement:
- No problems
- Cosmetic problem only
- Minor problem – low priority fix
- Major problem – high priority fix
- Catastrophic problem – imperative fix
It’s pretty dull stuff, so you can check the list out as an excel table here, but definitely worth a look if you’re trying to work out how to compare dissimilar parts of the big picture experience. The thing to understand is that while you’re only thinking about a website, your user arrives with a lot of baggage:
- The brand. Not just logos and colours – what doest the target audience expect from the brand and how do they expect to interact with it?
- Have users had experience with physical products or services? This will influence their expectations of how the site will behave
- Communications: This is huge. Understand how the audience is communicated with. How will this affect users’ entry points to the site, what they expect to find when they get there, who the comms has been targeted at and … well … just make sure comms and your work are on the same page
- Make the brand and user experience seamless
- Objectively test with real users – they’ll give you honest and surprising feedback that is correct, beyond your best and most educated guesses
The eventual report I wrote for that agency was 150 pages long (130 longer than they first imagined – but I did tell them it would be tricky) so I ‘m not going into any more detail here. Happy, as always to answer questions and reply to comments, but this little lot of heuristics should get you thinking.
Think big picture. Think … holistic experience (dude).
The Long Dog

Her wicked sense of humour doesn’t conceal her no-nonsense attitude and she’s a true digital professional, able to move between the often immiscible worlds of tech, comms and business strategy. She’s run intranets for some of the worlds best known brands, is a keen sportswoman and all round fun person to be with. Ok … that’s her ego massaged enough – here’s 60 seconds with one of best Intranet Managers I’ve met:
Also, like a rose garden, the downside of a lack of management is rambling and exponential organic growth, but the knock-on results of this for a website are measurably worse: