What are the best statistics for a UX Team to collect about its product?
There is a great paper on UX metrics by Kerry Rodden and Hillary Hutchinson, who are UX Researchers at Google.
Measuring the User Experience on a Large Scale:
User-Centered Metrics for Web Applications
It’s an academic paper, so it’s a little dry, but well worth the read. Here’s a quick summary:
Teams should focus on metrics that indicate:
- Happiness – Often measured through a long-running survey that includes a Net Promoter Score ®.
- Engagement – Visits per user per week. Or posts per user. In Gmail, we carefully watch a metric we call “5 of 7”. It’s the percentage of users that visit the product at least 5 out of 7 days a week. (This metric turns out to be predicative long term retention)
- Adoption – Measured as daily active users (DAUs). Or commonly at Google: 7-day-actives, which is the number of unique users who have used the product once in the last week.
- Retention – There are many ways to measure this. I like looking at the percentage of 7-day-actives who are still 7-day-actives a week later, a month later, and 3 months later.
- Task success – This can be measured by looking at abandonment rates in any task, or looking at time-to-completion of key tasks. For example: on Quora, you may measure how long it takes to answer a question, and how many people start to answer, but do not finish.
The paper goes into much more detail about “… articulating the goals of a product or feature, then identifying signals that indicate success, and finally building specific metrics to track on a dashboard.”
Which are the best design and user experience firms that can redesign the look, feel and information flow of a website?
Given the paucity of information here, for instance your audience (and industry), the site goals, your budget, the metrics of your current site, and the talent that you have in house as well as the last time you did a redesign, I am going to assume a number of things, as well as time and budget being infinite, the site being mostly content/marketing with little transactions, your team being small that can be dedicated full time to this project. For the top website UX/Visual Communication Design firms, you must expect to pay no less than $100K. You must also expect (assuming the taxonomy and content strategy of your current site is not massive), that it should cost no more than $250K. Mind you – this is for the very best – this is not Ford Focus territory, this is Astin Martin.
Two notes (These are strong opinions, so take that for what it’s worth – but it’s also based on 15 years experience working for product companies, operating companies, start-ups, enterprises, as well as for a few “digital” agencies):
First, do not, under any circumstances, go to a top tier “digital” agency. Your budget will be blown on account directors, fancy offices, lush travel accounts, and the direction and design will be led by the vicissitudes of a cranky creative director who has more interest in pursuing a dream of producing the next great independent firm than designing an elegant, useful, usable, desirable website that meets your core business objectives. Large digital agencies, by and large, also don’t have a core UX capability – their dirty little secret is they outsource most of the usability, information architecture, interaction design, and user research to contractors. A simple test is to look at the senior leadership of the firm – if there is an executive creative director, but no senior UX person on the leadership team, you know what their focus is – internal power structure indicates values – and if UX has no power in the organization, it’s an after-thought, and it will be an after-thought on the design of your site.
Second, do not hire a development firm that advertises their expertise in “Rails, Python, iOS, ,insert language and/or platform here>”, because while they may be able to write elegant, standards compliant code in a rapid manner, they will not, by and large, have a focus on user research, audience definition, design testing, or visual communication design. If the firm is dedicated to Adobe Flash implementations, run – don’t walk.
The top user experience design and visual communication design firms (notice the difference), for that kind of project with 3-6 months, and over 100K in budget is hands-down Happy Cog, Messagefirst, and Behavior Design. This is my opinion, but each of these firms has a strong reputation in both the design and user experience communities, have delivered consistent results year-over-year, and have processes and methodologies to back up their work as well as in-house talent in leadership roles that are considered best of the best by their respective communities. None of them will break your bank either (you can definitely spend more).
http://happycog.com/
http://messagefirst.com/
http://behaviordesign.com
Now, if you are loaded, and want to spend either that same amount, or even significantly more for the exact same quality or slightly lower quality site, then by all means, go with one of these next three, that will still deliver relatively good results, but more of your budget will end up funding fancy offices and multiple account directors (with all they lovely padding that comes with it), but not necessarily any meaningful or measurable increase in the value of your new site:
Huge, Inc
R/GA
AKQA
Each of these firms will design something that is good, but ceteris paribus, are at least 2x more expensive than the previous 3 firms, with no significant increase in the value of the product they will deliver to you. They do have quality UX and Creative in-house (will not out-source it to contractors, and they have in-house UX and Creative talent that are well-known and respected in their communities – perhaps not to the extent of the first three – but solid), but their rate sheets may bring tears to your eyes.
Happy hunting. If you want the same breakdown for transaction-heavy sites, e-commerce sites, or massive content sites, I can provide that information as well.
One last note: I know sometimes Forrester Research publishes something related to Web Design or User Experience Design, and in the course of doing an industry overview of the fields and disciplines, sometimes goes as far as recommending a few firms that do ux and/or web design work. I would take their recommendations with many, many grains of salt. Firstly, they are not known for doing solid, quantifiable research in the UX field; also, they are not exactly considered the arbiters of great ux, design principles, etc – and finally, many times they have been known for recommending firms or agencies that just happen to be clients of theirs – so they are not the most objective source of information or recommendations – even if they were considered thought leaders in the ux space – which they are not. I once saw a “heuristic evaluation” done by them which was, in fact, done by people for the ad agency world – and let’s just say that their understanding of design principles, user-centered design, and best practices was bordering on negligent idiocy. #JustSaying
Again, just my opinion, YMMV.
What are innovative, new ways to design Master/Child relationships on a page? [on hold]
I’m currently working on a ASP.net application that has a variety of master, child relationships, portrayed on the page in a master gridview with tabs below. While this works for a somewhat small set of relationships, I was w…
What are innovative, new ways to design Master/Child relationships on a page? [on hold]
I’m currently working on a ASP.net application that has a variety of master, child relationships, portrayed on the page in a master gridview with tabs below. While this works for a somewhat small set of relationships, I was w…
What company’s UIs are at the forefront of design, and why?
I’d look at if the UI/UX is getting the users from A to B in as few steps as possible, and as simply as possible. If it feels too complicated, then your designer needs to iterate. Looking at trendy screenshots is not something I recommend. Looking at design patterns might be, if you notice a UI problem and want to know best practices for how it may have been previously solved:
What is the most common user interface in the world? [closed]
Please explain:
(1) What leads you to believe the interface is the most commonly used, and
(2) Why do you believe that it is an interface.
UPDATE: Leonardo Herrera’s answer “The button, and its cousin hyperlink” had been…
Is custom manufacturer order confusing for users ?
I have an eshop that has in the menu a list of manufacturers available on the website. The default order for them is alphabetical, but due to marketing reasons the owner asked that several manufacturer should be first in the …
Software creating user interface prototypes on Linux
I’m looking for user interface prototyping software. I like Axure, but it is not available on Linux, so I’m looking something similar with it. What open source project do you use for basic UI prototyping? What are pros and co…
In a grid, how to display long column headers
When displaying data in a grid (each row contains a record, each column a different record field), vertical space need is easily solved with scrolling or paging.
We are usually sooner missing horizontal space as the number o…
What is a good way to display infinite nested comments?
Is there a way to do infinite nested comment threads in a way that doesn’t look horrible? I realize that one could simply restrict the levels of nesting, but perhaps there’s a better way of indicating some comments are replie…