Card sort analysis spreadsheet
Over the past few years I have been slowly developing and refining a spreadsheet I use for analysis of card sorts. I have used it on many projects and find it invaluable for helping me manage the data and spot patterns.
I use it to analyse results from physical (i.e. not software) open card sorts. It could quite easily be used for closed card sorts as well, though I haven't done that as I don't do closed sorts.
I have refined it to the point where I'm happy with it, and have prepared instructions for it. The instructions and spreadsheet are completely free for you to use however you wish.
Files
There are four files available:
- Card sort analysis spreadsheet instructions (PDF, 715KB)
- Empty card sort analysis spreadsheet template for 20 participants (ZIP, 765KB) (last updated 14 December 2009)
- Example spreadsheet with content (XLS, 2.0MB): based on papers from the IA Summit
- Empty card sort analysis spreadsheet template for 40 participants (ZIP, 2.3MB) (last updated 14 December 2009)
If you use it, please let me know how you go!
Notes
Some other random notes:
- I have done everything I know to make the PDF screen-reader friendly, but please let me know if it isn't
- I use a PC and know it works on a PC. I have had mixed response from friends with Macs - for some it works, some it doesn't. If it doesn't, please let me know and I'll explore further
- In the comments below is an answer to the question "What do I do with sub-categories". I'll include this in the instructions next time I revise them
Screenshots
Entering the card names:
Summary of all cards and standardised categories:
Analysis of categories:
Visualisation of results:
Comments
Awesome Donna, you are the card sorting master (and an Excel master by the looks of it!). I look forward to your template for analysing card based classification evaluation...
Posted by: Pat | June 8, 2007 2:54 PM
Oh Donna if only I had this three weeks ago when analysing a card sort! Wonderful stuff. I look forward to using it.
Posted by: David | June 10, 2007 10:09 AM
Great contents. Thanks Donna.
Posted by: Jorge Laranjo | July 4, 2007 3:09 AM
Although I'm a big fan of running card sorts and learn a great deal each time I do, one of the trickiest parts is quantifying the results. Not any more. Thanks Donna.
Posted by: Joel | July 18, 2007 11:10 AM
Hi Donna,
Nice tool.
I am curious, after you a filled out a spread-sheet: What's next?
Any guidance you can give to answering this questions will be appreciated!
Thanks,
Alex
Posted by: Alexander Trofimovsky | August 15, 2007 7:36 AM
Thanks Donna. Just getting into this xls now and I think it is going to be very useful - especially to be able to show the quizzical managers some scientific analysis.
I am not sure how to approach sub categories. One sort group came up with 10 high level categories, but one of those categories has four sub categories, and one has three. Do I use the categories or sub categories in the group column of the Sort worksheet? Using only sub-categories might lose some useful chunking up.
much appreciated
Louisa
Posted by: Louisa | August 23, 2007 1:00 AM
Hi Alexander
When you have it all filled in, that's when you have to start thinking about what you have learned. It isn't something I can answer in a blog post but I promise I have two whole chapters in my book ;)
Posted by: Donna Maurer | August 23, 2007 12:31 PM
Hi Louisa
For analysis, you can do one of two things with subcategories:
- break them into their own little groups, but make a note of the broader group so you don't forget that it was there
- combine them into broader categories and keep a note of the detailed breakdown
The way I make the decision is to look at what the overall pattern is with all the sorters and analyse all at a similar level.
For example, if everyone creates 10 groups with 10 cards, but one group creates 2 main categories with 5 subcategories each, analyse at the sub-category level. If one group creates 10 main groups with 2 sub-groups each, analyse at the broader level.
This isn't just a limitation of my spreadsheet - all statistical analysis needs you to make this sort of decision in order to crunch numbers sensibly.
I'm going to add some notes about this to the instructions when I next review them.
Posted by: Donna Maurer | August 23, 2007 1:02 PM
Dear Donna,
I am testing your cardsort analysing tool.
I was trying to change the max of 200 cards to 224 cards. Now everyting is OK, but only at the tab: summery I mis a lot of cards. I think you put some formule in the xls with a maximum of 200?
Could you tell me what I have to change, and where I can change it.
I hope I can use your cardsort tool.
Regards, nick
Posted by: Nick | October 5, 2007 5:39 AM
Nick, this spreadsheet has lots of relationships - adding cards means changes need to be made throughout the sheet. I've just sent you the larger spreadsheet, but this too only manages 200 cards. I'll have to make you a spreadsheet that copes with more cards.
In my book, I've made a strong point about thinking about analysis in the planning stage, and making sure you can analyse what you collect ;) It is important to check your analysis tools before you start.
Posted by: Donna Maurer | October 5, 2007 8:26 AM
Donna, this spreadsheet is amazing. Also, your detailed instructions are exceptionally easy to follow. I now know how to do a merge to create labels! I am eager to use the spreadsheet tomorrow for a card sort session.
Thanks for sharing!
Posted by: Tim Cothron | October 11, 2007 5:29 AM
Hi Donna, would you mind sharing the larger spreadsheet with me as well? Thanks!
Posted by: Brian Henkel | November 19, 2007 12:42 PM
This tool was incredibly helpful. Thanks for sharing!
Posted by: Sara | December 6, 2007 12:59 AM
Donna, I cant think you enough for creating and posting this online. This has been an amazing and eye-opening tool for our card sort. One quick question though - We had 23 participants as opposed to 20. I added a few more tabs to cover their results, added new columns to both summary tabs and changed the formulas, but cant seem to revise the formulas enough pull in the data for tabs Sort21 -Sort23. Any ideas?
Thanks again for sharing!
Posted by: Michael Rodriguez | December 8, 2007 7:20 AM
Dear Madam
I have 39 cards for sorting. I dont have standarised categoriesbut i have sub-catgoryHow can i anayss them.
Pl. advicd
Posted by: Javed | January 26, 2008 12:28 AM
Donna,
This is great, it seems like it will make my life easier for the card-sort I am doing next week.
I have a question about how you designed the card sort: I see that you put fairly long descriptions on the cards in the first go. How exactly did you elicit the category names from users? Did they create their groups, & assign a group name (original category) of their choosing?
What do you think about the approach where I might provide a label on the front of the card & a brief description of the content on the back?
Thanks.
Posted by: Anjali | April 5, 2008 6:36 AM
Hi Donna,
Thank for sharing the spreadsheet. It has been a tremenduous help in analysing our cardsort results. We will be using it extensively for our future experiments henceforth.
Btw, just to check, do you have a copy capable of handling more than 50 sorts? If not, can you guide me to do so? Cos its seemed there are a lot of linking functions in the worksheets. I tried to add the sorts in but to no avail so far.
Many thanks in advance.
Regards
An
Posted by: An | April 7, 2008 7:41 PM
Hi Donna,
Thank you so much for the spreadsheet - it is invaluable. I wanted to add an extra 15 participants (to have 35 maximum)...is there any way that you can do that easily? I realized that you have to pull forumulas from the different tabs... or do you have a bigger spreadsheet that can accommodate a larger number of participants?
Thanks!
Posted by: Gen | April 8, 2008 7:51 AM
Hey Donna,
This is awesome stuff you have put up here. Made my life so much easier!
Thanks!
Reuben
Posted by: Reuben | April 23, 2008 8:38 PM
Thanks a lot for this and for your article on card sorting. Really useful!
Posted by: Vivienne | May 14, 2008 2:19 AM
Hi Donna
This is my first card sort analysis and i came across your spreadsheet just before i started to analysis my data. The only problem is i have approx. 100 sorts not 40. Can you perhaps explain the changes i need to make to the spreadhseet to increase the number of sorts or maybe send me a larger spreadhseet?
Your help would be greatly appreciated.
Thanks
Sharon Mc Aleer
Posted by: Sharon | May 22, 2008 7:04 AM
Hi Sharon
100 people is really too many for a spreadsheet ;) The spreadsheet is great for few enough participants that you can print out the big matricies and look at what they came up with, and you really can't do that with 100 people. Your best bets for that number of participants is:
- split them somehow (demographics, role) and compare results across a couple of groups
- use a statistical tool
Posted by: Donna Spencer | May 22, 2008 7:27 AM
Hi Donna,
Great tool, thank you for sharing. I am using it now for the IA of our Intranet.
I have found what it looks to be a bug, at least to me. On the CatsSummary column C you have a formula =COUNTIF(StandardSummary,AX) (being X the row)
That will count the number of times the standarised category (in AX) is repeated on the sheet StandardSummary. OK. The problem is that if you have a standarised category with the name of a normal card it will count it +1 so giving wrong and quite confusing results. A better formula would be =COUNTIF(StandardSummary!C2:AP201,AX). I hope this helps.
For Sharon (although a bit late for you...):
Are you really sure that you need 100 people? Well, if you can afford it then it is great but i am not sure 100 people will give much better results than 30 or 20 people. Actually there is a nice paper you could create from that analysis (correlation of 20 users vs correlation of 100) since i don't see many studies about it.
http://www.useit.com/alertbox/20040719.html
http://www.useit.com/alertbox/quantitative_testing.html
Best regards,
David
Posted by: David Garcia | October 31, 2008 10:06 PM
Thanks for making this spreadsheet available Donna. What a great tool especially for novices like myself. We just completed a preliminary card sort and your spreadsheet will make explaining the data so much easier. Thanks for all the hard work!
PS --- your user instructions are very well written as well.
Posted by: Liz Stephenson | April 16, 2009 4:01 AM
Hi Donna,
This is one good tool, I'll explore it further.
Note: one good quick start to my usability study.
Thanks once again!
Posted by: Roopa Bhatt | June 10, 2009 6:20 PM
Hi Donna,
this method seems like inviting the guests of a restaurant to make the food in the kitchen with the cooks. Isn't the least thing an IA needs "suggestions" from client side on the site structure? I see the comforting rays of mathematics being emitted from this, which can warm a frosty client-IA relationship and give the IA the untouchable aura of a scientist, which then paves the way for the delivery of the actual work: a new site concept that none of the clients could have thought of with more than an initial idea anyway (an idea you can easily collect in a two hour brainstorming meeting). I don't see anything but a soft, mellow middle Information Architecture solution coming out of this that pleases everyone and no one. Unless you throw all data out after everyone got the feeling that their voice counts and will surely embrace the new solution. (The old mediator trick) and then start the actual work. I also can't remember the last project that actually had a budget for something more than a questionaire/brainstorming meeting to gather everyone's opinions on the company, products, their own work and their wishes for the new site. Luxurious! Where did you find the clients that pay for this? The mysterious, undiscovered forests of the Information Architecture market.
Posted by: IA | July 1, 2009 12:40 AM
IA, card-sorting participants aren't made up of the client team.
Posted by: Mike | July 1, 2009 12:39 PM
This is fantasitc, Donna. Thank you so much for sharing your spreadsheet. What a huge time saver for us all. I wish you every success with your book!
Posted by: Shannon Halgren | January 8, 2010 2:34 AM