Card sort analysis spreadsheet
Over the past few years I have been slowly developing and refining a spreadsheet I use for analysis of card sorts. I have used it on many projects and find it invaluable for helping me manage the data and spot patterns.
I use it to analyse results from physical (i.e. not software) open card sorts. It could quite easily be used for closed card sorts as well, though I haven't done that as I don't do closed sorts.
I have refined it to the point where I'm happy with it, and have prepared instructions for it. The instructions and spreadsheet are completely free for you to use however you wish.
Files
There are four files available:
- Card sort analysis spreadsheet instructions (PDF, 715KB)
- Empty card sort analysis spreadsheet template for 20 participants (XLS, 4.1MB)
- Example spreadsheet with content (XLS, 2.0MB): based on papers from the IA Summit
- Empty card sort analysis spreadsheet template for 40 participants (ZIP, 1MB)
If you use it, please let me know how you go!
Notes
Some other random notes:
- I have done everything I know to make the PDF screen-reader friendly, but please let me know if it isn't
- I use a PC and know it works on a PC. I have had mixed response from friends with Macs - for some it works, some it doesn't. If it doesn't, please let me know and I'll explore further
- In the comments below is an answer to the question "What do I do with sub-categories". I'll include this in the instructions next time I revise them
Screenshots
Entering the card names:
Summary of all cards and standardised categories:
Analysis of categories:
Visualisation of results:
Comments
Awesome Donna, you are the card sorting master (and an Excel master by the looks of it!). I look forward to your template for analysing card based classification evaluation...
Posted by: Pat | June 8, 2007 02:54 PM
Oh Donna if only I had this three weeks ago when analysing a card sort! Wonderful stuff. I look forward to using it.
Posted by: David | June 10, 2007 10:09 AM
Great contents. Thanks Donna.
Posted by: Jorge Laranjo | July 4, 2007 03:09 AM
Although I'm a big fan of running card sorts and learn a great deal each time I do, one of the trickiest parts is quantifying the results. Not any more. Thanks Donna.
Posted by: Joel | July 18, 2007 11:10 AM
Hi Donna,
Nice tool.
I am curious, after you a filled out a spread-sheet: What's next?
Any guidance you can give to answering this questions will be appreciated!
Thanks,
Alex
Posted by: Alexander Trofimovsky | August 15, 2007 07:36 AM
Thanks Donna. Just getting into this xls now and I think it is going to be very useful - especially to be able to show the quizzical managers some scientific analysis.
I am not sure how to approach sub categories. One sort group came up with 10 high level categories, but one of those categories has four sub categories, and one has three. Do I use the categories or sub categories in the group column of the Sort worksheet? Using only sub-categories might lose some useful chunking up.
much appreciated
Louisa
Posted by: Louisa | August 23, 2007 01:00 AM
Hi Alexander
When you have it all filled in, that's when you have to start thinking about what you have learned. It isn't something I can answer in a blog post but I promise I have two whole chapters in my book ;)
Posted by: Donna Maurer | August 23, 2007 12:31 PM
Hi Louisa
For analysis, you can do one of two things with subcategories:
- break them into their own little groups, but make a note of the broader group so you don't forget that it was there
- combine them into broader categories and keep a note of the detailed breakdown
The way I make the decision is to look at what the overall pattern is with all the sorters and analyse all at a similar level.
For example, if everyone creates 10 groups with 10 cards, but one group creates 2 main categories with 5 subcategories each, analyse at the sub-category level. If one group creates 10 main groups with 2 sub-groups each, analyse at the broader level.
This isn't just a limitation of my spreadsheet - all statistical analysis needs you to make this sort of decision in order to crunch numbers sensibly.
I'm going to add some notes about this to the instructions when I next review them.
Posted by: Donna Maurer | August 23, 2007 01:02 PM
Dear Donna,
I am testing your cardsort analysing tool.
I was trying to change the max of 200 cards to 224 cards. Now everyting is OK, but only at the tab: summery I mis a lot of cards. I think you put some formule in the xls with a maximum of 200?
Could you tell me what I have to change, and where I can change it.
I hope I can use your cardsort tool.
Regards, nick
Posted by: Nick | October 5, 2007 05:39 AM
Nick, this spreadsheet has lots of relationships - adding cards means changes need to be made throughout the sheet. I've just sent you the larger spreadsheet, but this too only manages 200 cards. I'll have to make you a spreadsheet that copes with more cards.
In my book, I've made a strong point about thinking about analysis in the planning stage, and making sure you can analyse what you collect ;) It is important to check your analysis tools before you start.
Posted by: Donna Maurer | October 5, 2007 08:26 AM
Donna, this spreadsheet is amazing. Also, your detailed instructions are exceptionally easy to follow. I now know how to do a merge to create labels! I am eager to use the spreadsheet tomorrow for a card sort session.
Thanks for sharing!
Posted by: Tim Cothron | October 11, 2007 05:29 AM
This tool was incredibly helpful. Thanks for sharing!
Posted by: Sara | December 6, 2007 12:59 AM
Donna, I cant think you enough for creating and posting this online. This has been an amazing and eye-opening tool for our card sort. One quick question though - We had 23 participants as opposed to 20. I added a few more tabs to cover their results, added new columns to both summary tabs and changed the formulas, but cant seem to revise the formulas enough pull in the data for tabs Sort21 -Sort23. Any ideas?
Thanks again for sharing!
Posted by: Michael Rodriguez | December 8, 2007 07:20 AM
Dear Madam
I have 39 cards for sorting. I dont have standarised categoriesbut i have sub-catgoryHow can i anayss them.
Pl. advicd
Posted by: Javed | January 26, 2008 12:28 AM
Donna,
This is great, it seems like it will make my life easier for the card-sort I am doing next week.
I have a question about how you designed the card sort: I see that you put fairly long descriptions on the cards in the first go. How exactly did you elicit the category names from users? Did they create their groups, & assign a group name (original category) of their choosing?
What do you think about the approach where I might provide a label on the front of the card & a brief description of the content on the back?
Thanks.
Posted by: Anjali | April 5, 2008 06:36 AM