Tagging your way to success: How to make sense of your qualitative research
User research often leads us down long and windy paths of enquiry. Unlike quantitative data that can be neatly categorized, ranked and measured, qualitative data from interviews and user tests can quickly become hard to manage.
Whether youâre a notebook, Post-it or audio recording kind of person, collecting and making sense of your qualitative research can be a challenge. Insights can easily become buried in stacks of notes and observations, making the process onerous and time consuming.
How do I make sense of it all?!
When youâre strapped for time, qualitative analysis can quickly become unwieldy.
The good news is that with a bit of upfront planning, digging into your data can become a lot more manageable (and enjoyable) later on.
Coding, categorizing, normalizing, bucketing â turning your data into a more digestible format has many names. The end goal is to facilitate analysis by making your data easier to filter and manipulate, allowing you to quickly identify things that may be causing âdelightâ on your âhomepageâ or âfrustrationâ at âcheckoutâ.
It also gives you the benefit of quantifying your qualitative findings, which grants you both enormous satisfaction and superhero status among your peers.
âTagsâ are added to observations, and are essentially criteria that allow you to filter and organize your data later on. Coming up with the right tags and related definitions for your project can save you a lot of time and stress, and as we all know: happy researcher, happy life (or something like that…).
What tags are most useful?
Since the launch of the Reframer beta back in 2015, researchers from all over the world have been using it to collect and make sense of their findings from user interviews, usability tests and more.
What better place to go to understand what tags researchers find most useful in analyzing data? I enlisted Mila â our bright and shiny new data scientist â to look for any patterns I could find.
When looking at what tags researchers rely on most frequently, I started by looking at the usage of one of Reframerâs newest features â the ability to create tag groups. I first wanted to identify what tag group names were most popular.
Most popular tag group names
Unsurprisingly, sentiment reigned supreme. Sentiment tags, such as âfrustrationâ or âdelightâ help in identifying positive and negative moments in our research, and make it easier to pinpoint areas where improvements can (and should) be made.
The second most popular group, âtasksâ, helps to identify what it is that weâre testing.
Whether itâs a task, an activity, a screen in your prototype or a specific question you want to explore, tags help in linking observations back to your research objectives. I then looked at what tags were most popular.
Most commonly used tags
As for tag names themselves: apart from sentiment tags such as âpositiveâ, ânegativeâ, âpainpointâ or âconfusionâ, the most popular tags are those that refer to specific elements of the pages and workflows we are testing. From âsearchâ, ânavigationâ or âcontentâ, through to devices and touchpoints such as âmobileâ or âemailâ â there was a lot of variety.
In summary, tags are most often used to identify:
- How the participant feels about their experience (sentiment),
- What the observation is referring to (for example task, screen, workflow, question)
- Devices or page elements specific to your product or service (for example content, navigation, pricing, mobile, email).
So what should you consider when creating a tagging strategy for your next project?
Setting yourself up for success
1. Keep analysis in mind
Think of your tags as variables that youâd like to use to filter your data later with in the process and work backwards. While you canât predict the outcomes of your research, you can anticipate some of the core themes youâll want to explore based on your objectives.
Consider some of the standard elements you capture in your sessions â whether itâs sentiment, significance ratings, touchpoints, devices used or pages visited.
By carefully considering your strategy once, youâll likely find use for it in future projects, too.
Iterate and improve your navigation
Get quicker and faster insights. Compare your tree test results in record time with our latest comparison feature.
2. For usability tests, predefine your tags at the start of your project
For task-based research (such as usability testing), you can predict some of the tags youâll find most useful for your project based on your objectives. A group of tags that relate to sentiment is a safe bet. Using tags to identify the tasks or screens youâre testing, or the activities youâre asking your participants to complete is also a good idea.
By filtering by task and sentiment, youâll quickly be able to identify the most common usability issues or frustrations encountered. Including a significance or severity rating can also help in surfacing critical issues.
Creating tags on the fly while note-taking can be a big distraction. Determining your tagging strategy at the start will help to keep things consistent and make it easier to make sense of your data later on. By combining related tags into groups, youâll also give your tag list most structure and make it easier to navigate.
3. For interviews, determine your approach once your data rolls in
In the case of more open-ended research such as interviews or contextual enquiries, predefining tags beforehand may lead to unintentional bias.
While you may add some relevant tags before you begin, refrain from settling on your tagging structure until youâve collected all of your data. Taking some time to immerse yourself in what youâve heard will help develop a set of tags best suited to the data youâve collected.
4. Less is more
It can be tempting to extend the list of tags youâre using as you go, amalgamating tags such as âhomepageâ and âconfusionâ into âhomepage_confusingâ. Convoluted tag combinations wonât make analysis easier, and will only slow you down.
Consolidating your tags is a great way to tidy and refine your tagging system, and can easily be done using the âmergeâ feature in Reframer. Creating groups for related tags (for example âsentimentâ, âtasksâ or âdevicesâ) will also help keep things organized.
A poorly-thought through set of tags will double the time it takes to make sense of your data.
Create distinct tags that will be useful and informative in analysis. What is your participant doing? What device are they using? What is their goal? How do they feel about it? After all, thereâs no point in tagging something that could easily be identified through a simple keyword search.
How many tags should you create? It will vary depending on your project. With researchers creating an average of 3 groups consisting of 7-8 tags each using Reframer, 15-25 tags is a healthy number to aim for.
5. Make use of session tags
While tags can help you make sense of your individual observations, theyâre also useful for identifying session level information, such as participant demographics, personas, user groups or devices used.
Session tags in Reframer allow you to automatically add tags to all observations captured within session, giving you more flexibility for segmenting your data across sessions later on.
Keep it simple, stupid
Whether you predefine your tags, create them on the fly or wait until youâve collected all your data, simplicity is your friend.
Not having a well-defined tagging structure leads to over complication and time lost. Create tags that are meaningful enough for you to easily make sense of them, without being too specific.
Making use of tag groups is a great way to help organize your tags, while reducing complexity.
It’s important to have a clear understanding what level of granularity you’re working with – sometimes more detail is needed, sometimes less detail is sufficient â a clear structure should ensure that you’re focussing on the right level of granularity for your project.
It may take a few projects to arrive at a tagging strategy that works best for you, but with time, the process of discovering patterns in your data will become a lot more satisfying.
Reflect, iterate and repeat.
Sounds familiar, doesnât it?
Usability testing made easy
Give our qualitative notetaking tool Reframer a try for free (no credit card required) and see how easy it is to get actionable, useful user insights.
Recommended for you
Qualitative research methods
Interested in qualitative research methods but donât know where to start? This article gives you a solid introduction.
How to build rapport in a user interview
How exactly do you build rapport in a user interview? Here's all you need to know.
Note-taking: The best tool to get stakeholders onside with your next research project
Getting stakeholders aligned and engaged with your research is rarely easy. In fact, itâs often one of the hardest parts of being a user researcher.