New feature: Compare task results in Treejack

4 min read Caitlin McDougall

Please note, this feature has been partially rolled out. If you don’t have access to it yet, feel free to get in touch with us at support@optimalworkshop.com and we’ll get it up and running for you!

Your navigation structure is the backbone of your website, app or product. It’s where people go to find what they need, quickly and easily. A good structure should lead your users to exactly where they want to go, without them even having to really think about it. A bad one, however, can leave them lost and frustrated.

Tree testing helps you evaluate your navigation structure (or tree). It helps you determine the path people expect to take to find the information they need, where they might get lost in the process, and what you can do about it.

Testing and comparing multiple variations of trees, and then iterating on what you learn, can help you nail down an effective navigation structure before you implement it.

Compare task-based Treejack results

To make this process easier, we’ve released a brand new comparison functionality in our tree testing tool, Treejack. It allows you to compare two tasks from two different Treejack studies without even having to leave the results page.

This new feature removes the need for multiple displays or downloading a spreadsheet and manually comparing the data, thus removing the tedium and cognitive overload so often associated with comparative analysis.

And the best part is, this is only the first of many new improvements to come! Watch this space for an even better tree testing experience (but more on that further down).

Using the comparison feature

The image above shows a common workflow of how Optimal Workshop tools can be used together to improve your navigation structure. 

To create a great navigation structure, it’s best practice to test variations of your tree, often multiple times, before you implement it in production. You’ll then want to compare the results of these variations to get a clear understanding of what did and didn’t work. However, the comparison stage can often be overly time consuming and there’s always a lot of data to wade through to find the information you’re looking for.

This new Treejack feature helps make comparing your variations easier and faster by putting results side-by-side for you to explore simultaneously. 

How does it work?

Simple! Open the tree test that you want to start your comparison from, then navigate to the Task Results tab in the Analysis section.

Click the ‘Compare’ button in your chosen task then select the study and task you want to compare with.

That’s it! You can now compare the two tasks together and start the analysis process. Do this as many times, with as many tests and tasks, as you need to.

What’s on the horizon?

The comparison functionality is just the first of many to come! We’re working on a number of new features that will make it easier than ever to improve your navigation structure. Here’s what you can look forward to…

Compare pie trees and table view

The ability to compare pie trees and table views will help you diagnose what went wrong, as well as cherry pick the bits that are working well from other tree variations.

You’ll be able to compare side-by-side:

  • Paths: The different paths participants took and where they failed or recovered.
  • First click: Did the participants find the correct entry point on your top level navigation?
  • Destination: Where did the participants end up, or think they’d find the right information?

This information will be presented to you visually in the pie trees, and the corresponding table views will give you the data to support these pie trees.

Download/Export raw data

We’ll be adding the ability to download the raw data from your comparisons in one single spreadsheet, which means no more copy-pasting from one spreadsheet to another!

Compare at a study level

As well as comparing at task level, you’ll be able to compare entire studies. This will help you see which variation of your tree performed best overall, or if your iteration was an improvement on your benchmark structure.

You’ll also be able to easily identify which parts of each tree need further attention, or could serve as a blueprint for other trees. 

Support the setup of multi study projects, including A/B testing

We want to make it even easier for you to set up your iterations or variation tests right from the start and also allow you to randomly distribute participants to your tests.

Wrap up

We’ve got a lot of exciting improvements in the pipeline – the Treejack comparison of statistical task results feature is just the beginning! As always, we’d love your feedback on this new release. Log in now, give it a go and let us know what you think!

Treejack

Iterate and improve your navigation

Get quicker and faster insights. Compare your tree test results in record time with our latest comparison feature.