Skip to Navigation | Skip to Content

Search Analytics

Conversations with your customers

Title In Progress

Using search analytics to improve navigation

That will be the title of one of our chapters, and I'm digging into it now. And I'm finding it a bit surprising.

Unlike other topics we're covering in the book—using search analytics to improve content development, metadata, search results, and so on—there seems to be comparatively little to cover here. While there's nothing wrong with short chapters, I do want to make sure that we're not missing something big. And obvious.

So here's what I've come up with so far, in a rough mix of outline and prose. If you have any experience in using SA to enhance your site's navigation, we'd appreciate your input, not to mention any additions you think we should incorporate to the list below (full credit due, naturally):

The Caveats

  • Searching and browsing aren't the same; everything we say here should be taken with a huge grain of salt
  • But sometimes what people search can mirror what they browse, and vice versa; so while this chapter is full of conjecture, it's worth considering what benefits search analytics might hold for us as we design means for navigating our sites

Learning from Failures

  • Analyzing failed navigation sessions that lead to searches. Use referrer data to see which navigational pages—aside from the main page—originate queries. Analyze the queries associated with each of those pages. If common topics emerge, create ad hoc links to related information from those pages to enable contextual navigation. If types of content emerge, then consider creating a tight link between the type of originating page (e.g., product description pages) and the likely type of destination pages (e.g., product review pages). Now you're building content models that encode contextual navigation into repeatable logic.
  • Analyzing failed search sessions to see where users navigated next. This is far more conjectural, and I have no supporting data. But it seems worth examining frequently 0 results queries, see if there are patterns to where the originated (e.g., content types A, B, and C), and see if there are patterns to where users navigated after the failed search (e.g., content types X, Y, and Z). If patterns emerge on either side, it might indicate the need for creating contextual navigation between these types of content (e.g., content types A, B and C should link to X, Y, and Z).

Looking for Opportunities

  • Improving on existing navigation. Search analytics will help you improve some existing navigation systems, and less so with others.
    • Site indices: Michigan State University ingeniously uses the same data that backs its Best Bet search results to serve as an A-Z site index. Essentially, frequent queries are used as index entries, and are linked to best bets. The entries aren't as comprehensive as those in a manually developed index, but are broad in scope and cover the most popular queries, and are thus much less expensive to maintain.
    • Site hierarchy (and, by extension, tables of contents): The benefit of SA is less obvious here. Common queries are often navigational in nature; major queries or clusters of queries might suggest category or sub-category labels that should be included in a hierarchy or taxonomy. So at best SA can help validate and perhaps identify gaps in an existing hierarchy.
    • FAQs and Guides: Clearly, FAQs and guides should be developed in response to common queries, both in terms of general topics and specific questions addressed within each.
    • Wizards: Unclear; might their flow/sequence be informed by the corresponding flow/sequence of search sessions?
    • Contextual navigation: Already addressed in the Learning from Failures section.
  • Leveraging sessions to better understand navigation. It seems that session analysis—looking at how queries develop and change in the course of a single search session—might unlock some clues about how users seek to navigate. So, for example, we might see patterns like this one: "car model name"=>"that model's pricing"=>"financing the car". Such patterns might suggest models for contextual navigation (and for wizard design). The challenge is detecting these patterns. I think it can be done by searching for some reasonable number of common queries within sessions, and then analyzing those sessions for patterns. It's potentially a lot of work with little payoff, but for certain types of sites with fairly consistent query types—Netflix, for example—it might be cost effective, as patterns would emerge relatively quickly.

Digging into the Long Tail

Everything mentioned above pertains to the natural starting point—the "Short Head". Can the same sorts of analyses be applied to Long Tail data? It seems entirely possible to work with random samples of such data, and we know that queries vary between the two (Short Head queries are typically more navigational, Long Tail more research-oriented). If nothing else, one could analyze Long Tail data to see if content types emerge that aren't reflected in existing content models—essentially, content model gap analysis.

OK, this is what I have; I'd love any feedback on how search analytics can help improve navigation.

—Lou Rosenfeld

Comments

My two cents, with two real examples:

- First hypothesis: many people browse more (and in my opinion, "before") than search inside a site, as shown by Koch, T.; Ardö, A; Golub, K. Log Analysis of User Behaviour in the Renardus Web Service.

We looked then at our search log, and found a consistent top query through various months. The query (an other synonyms associated also in the top ten-twenty) talked about a section we have perfectly remarked by a graphic banner in the home (not in the classic categories section used throughout the site) Would change the situation if we transform this "graphically labeled" section into a text label placed in the categories column, and not only in the home, but within the whole site?

Result: yes indeed, this query (and similar queries) disappeared from the top, and the section itself gained about 300% visits. We validate also the hypothesis with a usability (qualitative) test: most of the studied users looked first within categories, then type keywords on internal search engine if not found browsing.

- Second hypothesis: in certain topics, we can forecast future search demands based on previous observation of seasonality. Connected to first hypothesis, if we prepare navigation (browsing navigation) for it, we will have less searches on internal search engine, and more visitors through a simple and natural SEO effort.

Google Trends was of great help, and trends confirmed by our 3 years old search log. People were looking in the same season about a certain topic. We have content for it, but disgregated and not well labeled. Of course, we created a monograph section on the topic, placed high on categories section a month before this future topic searching season started, and saw what happened.

Results: great indeed numbers, by every possitive indicator, and less searches.

So, yes indeed, search log analytics improve navigation.

Cheers,

Jorge Serrano-Cobos

Jorge, thanks for the excellent comment!

It's interesting to see how much SA has driven your navigation work. It seems that it's been focused primarily on improving main page layout, specifically which content you're making most prominent.

I think that Rich Wiggins had a different experience at Michigan State University, where "campus map" was a common query. They placed a prominent link to the campus map from the main page, but it didn't have a significant impact on the number of queries executed for "campus map". The problem may have been that it was a visual link, not textual, so it could have appeared to be an ad banner to many users. Rich, did I get this right?

Jorge, could you also describe the site you're referring to (and provide a URL if its publicly-accessible)? Many thanks.

Sure, no problem:

You can take a look at this pdf about information seeking case studies (in spanish, but probably understandable the most interest part for you) Look at page 26, there is shown quite visually the process of design iteration, and some figures. And a couple of citation of you two, guys ;-)

There is also an abstract in english in E-LIS, which I recommend profoundly as is a great source for bibliography ;-)

The web, the Official Tourism Site of the Region of Valencia .

I guess also the same as you, Lou. A text link works much much better than the visual one, and this was the case. Also, notice that the link is not only at the home, but every internal page. So, now for users coming straight from links and search engines to internal pages, is not "invisible", as it was before.

Search analytics power, yes indeeeeeed.

Cheers,

Jorge Serrano-Cobos

Jorge, thanks very much; I wish my Spanish was better, as I'd love to read your full paper...

Wow, I am really geeked by Jorge's use of the scientific method. And I'm happy to learn of an example where search analysis led to better links on the site, in turn changing the need to search.

But, and forgive me for trotting out this old chestnut, but at www.msu.edu we found that no matter what we did, local searches for "campus map" remained popular. We put above the fold the words "campus map" and a picture of a map and other terms, and it had virtually no effect on the number of searches.

Then we put the map below the 1024 X 768 fold, and, lo and behold, searches for "campus map" didn't change much.

You can explain this in part because there is a search box on every page of our site, and most leaf pages don't have links to the campus map.

But you can also take to heart Nielsen's observation that 50% will search no matter what your carefully-crafted nav offers.

My strong "take away" is that your search and your browse views both need to lead people to the place they need to be.

Search and nav inter-relate: bad nav leads to searches, and bad searches lead to nav. The goal should be a usable and useful experience, whether your site visitor is a browser or a searcher.

Muchas gracias, Jorge...

More than welcome, and as you can see in this thread of SIGIA-L, Jared Spool gives you more interesting numbers on the issue:

The initial thread, started by Eric Scheid: http://www.info-arch.org/lists/sigia-l/0603/0405.html

and Jared´s comments:
-http://www.info-arch.org/lists/sigia-l/0603/0482.html

-http://www.info-arch.org/lists/sigia-l/0603/0482.html

Cheers, Jorge

Post a comment

We’ve enabled comment moderation on Rosenfeld Media. Upon posting your comment, it will not immediately appear on this page. Hang tight, we’ll be sure to screen it before too long. (Starred fields are required)

Within This Book's Site: