Analytics is a wonderful tool. It gives us real insights into how people are behaving on our site. But we have to use caution because with analytics there is a dark side. Not that kind of dark side. The dark side I’m referring to
is how we report analytics data. So let me give you two pieces of sample data. The first one is a conversion rate. Let’s say that we have a conversion rate of 3% Okay? Now, let’s say the next piece of data we have is average time on page. Let’s say 2 minutes and 10 seconds We have two pieces of data here. And what we have to do is figure out what insights we can draw from this. On the one hand, if we look at conversion data, we are
safe to interpret that that was the intended user action. They submitted their order. They completed the purchase. There’s no wiggle room in what that means. But when we focus on something like
the average time on page, this could be open for interpretation. It could be that someone spent a long time on this page, because they were really engaged with our content, and they read every single word and they loved it. Or, it could actually mean that they didn’t understand anything, that they couldn’t find what they were looking for. Or that the navigation didn’t quite make sense to them. So the first type of data of conversion rate we call this hard data where there’s not this room for interpretation. We know what it means. But, soft data, like average time on page, or something like how far down the user scrolls, or even whether they use search versus navigation when they first get to the site. Those things require further interpretation. We need to complement those pieces of analytics data with extra insights that we can usually get from usability testing. Next time you’re presenting or receiving analytics data, make sure that you’re asking those important questions about whether or not the information is reporting hard data or soft data.