The Last Mile of Business Intelligence

“The last mile” is a term that often is applied in the telecom industry in reference to “the final leg of delivering connectivity from a communications provider to a customer.” It is an expensive and complex step due to the challenge of pushing information from centralized, high capacity channels to many diverse end-points where information is ultimately used.

We think there is a “last mile” problem in business intelligence too. This critical bridge between data warehouses and communication of insights to decision-makers is often weak or missing. Your investments and meticulous efforts to create a central infrastructure can become worthless without effective delivery to end-users. “But how about my reporting interface?” you wonder. That’s a creaky and narrow bridge to rely on for the last mile of business intelligence.

Bridge

Listening to our clients, we are confident the last mile is a real problem. The ultimate source of this failure is less clear. Here are a few of theories:

1. The engineers who built the data warehouse build the interface. No offense to the talented individuals who can push around, clean, normalize, and integrate data—but they may not be ideally suited to designing a user interface for non-technical users. A designer wouldn’t create charts that look like this (our favorite example of chart-based encryption):

Chart-based encryption

In the worst case, developers are dismissive of user experience. I’ve met with IT folks who felt confident that providing a massive data table would provide a suitable solution for delivering information to users. “Hey, they’re getting their data. Is there a problem?”

2. Reporting is considered the fundamental mechanism for working with data. Here’s a framework we’ve started to consider in thinking through the multiple approaches for getting value from data:

Last mile triangle

  • Reporting lets you monitor things that are well-understood and relatively predictable.
  • Exporation or analysis helps you understand new processes and erratic and shifting behaviors.
  • Presentation is about communicating insights and understanding, often building on both reporting and analysis.

Many people assume that a reporting tool is sufficient to do in-depth analysis and communicate results. That’s like trying to build a deck with a screwdriver.

3. Poor fundamentals in information display. Despite the efforts of folks like Edward Tufte and Stephen Few, general literacy in this area is still low. Shiny, 3D pie charts are still acceptable, even desirable in some places. Particularly disturbing is the persistence and pervasiveness of this problem in Excel where there still remains some confusion as to why this is bad information display:

Excel data bars

You don’t have to go any further than the Dashboard Spy to find examples of the visual muck that is commonplace.

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

16 comments | Show all comments only the last 5 are shown


November 6, 2007
Zach said:

Jennifer: I'm sorry to hear about our situation. It raises the question: Does a lone, screaming user interface person in the Data Modeler woods make a sound? We'd be happy to lend a sympathetic ear if you want to reach out.

Sanjay: Our experience has been very different from what you describe. We've found it rare that management and tech work so smoothly "in concert." I have yet to see a BI implementation that consistently brings joy and insight to end-users. Furthermore, it seems a stretch to attribute 15+ years of global business growth to the success of these EIS/BI systems. On the other hand, it seems like you have a Harvard Business Review article in you.


November 11, 2007
Sanjay Tamta said:

Zach:

That was funny and your point is well taken. Actually, I think an HBR article may just hit the spot.

Good blog btw.

Sanjay


November 21, 2007
James Taylor said:

Nice post and inspired me to post on something similar over at http://www.edmblog.com/weblog/2007/11/mistakes-in-the.html
JT


May 1, 2008
Mark said:

Good post and you can see similar examples at <a hfre="http://www.dashboardzone.com">Dashboard Zone</a>


June 26, 2008
Sanjay Tamta said:

Zach:

Has your firm done any BI work in the area of Social Network Analysis?

Thx

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment


Add a comment