Boosting Your Return On Your Human Capital investment: Given that the sole differentiator for most companies today is customer service, staff must be any organisation’s
SCA judgment stops lawyers flocking to CCMA: The Labour Relations Act allows legal representation at CCMA. However, the CCMA rules limit such representation in
The broadcasters’ skills gap – too much IT, not enough media: Convergence has revolutionised the ICT space, enabling new technologies to be offered more affordably over IP, and
Leveraging knowledge for a competitive edge:  What are value added services and how can smart retailers can use this to thrive in a
Car Dealers have multiple car sites at their disposal…which one is right for you?: The digital revolution has meant that numerous online publishing companies are building trader platforms that allow dealers
The Rise of the Millennial Consumer: The world is in a constant state of change. Now more than ever before. Daily if not
Ethics in the Workplace: Whenever we think of ‘ethics in the workplace’, we inevitably think of all the things we could
A+ A A-

The unbearable truthiness of analytics

Rate this item
(0 votes)
The unbearable truthiness of analytics

Decision support, or business intelligence (BI), has been a major driver for CIOs for many years. The current focus on "big data" and social media analytics is a logical extension of inward facing analysis capability to allow decision making and using the wealth of information available on the web.

Most BI sales, and projects, are delivered on the premise that any decision is better than no decision. Decision makers need information in order to make a decision and it is crucial to look for not only BI tools to assist with contextualising information but also advise and services to maximise the most out of the tool, including big data.  Big data’s three dimensions – volume, velocity and variety – represent an extreme view of the challenges faced in any data analytics project.  The question is: How do we consolidate multiple data sources, with varying levels of quality, and deliver analysis that is timely and relevant?

Analytics projects are tricky to say the least. The CEO needs his report out within an hour but the data quality means that the numbers cannot be generated. So IT works around the problem – maybe they ignore the records that do not hold information in the right format, or they substitute invalid values with valid ones.

More than often, the data is ‘fudged’.  The inputs are manipulated so that the outputs we need can be generated while they are still relevant. The problem is not that this is done purposely but is rather a necessary evil and by product of working in an imperfect world.  Most of the time, it will not have a significant impact on decision making, except when it does.

Decisions need to be based on an evaluation of the ‘best information available’. It is when poor information is presented as good information that the waters get muddy. Are business decisions being made based on truth, or based on truthiness?

According to Stephen Colbert, "Truthiness is what you want the facts to be, as opposed to what the facts are. What feels like the right answer, as opposed to what reality will support."

If information has been significantly manipulated to provide a report surely the decision maker deserves to understand this. What is the level of confidence in the underlying data? Was key information missing, or did it vary widely and inconsistently from the previous quarters numbers? Could this have been an error in translation or amalgamation?

Legislation and regulations such as King III, the Basel Accords and the Solvency and Asset Management regime all recognise that key indicators such as financial forecasts or risk models can only be accurate within the margin of error supported by the underlying data – and seek to ensure that the public is protected against risk by penalising companies and individuals that cannot provide a measure of the quality of the data supporting key public metrics.

Common sense suggests that we need to give our business leaders similar protection by providing an indicator of confidence on all reports linked to the quality of the supporting data. If they need to make a decision based on gut feeling, surely this is better than making a decision based on truthiness?

Gary Allemann

Gary Allemann

Gary Allemann is passionate about Information Communication Technology (ICT) and more specifically data quality, data management and data governance. His introduction to the field of ICT was cemented with the completion of a Bachelor of Science degree (Hons) at Rhodes University which saw him enter the workplace in 1993 where he secured a position at First National Bank as a programmer. In 1996, Gary moved on to Dimension Data where he began to be more intimately involved with master data management as a Dimension Data CRM specialist. In 2001, Gary moved onto ILC Lerumo, a company that provides asset management and logistics consulting services to the defence and manufacturing industries, as a sales and marketing manager. In 2003, armed with 10 years’ experience, Gary formed Master Data Management, a business that provides specialist solutions for data governance, data quality, data integration and MDM. Leveraging the international expertise of its vendors including Harte-Hanks Trillium Software and Global Data Excellence, MDM has provided solutions for a range of clients in financial services, government, mining and telecommunications.


Latest from Gary Allemann

Login to post comments

The SA Leader Magazine

Cover sml

In the October issue

On leadership: Your next 10 moves; think carefully!

Ethics in the workplace

The broadcasters’ skills gap – too much IT, not enough media

Boosting Your Return On Your Human Capital investment


Copyright © 2013 gdmc (Geoffrey Dean Marketing Corporation cc). All rights reserved. Material may not be published or reproduced in any form without prior written permission. Use of this site constitutes acceptance of our Terms & Conditions and Privacy Policy. External links are provided for reference purposes. is not responsible for the content of external Internet sites.

Login or Subscribe