You are currently browsing the tag archive for the ‘big data’ tag.
Our research consistently finds that data issues are a root cause of many problems encountered by modern corporations. One of the main causes of bad data is a lack of data stewardship – too often, nobody is responsible for taking care of data. Fixing inaccurate data is tedious, but creating IT environments that build quality into data is far from glamorous, so these sorts of projects are rarely demanded and funded. The magnitude of the problem grows with the company: Big companies have more data and bigger issues with it than midsize ones. But companies of all sizes ignore this at their peril: Data quality, which includes accuracy, timeliness, relevance and consistency, has a profound impact on the quality of work done, especially in analytics where the value of even brilliantly conceived models is degraded when the data that drives that model is inaccurate, inconsistent or not timely. That’s a key finding of our finance analytics benchmark research.
A main requirement for the data used in analytics is that it be accurate because accuracy affects how well finance analytic processes work. One piece of seemingly good news from the research is that a majority of companies have accurate data with which to work in their finance analytics processes. However, only 11 percent said theirs is very accurate, and there’s a big difference between accurate enough and very accurate. The degree of accuracy is important because it correlates with, among other things, the quality of finance analytics processes and the agility with which organizations can respond to and plan for change.
Although almost all (92%) of the companies that have very accurate data also have a process that works well or very well, that assessment drops to 43 percent of companies that said their data is just accurate. Even in small doses, bad data has an outsized impact on finance analytic processes. Inaccuracies, inconsistencies and not comparable data can seriously gum up the works as analysts search for the source of the issue and then try to resolve it. As issues grow, dissatisfaction with the process increases. Just 22 percent of those with somewhat accurate data and none of the companies with data that is not accurate said their company has a process that works well or very well.
To be truly useful for business, analytics provided to executives, managers and other decision-makers must be fresh. The faster a company can deliver the assessments and insight as to what just happened, the sooner company can respond to those changes. Almost all (85%) companies with very accurate data said they are able to respond immediately or soon enough to changes in business or market conditions, but only 35 percent of those with accurate data and just 24 percent of those with somewhat accurate data are able to do so.
Moreover, having data that is timely enables companies to react in a coordinated fashion as well as quickly. Companies that are able to operate in a coordinated fashion are usually more successful in business than those that are somewhat coordinated in the same way that a juggler who is somewhat coordinated drops a lot of balls. Almost all (86%) companies whose data is all up-to-date said they are able to react to change in a coordinated or very well coordinated fashion, compared to just 38 percent of those whose data is mostly up-to-date and 19 percent that have a significant percentage of stale data. Three-fourths (77%) of companies that have very accurate data are able to respond to changes in a coordinated or very well coordinated fashion, but just one-third (35%) of those with accurate data and 14 percent with somewhat accurate data are able to accomplish this.
Speed is essential in delivering metrics and performance indicators if they are to be useful for strategic decision-making, competitive positioning and assessing performance. Companies that can respond sooner to opportunities and threats are more able to adjust to changing business conditions. The research finds that fewer than half (43%) of companies are able to deliver important metrics and performance indicators within a week of a period’s end – that is, soon enough to respond to an emerging opportunity or threat.
One way to speed up the delivery of analytics is to have analysts focus their time on the analytics. But the research shows that not many do: A majority of analysts spend the biggest chunk of their time dealing with data-related issues rather than on the analysis itself. Two-thirds (68%) of participants reported that they spend the most time dealing with the data used in their analytics – waiting for it, reviewing it for quality and consistency or preparing it for analysis. Only one-fourth (28%) said their efforts focus most on analysis and trying to determine root causes, which are the main reasons for doing the analysis in the first place. In other words, in a majority of companies, analysts don’t spend enough time doing what they are valued and paid for.
The results also show that there are negative knock-on effects of spending time on data-related tasks rather than on analysis. More than half (56%) of the companies that spend the biggest part of their time working on analytics can deliver metrics and indicators within a business week, compared to just one-third (36%) of those that spend the biggest part of the time grappling with data issues. Having high-quality, timely and accessible data therefore is essential to reaping the benefits of finance analytics.
Data issues diminish productivity in every part of a business as people struggle to correct errors or find workarounds. Issues with data are a man-made phenomenon, yet companies seem to treat bad data as a force of nature like a tornado or an earthquake that’s beyond their control to fix. Our benchmark research on information management suggests that inertia in tackling data issues is more organizational than technical. Companies simply do not devote sufficient resources (staff and budget) to address this ongoing issue. One reason may be because the people who must confront the data issues in their day-to-day work fail to understand the connection between these and getting the results from analytics that they should.
Excellent data quality is the result of building quality controls into data management processes. Our research finds a strong correlation between the degree of data quality efforts in finance analytics and the quality of the finance department’s analytic processes and output, and ultimately its timeliness and its value to the company. Corporations generally – and finance organizations in particular – must pay closer attention to the reliability of the data they use in their analytics. The investment in having better data will pay off in better analytics.
Robert Kugel – SVP Research
Business computing has undergone a quiet revolution over the past two decades. As a result of having added, one-by-one, applications that automate all sorts of business processes, organizations now collect data from a wider and deeper array of sources than ever before. Advances in the tools for analyzing and reporting the data from such systems have made it possible to assess financial performance, process quality, operational status, risk and even governance and compliance in every aspect of a business. Against this background, however, our recently released benchmark research finds that finance organizations are slow to make use of the broader range of data and apply advanced analytics to it.
Analytics has long been a tool used by Finance. Yet because analytical techniques for assessing balance sheets, income statements and cash-flow statements are well developed and widely accepted, finance professionals have had little incentive to do more even as the opportunities available to them have proliferated. Taking a narrow of finance analytics they have largely failed to take advantage of advanced analytics to address the full needs of today’s enterprise and thus to increase their own value to it.
It’s not that finance departments aren’t aware of their shortcomings. For instance, more than half (58%) of participants in this research said that significant or major changes to their process for creating finance analytics are necessary; only 7 percent said no improvements are needed. We found four main reasons for dissatisfaction with their process: it’s too slow; it isn’t adaptable to change; there aren’t enough skilled people to do this work; and data used in it is inaccessible or too difficult to integrate.
Usually, addressing some business issue requires dealing with a combination of the underlying people, processes, information and technology. Companies often fail to address the issue successfully because they focus on just one of these elements. We think it’s important to use the people, process, information and technology framework to isolate the root causes behind the issues. Let’s look at the role of technology – mainly software – in finance analytics.
Our research finds many companies have trouble with the technology aspects. Only 12 percent of organizations are satisfied with the software they use to create and apply analytics; more than twice as many (27%) are not satisfied. That’s probably because 71 percent of them use spreadsheets for analytics, a higher percentage than for any other tool. Two-thirds of these users said that reliance on spreadsheets makes it difficult to produce accurate and timely analytics. In contrast, fewer than half use innovative techniques such as predictive analytics (44%) to assist planning and forecasting, and just 20 percent are employing big data to process the flood of data into today’s businesses.
The research demonstrates a correlation between the technology a company uses and how well its finance analytics processes work. Two-thirds of participants who said their software works well or very well also said their finance analytics process needs little or no improvement. By comparison, just one in four of those that said significant changes must be made to the software they use have a process that needs little or no improvement.
Here again we find that the inappropriate use of spreadsheets is an issue. When asked whether spreadsheets cause problems in their use of analytics, 67 percent said yes. This is because desktop spreadsheets have inherent shortcomings that make them poorly suited for any sort of advanced analytics. In particular, they cannot readily manage analyses involving more than a handful of dimensions. (A dimension is some aspect of business data such as time, business divisions, product families, sales territories and currency.) Many of these dimensions are constructed in hierarchies: Branches roll up into territories which roll up into divisions of companies, for example. Analyzing data usually requires viewing the data from different perspectives (which translates into dimensions) to isolate an issue or opportunity. One such would be looking at sales by product family and region and then drilling down into specific branches or stock-keeping units (SKUs). In doing analysis, it’s difficult enough to manage the dimensions of the purely financial aspects of a business. Spreadsheets are especially ill-suited to analyzing operational and financial data together, such as the delivery method or product configuration details.
Our research data shows that not having the right technology is impedes finance departments’ ability to create and use more advanced analytics. We found several reasons why companies decide not to make these technology investments. The top three are a lack of resources, no budget and a business case that’s not strong enough. The first two may be valid reasons, but not wanting to commit resources and budget to advanced analytics could be a symptom of a poorly constructed business case, as I noted earlier. A lack of leadership and vision on the part of senior finance executives also plays a role. Many may say they want their department to play a more strategic role in running their company yet fail to follow through to adopt new methods and the necessary supporting technology.
But now a new generation of finance department leaders is emerging. These are people young enough to have grown up with technology and to be more demanding in their use of software and systems to produce results. The time is ripe for change, and it’s up them to drive finance departments to be more strategic in their use of analytics.
Robert Kugel – SVP Research