by Angela Guess
Adrian Bridgwater recently wrote in Forbes, “Today we know that data science isn’t just for data scientists. At least that’s the trend we are seeing radiate upwards from our increasing business-centric approach to the Internet of Things, big data analytics and machine learning. The new data-aware boardroom even sees CEOs and CFOs asking the IT function about ‘data health’. Look at the ‘agenda tracks’ in your average world futurist or society-development conference, it is not unusual to see sessions dedicated to Artificial Intelligence, robotics and data learning. Businesspeople want to know how well their firm is processing its data, even if they don’t want to know ALL the mechanics behind the tools in hand. After all, many of the most functional technologies in this space are pieces of automation software i.e. tools than can be applied to apply machine-based ‘wrangling’ on all types of large, complex data.”
Bridgwater goes on, “This approach to disparate data analysis in some ways describes the methodology being applied ClearStory Data. The firm talks about so-called data inference and has somewhat synthetically even trademarked the term Intelligent Data Harmonization. At the risk of acronym-overload, what we also find here is a piece of technology called Infinite Data Overlap Detection (internally code-named IDOD). This is a Spark-based analytics product that claims to be able to detect and infer data patterns and customer-specific data types for all values for all data types in every source that a user connects to as part of an analysis.”
photo credit: Flickr