Complex data models have now become the norm. A single stream of the data can travel through many hubs, and many different technologies. It may travel through the front end, the APIs, the Kafka pub/sub systems, Lambda functions, ETLs, data lakes, data warehouses, and more. Riding within this stream of data is the schema, and […]
Business Intelligence Meets Metadata Challenges
Many BI managers, CEOs, and CIOs cannot afford to add more staff, so they are seeking technologies that can help their existing teams operate more accurately and efficiently. They “need to change the physics, as we call it. They can’t just add more people to the team,” said Amnon Drori in a recent DATAVERSITY® interview. […]
Data Chef ETL Battles: WebLog Data for Clickstream Analysis
Click to learn more about co-author Maarit Widmann. Click to learn more about co-author Anna Martin. Click to learn more about co-author Rosaria Silipo. Do you remember the Iron Chef battles? It was a televised series of cook-offs in which famous chefs rolled up their sleeves to compete in making the perfect dish. Based on a […]
Now is the Time: Perspectives on the Challenges and Value of Metadata
Click to learn more about author David Schott In the era of publishing’s emergent global digital marketplace, many organizations are struggling with strategic questions about how to change their approach, planning, and execution around creating and managing their metadata. In the traditional publishing world, a significant portion of the metadata created and stored was on […]
Truth Before Meaning with Data and Analytics
Click to learn more about author Scott Taylor. There is data and there is analytics. They work together. They need each other. These two things are linked, but it helps to think of them separately. From my perspective data is about determining the truth. Analytics is about deriving meaning. I would suggest that most data experts already […]
The Chief Data Officer and the Chief Digital Officer: Work Together, Not Apart
Data vs. digital: That’s a big tension within many organizations. Chief Data Officer s and Chief Digital Officers don’t always agree about some important things, said Joe Caserta, president of consulting firm Caserta, during his DATAVERSITY® Enterprise Data World Conference presentation titled Building a Foundation for Disruption and Advanced Analytics. What’s the disconnect between the […]
Data Versioning Matters to Data Science
Amazon Web Services (AWS) recently published a case study about how the Allen Institute for Cell Science — which was founded by Microsoft’s Paul Allen to research how the human brain works in health and disease — is taking new steps to make its data and metadata easy to access, search, and redistribute for internal […]
erwin Unveils New Version of Flagship Data Modeling Solution
According to a new press release, “erwin, the data governance company, today released a new version of erwin Data Modeler (erwin DM), the world’s No. 1 data modeling software for designing, deploying and understanding data sources to meet modern business needs. This is the first in a series of new products the company will announce […]
Metadata Management Drives the Future of Data Management
Metadata Management makes a huge difference in finding critical data and helps enterprises not get lost within millions (or billions) of records. Metadata provides context about data, describing the information inside a data set, like a candy wrapper detailing the ingredients of the sweet stuff it encloses. This kind of data about data drives a […]
Predictions for 2020: How the Edge, AI Workloads and Object Storage are Set to Proliferate
Click to learn more about author Jon Toor. As 2019 winds down, 2020 is winding up all the way to edge – edge computing of course – the next frontier in the enterprise storage industry. As data storage balloons to the exabyte level for many enterprises, ways of managing storage are going to change drastically […]