Complex data models have now become the norm. A single stream of the data can travel through many hubs, and many different technologies. It may travel through the front end, the APIs, the Kafka pub/sub systems, Lambda functions, ETLs, data lakes, data warehouses, and more. Riding within this stream of data is the schema, and […]
Decoded Data Lineage Helps Tackle Bad Data Quality
What are your outcome expectations of data lineage? No one’s just doing it for fun, after all. Generally speaking, data lineage is a major asset for: Regulatory reporting/governance; trust in decision-making; and, on-premise to cloud migrations. Data lineage tools track business data flow from originating source through all the steps in its lifecycle to destination. […]
The Conceptual Model Strikes Back!
“You must unlearn what you have learned” (Master Yoda) The “conceptual” level of Data Modeling has been a stepchild for many years and is mostly forgotten in fast-paced delivery projects today. Since the mid-nineties the legacy toolbox basically offered software-engineering inspired diagramming tools, and they did not communicate well on the business level. Fortunately, a […]
Data Architect vs. Data Modeler vs. Data Engineer
Michael Bowers, author and Chief Data Architect at FairCom Corporation, initially set out to research three careers in his presentation titled Data Architect vs. Data Modeler vs. Data Engineer for the DATAVERSITY® Data Architecture Online 2019 Conference. The process brought him to a wealth of information he would have appreciated much earlier in his career, […]
Data Architects, It’s Time to Improve Your Data Classification
Team Data — data architects in particular, whatever their official title may be — have a job to do. That is to take more aggressive steps to protect data assets on behalf of customers and constituents. The responsibility falls to data architects because few in most organizations are thinking about protecting data from the data […]
Data Modeling Trends in 2020: A Year of Optimization
This next year demands quicker data-driven decisions, better automation, more integration, and more data, requiring optimized Data Modeling. Data Modeling refers to documentation describing core business rules and definitions around data. Business and technical shareholders benefit from Data Modeling by seeing complex data concepts in an intuitive, visual way. Throughout 2020, Data Modeling will need […]
2019 DATAVERSITY Top 20
It is once again time to look back and evaluate the struggles and successes of the previous year and then build those lessons into the year to come. Part of how we do that here at DATAVERSITY is to look at the content consumed by the community over the year and evaluate what was hot […]
Semantic Web and Semantic Technology Trends in 2020
One way or another, it’s all about graphs. And machine learning. And AI. And what their connections to each other are. Welcome to the world of semantic technology in 2020. The year ahead largely picks up the pace on what industry experts predicted would happen in 2019. Graph technologies have finally become mainstream, says Andreas […]
Enterprise Architects are More Than Just Modelers
New opportunities are emerging for enterprise architects (EAs). EAs will work in conjunction with technology innovation leaders to help their organizations select, create, and implement the right business- and technology-based platforms to support their business ecosystems. “By 2021, 40 percent of organizations will use enterprise architecture to help ideate new business innovations made possible by […]
Ride the Data Governance 2.0 Wave
Companies were engaged in Data Governance practices such as Data Lineage and Data Quality for years before the concept of Data Governance emerged as a mainstream enterprise-level activity in 2005, said Kelle O’Neal, the founder and CEO of First San Francisco Partners, during her DATAVERSITY® Enterprise Data Governance Online event presentation titled Data Governance 2.0. […]