The process of Data Modeling is playing an increasingly important role when creating or improving a Data Governance program. Data Governance has become extremely complex, and the use of Data Modeling promotes understanding. One basic reason for the increasing complexity is the expanding use of data analytics for purposes of research. Another reason is complying […]
2023: Mitigating Data Debt by Knowing or by Guessing?
One of the newer data buzzwords is “data debt.” Actually, it is approximately 10 years old, and it became popular ever since agile people realized that postponing things creates not only technical debt, but certainly also data debt. Will we, in 2023, be better at not creating so much data debt, and will it be […]
Types of Data Models and Their Uses
Businesses can benefit from Data Modeling in a variety of important ways. Data models serve two primary purposes. They can be designed to represent the organization’s current data system, providing an understanding of how the data flows through an organization, or be developed to show a new desired data system. The model can be used […]
2022 DATAVERSITY Top 20
Every December, we here at DATAVERSITY set aside time to dig through our data and reflect on the hits and misses of the year. We want to know: Which content did you, our data-loving readers, consume and enjoy the most? Which Data Management topics and experts helped you learn valuable new skills, succeed at your […]
Data Modeling Trends in 2023: A Refresh
Data Modeling, the practice of diagramming Data Architecture and aligning core business rules with data definitions, will go through a refresh in 2023. Organizations will assess and make over their data fabrics, which describe distributed Data Management systems. Furthermore, managers and project teams will use data models to optimize business processes with their data assets and allocate resources to achieve […]
It’s All About Relations!
The new ISO 39075 Graph Query Language Standard is to hit the data streets in late 2023 (?). Then what? If graph databases are standardized pretty soon, what will happen to SQL? They will very likely stay around for a long time. Not simply because legacy SQL has a tremendous inertia, but because relational database paradigms […]
The Data Engineer’s Roadmap
Data engineering is a fascinating and fulfilling career – you are at the helm of every business operation that requires data, and as long as users generate data, businesses will always need data engineers. In other words, job security is guaranteed. But, with such great power comes great responsibility. The journey to becoming a successful data engineer […]
A Guide to Time Series Databases
Time series databases (or TSDBs) are databases that have been optimized for processing time series data. Time series data is made up of data records that are indexed using timestamps. The timestamps provide a reference for each of the data records and show how they relate to one another in time. An example of time […]
A Primer to Optimizing Your Apache Cassandra Compaction Strategy
When setting up an Apache Cassandra table schema and anticipating how you’ll use the table, it’s a best practice to simultaneously formulate a thoughtful compaction strategy. While a Cassandra table’s compaction strategy can be adjusted after its creation, doing so invites costly cluster performance penalties because Cassandra will need to rewrite all of that table’s data. Taking […]
Data Modeling 101
Data Modeling creates a visual representation of a data system as a whole or as parts of it. The goal is to communicate the kinds of data being used and saved within the system. A data model should also show the data’s relationships, how the data can be organized, and the formats used. A data model can […]