As companies look for ways to use their data to find new opportunities, the importance of real-time insights is growing. But many companies still rely on older, slower approaches to Data Management that struggle to keep up with the pace of business today. Companies know they need better ways to manage data without slowing down […]
The Future of Data Management: Five Predictions for 2022
As many have said, data is everything and everything is data. And the fact remains that the highest-value data sits in transactional databases behind applications like ERP, CRM, etc. To get the most out of data, it must be consolidated from many systems to unlock valuable business insights and feed applications such as machine learning […]
The Declarative Approach in a Data Playground
Click to learn more about author Michele Iurillo. One of the most fascinating things I’ve found at my current organization is undoubtedly the declarative approach. It is something so simple and so powerful. In my first business intelligence endeavors, there were data normalization issues; in my Data Governance period, Data Quality and proactive Metadata Management were the critical points. But […]
Virtualize or Replicate? Accessing Your Data in Hybrid Cloud Architecture
Click here to learn more about Joe deBuzna. The term “hybrid cloud” has no single definition. When it was first used, it typically meant a combination of a private and public cloud. Since then, the term has taken on a broader meaning, including (public) cloud offerings from multiple vendors. For this post, I’m using Gartner’s […]
Seven Major Benefits of Using Log-Based CDC for Data Replication: A Use Case
Click here to learn more about Joe deBuzna. In this blog, we will talk about what a global water company achieved with real-time data replication. The world’s water resources are stretched beyond all previous limits, and the toughest industrial water process challenges still lay ahead. One global water technologies and solutions company (which I’ll refer […]
Trusting Data Delivery: What to Look for in a Data Validation Solution for Replication
Click here to learn more about Joe deBuzna. Many of us have experienced moving to a new home or city. And in any moving process, it’s common to end up with missing valuables or broken items that leave you wondering if you should have packed better, picked a different moving company, or just thought through […]
StreamSets Expands Databricks Partnership With New Connector for Delta Lake
A new press release reports, “StreamSets®, provider of the industry’s first DataOps platform, today announced an expansion of its partnership with Databricks by participating in Databricks’ newly launched Data Ingestion Network. As part of the expanded partnership, StreamSets is offering additional functionality with a new connector for Delta Lake, an open source project that provides […]
Using CDC to Power Real-time Analytics
Click here to learn more about author Joe DeBuzna. Snowflake is the first data warehouse and analytics service to be built for the cloud. Since Snowflake’s introduction in 2012, companies have flocked to it in order to minimize costs and simplify implementation and management of their data warehouse infrastructure. With Snowflake’s cloud-native architecture, organizations no […]
Four Methods of Change Data Capture
Click to learn more about author Joe deBuzna. As its name suggests, Change Data Capture (CDC) techniques are used to identify changes. CDC can be the basis to synchronize another system with the same incremental changes, or to store an audit trail of changes. The audit trail may subsequently be used for other uses e.g. to update a […]
A Glimpse into the Future of Modern Data Architectures with DataOps at its Core
Click to learn more about author Itamar Ankorion. Enterprises are building out modern Data Architectures to accommodate new analytic requirements, larger data volumes and take advantage of newer technologies such as cloud, data lakes and data streaming. These platforms make it possible to support digital transformation with modern analytics, delivering new services empowered by data […]