In the ever-evolving landscape of the modern business world, generative artificial intelligence (GenAI) is taking the industry by storm. Companies increasingly recognize the transformative potential of GenAI and machine learning. To harness the full power of these technologies, it is critical for organizations to embrace cloud computing. Cloud migration is not a mere option but […]
Machine Learning: Challenges and Opportunities for Modern Data Executives
The transformational promise of artificial intelligence (AI) and machine learning (ML) for enterprises has fueled enormous excitement and massive investment by data executives. One estimate predicts that AI’s contribution to the global economy could reach an extraordinary $15.7 trillion by 2030. That’s more than the current combined economic output of China and India. Yet, there seems […]
No Database Is Perfect: Applying CAP Theorem to Database Choice
Since its introduction to the marketplace in 2000, the consistency, availability, and partition theorem, or CAP theorem, has been a guiding principle in database management. Computer scientist Eric Brewer presented the CAP theorem in a talk about distributed systems that provide web services. Two MIT professors later proved the theorem. It states that a database can be […]
Choosing Tools for Data Pipeline Test Automation (Part 1)
Those who want to design universal data pipelines and ETL testing tools face a tough challenge because of the vastness and variety of technologies: Each data pipeline platform embodies a unique philosophy, architectural design, and set of operations. Some platforms are centered around batch processing, while others are centered around real-time streaming. While the nuances […]
Building a Strong Community for Women in Data Management and Governance
In September, I had the privilege of co-hosting a new special interest group (SIG), Women in Data Management and Governance, alongside DATAVERSITY’s Shannon Kempe, at a pre-conference Enterprise Data World (EDW) event. I’m so honored to be part of building this community and to better serve a critical and growing constituency in our industry. Supporting the growth of […]
Managing Missing Data in Analytics
Today, corporate boards and executives understand the importance of data and analytics for improved business performance. However, most of the data in enterprises is of poor quality, hence the majority of the data and analytics fail. To improve the quality of data, more than 80% of the work in data analytics projects is on data […]
Data Governors, First Govern Yourselves
Data Governance, as currently practiced, is failing. There have been some successes, but by and large, even these efforts have fallen short. Worse, many of those tasked with contributing to Data Governance find the effort painful. We have enormous sympathy for data governors. (We use the term “data governors” – DGs – as the most […]
Transforming Data Management with AI-Driven Data Catalogs
In today’s data-driven world, where every byte of information holds untapped potential, effective Data Management has become a central component of successful businesses. The ability to collect and analyze data to gain valuable insights is the basis of informed decision-making, innovation, and competitive advantage. According to recent research by Accenture, only 25% of organizations are […]
The Cool Kids Corner: Data Quality Is Not a Fish You Can Catch
Hello! I’m Mark Horseman, and welcome to The Cool Kids Corner. This is my monthly check-in to share with you the people and ideas I encounter as a data evangelist with DATAVERSITY. (Read last month’s column here.) This month we’re talking about Data Quality (DQ). Data Quality, the phrase “garbage in, garbage out,” dirty data, data […]
5 FinOps Best Practices You Should Not Ignore
FinOps, or Financial Operations, is a relatively new term that has been gaining traction in the business world. It represents a cultural shift in the way organizations manage their finances, especially in the context of cloud computing. FinOps is a collaborative approach that brings together finance, operations, and engineering teams to manage and control cloud […]