There’s a movement underway to capture an increasing amount of data about employees – from facial recognition or fingerprint systems used for tracking time and attendance, to systems that monitor your every keystroke. All of these invasive data collection technologies raise this question: What should be the limits of biometric data collection in the workplace? […]
Generative AI Is Accelerating Data Pipeline Management
Data pipelines are like insurance. You only know they exist when something goes wrong. ETL processes are constantly toiling away behind the scenes, doing heavy lifting to connect the sources of data from the real world with the warehouses and lakes that make the data useful. Products like DBT and AirTran demonstrate the repeatability and […]
What Is Active Metadata and Why Does It Matter?
Metadata is like the secret sauce of the internet. You type a word or phrase in a search engine, press enter, and the information you’re looking for appears (usually). An action that once seemed “indistinguishable from magic,” to quote the third of Arthur C. Clarke’s three laws, is now as commonplace as heating up leftovers in […]
Choosing a Data Quality Tool: What, Why, How
Data-driven organizations are in a race to collect the information that modern analytics techniques rely on to generate insights and guide business decisions. The ever-growing flow of data into business systems challenges companies to devise new techniques for ensuring the quality of the data as its quantity skyrockets. Data quality tool vendors are rising to […]
Embracing Data and Emerging Technologies for Quality Management Excellence
In today’s rapidly evolving business landscape, the role of quality management (QM) is undergoing a significant transformation. No longer just a compliance checkbox, QM is emerging as a strategic asset that can drive continuous improvement and operational excellence. This shift is largely propelled by the adoption of intelligent technologies and the strategic use of data, […]
A Brief History of Data Ethics
In this digital age, where data is an increasingly integral asset for every organization, the ethical implications surrounding data collection, storage, and usage have become prominent. The evolution and history of data ethics is a complex journey that connects technological advancements with societal values and legal frameworks. Understanding this evolution requires examining key historical milestones and the […]
Cutting Hidden Costs: Optimizing Data Management for Financial Efficiency
In the face of rising costs and rapid technological advancements, businesses must streamline their operations to remain competitive. An often overlooked area in these cost-cutting initiatives is data management. While many companies focus on reducing expenses related to infrastructure – such as virtual machines and serverless architectures – data management costs frequently go unchecked until […]
Enterprise Data World 2024 Takeaways: Key Trends in Applying AI to Data Management
I was privileged to deliver a workshop at Enterprise Data World (EDW) 2024. Publishing this review is a way to express my gratitude to the fantastic team at DATAVERSITY and Tony Shaw personally for organizing this prestigious live event. Part 1 of this article considered the key takeaways in data governance, discussed at Enterprise Data World 2024. […]
Six Common Digital Transformation Challenges
During digital transformation, one of the most formidable challenges organizations face is resistance to change and the complexities of effective change management. Human nature often gravitates toward familiarity and routine, making any deviation a source of discomfort. This psychological inertia can stem from various factors including fear of job loss, perceived inadequacy in new skill […]
What Is Data Trust and Why Does It Matter?
A batch processing system fails on the eve of a company’s deadline for monthly reports, threatening the accuracy of its financials. One of the two systems powering the dashboard of a global supply chain company crashes, and a manager overbooks a transport ship because it displays inaccurate data, causing a costly delay in a customer’s […]