Artificial intelligence (AI) could boost company productivity by 1.5%, increasing S&P 500 profits by 30% over the next 10 years. The rapid success of generative AI technologies such as ChatGPT is an excellent example of how companies can shape their fortunes by harnessing the power of the data they hold. The insights from data enable businesses across […]
Testing and Monitoring Data Pipelines: Part Two
In part one of this article, we discussed how data testing can specifically test a data object (e.g., table, column, metadata) at one particular point in the data pipeline. While this technique is practical for in-database verifications – as tests are embedded directly in their data modeling efforts – it is tedious and time-consuming when end-to-end data […]
Understanding the Importance of Identity and Access Management in Data Protection
Companies today use a range of systems to transfer and store data, perform tasks, and, most importantly, manage their customers and staff members. With so many online and offline factors, good cybersecurity is a must. That’s where identity and access management (IAM) comes in to organize user identities and determine who accesses what. It’s an […]
AI and Privacy: Navigating the Intersection of Technology and Personal Data
The rapid adoption of generative AI in the business world is transforming the way we work and improving our ability to engage with customers, streamline internal processes, and drive cost savings while introducing unprecedented challenges to the protection of individual privacy. As AI technologies continue to evolve and permeate various aspects of our lives, concerns about data […]
Mitigate Real Risks: Create Ethical, Responsible AI
AI is everywhere, and it is growing. In a 2022 edition of an annual global AI survey, a leading consulting firm found that adoption among enterprises had more than doubled in five years, with about 50% of respondents using it in at least one business unit or function. Thirty-two percent of enterprises reported cost savings […]
4 Data Privacy Best Practices
Data privacy is at the heart of every prominent security threat – what are the top best practices for keeping data private? Some of the major cyber security challenges in 2023 are ransomware, hacking of cloud service vendors, and wiper malware. During ransomware attacks, bad actors obtain or encrypt sensitive information. The victims are urged to pay […]
Testing and Monitoring Data Pipelines: Part One
Suppose you’re in charge of maintaining a large set of data pipelines from cloud storage or streaming data into a data warehouse. How can you ensure that your data meets expectations after every transformation? That’s where data quality testing comes in. Data testing uses a set of rules to check if the data conforms to […]
Why Data Privacy, Data Security, and Data Protection Go Hand in Hand
Here’s an important truth: There is no data privacy without data protection. Consumers and companies place their trust in the organizations they do business with and trust that their sensitive data will be kept private. These same organizations want to protect consumer and partner data, to preserve their brand as a trustworthy partner, grow revenues, […]
Why Metadata Is a Critical Asset for Storage and IT Managers
We live in a data-driven economy, but what lies beneath the data is hidden gold. Metadata, or data that describes data, delivers many benefits for storage and IT managers. Yet metadata is complex, vast, and distributed across hybrid cloud infrastructure. Understanding and strategically managing metadata as part of your overall data storage strategy has become central […]
4 Essential Data Management Principles
Data is central to modern businesses. However, most companies fumble their approach to Data Management and fail to draw insights as a result. Data Management might seem like a back-office function, but it is critical to a modern company’s success. Getting started with or fixing your Data Management processes might seem intimidating. Here are four essential Data […]