Suppose you’re in charge of maintaining a large set of data pipelines from cloud storage or streaming data into a data warehouse. How can you ensure that your data meets expectations after every transformation? That’s where data quality testing comes in. Data testing uses a set of rules to check if the data conforms to […]
Companies Must Have Guardrails in Place When Incorporating Generative AI
At the time of reading this, you’ve likely heard of ChatGPT and/or generative AI and its versatile conversational capabilities. From asking it to draft cohesive blog posts, to generating working computer code, all the way to solving your homework and engaging in discussing world events (as far as they happened before September 2021), it seems […]
How Analysts Leverage Creativity to Gain Powerful Insights from Alternative Data
Creativity is critical to producing superior results in any field, whether it’s the arts, sciences, or technology. The same can be said for alternative data analysis. The most successful data scientists apply creativity by thinking out of the box when analyzing information to solve challenging problems or understand human behavior. From investment decisions to public policy and […]
How Kubernetes Can Help You Weather Regional Disaster Recovery
If you’re lucky, you’ve only had to worry about managing a data disaster recovery effort once or twice in your career, if at all. However, as the rate and number of natural disasters have increased, the chances of needing to navigate through a worst-case scenario have risen. As of April 11, 2023, the U.S. had […]
Why Traditional Threat Prevention Is Insufficient for Insider Threats
Security teams can be so focused on blocking cyberattacks from external actors that they forget the potential threats within their organizations. Verizon reports that insider threats cause almost 20% of all breaches. Insider threats are difficult to defend against using traditional threat prevention measures because insiders inherently require elevated trust and access to get their jobs done. […]
Cloud Architecture Mistakes: The Perils of Poor Security Architecture
In this five-part series, I’m taking a hard look at the common – and costly – mistakes organizations typically make while building a cloud architecture. Part one explained how organizations can quickly lose visibility and control over their data processing, and detailed how to avoid that mistake. Part two looked at why a DIY approach often goes wrong, […]
7 Best Practices for Data Collection in 2023
Digital procedures play an important role in modern business, as they generate lots of valuable information that can be used to improve organizations and advance their goals. Thus, in 2023, website data collection will be a staple for most growing firms in various industries. However, as with any craft, there are bad, good, and better ways to collect website […]
Why Good Data Management Matters Now More Than Ever
In the early days of business analysis and underwriting, data was managed with simply a pen and paper and, of course, Excel spreadsheets. As technology has advanced, databases, warehouses, and data lakes have enabled information to be collected, stored, and managed electronically. But as businesses have rapidly increased the volume, velocity, and variety of data […]
Why Data Privacy, Data Security, and Data Protection Go Hand in Hand
Here’s an important truth: There is no data privacy without data protection. Consumers and companies place their trust in the organizations they do business with and trust that their sensitive data will be kept private. These same organizations want to protect consumer and partner data, to preserve their brand as a trustworthy partner, grow revenues, […]
What Will the Future of the AI and Machine Learning Industry Look Like?
AI applications catering to the mass public are moving towards larger-scale use for enterprises, as big tech companies try to get into this new technology. As the use of AI proliferates in the future, tremendous amounts of computing power from cloud service providers are needed to operate these AI applications and unleash more of their […]