As AI continues to drive innovations in customer experiences, the need for better data management systems has become more evident. One such system, vector databases, is gaining traction as a key enabler of generative AI in industries like travel. These databases are specifically designed to store and process high-dimensional data in the form of vectors, […]
Data Modeling in Machine Learning Pipelines: Best Practices Using SQL and NoSQL Databases
Data, undoubtedly, is one of the most significant components making up a machine learning (ML) workflow, and due to this, data management is one of the most important factors in sustaining ML pipelines. An appropriate data model allows the respective data to be accessible all day long, operate at peak efficiency, and be adjusted to […]
Mind the Gap: Architecting Santa’s List – The Naughty-Nice Database
You never know what’s going to happen when you click on a LinkedIn job posting button. I’m always on the lookout for interesting and impactful projects, and one in particular caught my attention: “Far North Enterprises, a global fabrication and distribution establishment, is looking to modernize a very old data environment.” I clicked the button […]
Bridging the Gap: Harmonizing RDBMS with Data Warehousing for Scalability
As businesses grow, so does the complexity of managing and analyzing data. Traditionally, relational database management systems (RDBMS) have been the backbone of data storage, offering robust and reliable transactional capabilities. However, as data volumes increase, traditional RDBMS solutions start to hit their limits, causing performance issues that affect overall operations. The need to scale […]
The Post-Modern Data Stack: Unleash the Power of Foundational Models
Imagine you are assigned to extract sales insights from your data. Along with troves of corporate financials together with other market trends, you are also given access to hours of audio and video files of actual sales representatives speaking with customers. How do you process this in Spark? Or, consider another scenario where you work […]
How AI Is Changing SQL for the Better
Structured query language (SQL) is one of the most popular programming languages, with nearly 52% of programmers using it in their work. SQL has outlasted many other programming languages due to its stability and reliability. SQL doesn’t change dramatically from version to version, and that consistency, combined with a logical design that allows it to deliver […]
The Hidden Pitfalls of Cloud-Based Managed MySQL Services
Cloud-based managed MySQL data services are being aggressively marketed to organizations with the promise of streamlining their database management. These “managed data services” are an alternative to more traditional “non-managed data services” – software solutions with embedded intelligent proxies and cluster management using native MySQL run on-premises, in the cloud, or a hybrid cloud. These […]
Data Management in an Industrial Environment
Industrial environments are rich data sources, from equipment pressure and temperature readings to real-time inventory levels. This ocean of data provides organizations with valuable insights when (and if) effectively harnessed. By transforming raw data generated across the floor 24/7 into actionable intelligence, industrial plants are equipped with data-informed insights necessary to create operational strategies that […]
Generative AI and Data: Using Knowledge Graphs and RAG Together
Generative AI has huge potential, but it also faces problems. If generative AI creates information that is not factually accurate in response to a user request – resulting in so-called hallucinations – it can have a big impact on users. Relying on large language model (LLM) training data on its own is not enough to prevent […]
How a Neuro-Symbolic AI Approach Can Improve Trust in AI Apps
As a cognitive scientist, I’ve been immersed in AI for more than 30 years – specifically in speech and natural language understanding, as well as machine-based learning and rule-based decision-making. Progress in our field is always uneven, unfolding in fits and starts. Those of us in the AI field have witnessed multiple “AI winters” over the […]