You never know what’s going to happen when you click on a LinkedIn job posting button. I’m always on the lookout for interesting and impactful projects, and one in particular caught my attention: “Far North Enterprises, a global fabrication and distribution establishment, is looking to modernize a very old data environment.” I clicked the button […]
Bridging the Gap: Harmonizing RDBMS with Data Warehousing for Scalability
As businesses grow, so does the complexity of managing and analyzing data. Traditionally, relational database management systems (RDBMS) have been the backbone of data storage, offering robust and reliable transactional capabilities. However, as data volumes increase, traditional RDBMS solutions start to hit their limits, causing performance issues that affect overall operations. The need to scale […]
The Post-Modern Data Stack: Unleash the Power of Foundational Models
Imagine you are assigned to extract sales insights from your data. Along with troves of corporate financials together with other market trends, you are also given access to hours of audio and video files of actual sales representatives speaking with customers. How do you process this in Spark? Or, consider another scenario where you work […]
How AI Is Changing SQL for the Better
Structured query language (SQL) is one of the most popular programming languages, with nearly 52% of programmers using it in their work. SQL has outlasted many other programming languages due to its stability and reliability. SQL doesn’t change dramatically from version to version, and that consistency, combined with a logical design that allows it to deliver […]
The Hidden Pitfalls of Cloud-Based Managed MySQL Services
Cloud-based managed MySQL data services are being aggressively marketed to organizations with the promise of streamlining their database management. These “managed data services” are an alternative to more traditional “non-managed data services” – software solutions with embedded intelligent proxies and cluster management using native MySQL run on-premises, in the cloud, or a hybrid cloud. These […]
Data Management in an Industrial Environment
Industrial environments are rich data sources, from equipment pressure and temperature readings to real-time inventory levels. This ocean of data provides organizations with valuable insights when (and if) effectively harnessed. By transforming raw data generated across the floor 24/7 into actionable intelligence, industrial plants are equipped with data-informed insights necessary to create operational strategies that […]
Generative AI and Data: Using Knowledge Graphs and RAG Together
Generative AI has huge potential, but it also faces problems. If generative AI creates information that is not factually accurate in response to a user request – resulting in so-called hallucinations – it can have a big impact on users. Relying on large language model (LLM) training data on its own is not enough to prevent […]
How a Neuro-Symbolic AI Approach Can Improve Trust in AI Apps
As a cognitive scientist, I’ve been immersed in AI for more than 30 years – specifically in speech and natural language understanding, as well as machine-based learning and rule-based decision-making. Progress in our field is always uneven, unfolding in fits and starts. Those of us in the AI field have witnessed multiple “AI winters” over the […]
Running Generative AI in Production – What Issues Will You Find?
As your data projects evolve, you will face new challenges. For new technology like generative AI, some challenges may just be variations on traditional IT projects like considering availability or distributed computing deployment problems. However, generative AI projects are also going through what Donald Rumsfeld once called the “unknown unknowns” phase, where we are discovering […]
Microservices and AWS RDS Instances: Revolutionizing Application Development
In today’s fast-paced digital landscape, the demand for flexible, scalable, and independent application deployment is more critical than ever. Microservices architecture has emerged as a game-changer in how developers build and manage applications, allowing for the decomposition of traditional monolithic systems into independently deployable services. Coupled with the power of Amazon Web Services (AWS) Relational […]