In 2002, internet researchers just wanted a better search engine, and preferably one that was open-sourced. That was when Doug Cutting and Mike Cafarella decided to give them what they wanted, and they called their project “Nutch.” Hadoop was originally designed as part of the Nutch infrastructure, and was presented in the year 2005. The […]
Deep Learning Demystified
The “deep” in deep learning refers to the number of hidden layers involved in the design. Deep learning is a way of training artificial intelligence (AI) to recognize specific data, such as speech or faces, and to make predictions based on previous experiences. Unlike machine learning, which organizes and sends data through predefined algorithms, deep […]
Working with Metadata Management Frameworks
Metadata Management will grow into 2021 and beyond. According to a DATAVERSITY® Trends in Data Management Report, 84 percent of business respondents had a Metadata Management initiative in place or had plans for one. MarketWatch, a consulting firm, expects massive growth by 2026. How much success a company will have with Metadata Management will depend […]
A Brief History of Microservices
The history and origins of microservices are a continuing effort to provide better communication between different platforms, greater simplicity, and more user-friendly systems. Microservices are typically thought of as a software development technique which organizes an application as a group of loosely coupled services. It is, however, any kind of small service which interacts with […]
Managing Data Governance Throughout the Data Lifecycle
Companies rely on Data Governance, the formal Data Management of people, technology, and practices, to balance data risks and opportunities. Managing Data Governance takes on even more importance across the data lifecycle, from data planning to data disposal, as shown in the diagram below Organizations tend to neglect more comprehensive Data Governance throughout the lifecycle. […]
Re-imagining the Business with Artificial Intelligence
Artificial Intelligence (AI) will be a strategic capability and competitive advantage, no doubt. Statistics speak to that point. According to AI startup advisor Steve Ardire during his presentation (co-presented with Mico Yuk) at the DATAVERSITY® Enterprise Data World Conference titled “Why Enterprise Organizations Use AI as a Strategic Capability and Competitive Advantage,”AI is expected to […]
Citizen Data Scientists: Where Do They Belong?
The phenomenal growth of data technology in recent years has led to the rise of the citizen data scientists (CDS). Developments in augmented analytics and artificial intelligence (AI) automation have now made it possible for ordinary business employees to conduct advanced analytics or business intelligence (BI) which would have required expert knowledge even some years […]
ETL vs. Data Preparation
Extract, Transform, and Load (ETL) technologies, managed exclusively by IT, have until recently been the primary tool used to combine data from multiple sources and thus provide the ability to drive important business decision making for organizations. But, with the advent of self-service data preparation, business users and subject matter experts (SMEs) can find those […]
Fundamentals of Self-Service Business Intelligence
It’s clear that there is considerable recent market movement towards self-service business intelligence (SSBI) in the numerous vendor offerings available. There is also a growing concern among the Data Science community that ordinary business users may misunderstand or misinterpret the available data, leading to incorrect results. Experienced data scientists have a tremendous ability to analyze, […]
So You Want to be a Machine Learning Engineer?
Ideally, a machine learning engineer would have both the skills of a software engineer and the experience of a data scientist and data engineer. However, data scientists and software engineers usually come from very different backgrounds, and data scientists should not be expected to be great programmers, nor should software engineers be expected to provide […]