Data preparation describes the process of getting data ready for use in analytics. In the past, data preparation was a time-consuming task handled by the IT team, involving “data extraction, transformation and loading (ETL), access to data warehouses and data marts, and lots of complicated massaging and manipulation of data across other data sources,” says […]
What Is DataOps?
DataOps (Data Operations) is collaborative Data Management practices “focused on improving the communication, integration, and automation of data flows” to create predictable delivery and change management of data, data models, and related artifacts. DataOps were created as a better way to develop and deliver analytics, and to aid the data engineers, business uses, analysts, and […]
What Is Natural Language Processing (NLP)?
Natural language processing (NLP) describes a branch of artificial intelligence (AI) that automates language recognition and generation so that computers and humans can communicate seamlessly. To interact with humans, computers must be adept at and understand syntax (grammar), semantics (word meaning), morphology (tense), and pragmatics (conversation). These tasks have proven quite complex. Natural language processing […]
Data Management and the Internet of Things
Billions of things with sensors surround people and their lives. These Internet of Things (IoT) interact with people, homes, factories, workplaces, cities, farms, and vehicles. Gartner predicts that by 2021, IoT technology will be in 95 percent of electronics for new product designs, from wearables to medical devices and beyond. IoT promises useful information, allowing […]
Demystifying Master Data Management
Thomas Edison may have understood the importance of Master Data Management before the term was formally coined. He said, “The value of an idea lies in the using of it.” While ideas in the early 20th century relied on thoughts and things, ideas in this information age depend on data. Take reference data: unchanging tags […]
What Is Data Wrangling?
Data wrangling, also known as data mungling, shapes data, found in different formats, restructuring it to provide business value. Companies implement a variety of data systems to guide business decisions and solve problems to optimize a situation. Over time business context evolves, with newer technologies, additional data sources, updated regulations, and different stakeholder requirements. This […]
What Is Self-Service Analytics?
Self-service analytics describes the use of technology by subject-matter experts to get relevant information without requiring computer coding or substantial information technology support. The purpose of self-service analytics gives business users and stakeholders the capacity to perform day-to-day tasks without “getting involved in a more critical data process.” Characteristics of self-service analytics include the abilities […]
What Is a Data Democracy?
A data democracy describes a methodological framework of values and actions that benefit and minimize any harm to the public or the typical user. Organizations like Data for Democracy, initiated by Bloomberg and BrightHive, and projects like Data for Democracy, established by the University of Washington to help Myanmar transition to a data democracy, are spearheading […]
What Is Reference Data?
Reference data (a.k.a. as master data, or golden copy, or single source of truth [SSOT] ) describes the set of data an organization needs for daily operations. According to the DAMA-DMBoK2, reference data characterizes or classifies or relates to other data or information external to the organization. It describes the core entities of the business […]
Maturing Data Governance and Data Literacy to Serve Organizations Better
Maturing Data Governance means growing an organization’s conception and management of its data assets from a narrow IT project conception to the broader business. Organizations can no longer ignore this approach as they drive to digitally transform, improve business efficiency and effectiveness through digitization and human resources. Al-Ruithe, et al. hammer this point home by […]