Tag: Data Quality

June 19, 2023

In part one of this article, we discussed how data testing can specifically test a data object (e.g., table, column, metadata) at one particular point in the data pipeline. While this technique is practical for in-database verifications – as tests […]

June 15, 2023

Business leaders often make corporate decisions in haste, based on data that is neither thoroughly analyzed nor understood. This can pose a serious threat to data-driven decision-making. Additionally, businesses risk losing a competitive edge by not following important business analytics […]

June 13, 2023

Data lineage can be described as a historical map of data’s journey within an organization. Use cases, in general, provide an example of how services or techniques can be used, and data lineage use cases are situations in which a […]

May 31, 2023

Data Governance, a formalized practice that executes and enforces company-wide data policies, has gained significant traction in the last few years. As of 2022, 81.89% of the participants in a DATAVERSITY Trends in Data Management(TDM) survey have either implemented a […]

May 26, 2023

Suppose you’re in charge of maintaining a large set of data pipelines from cloud storage or streaming data into a data warehouse. How can you ensure that your data meets expectations after every transformation? That’s where data quality testing comes […]

May 25, 2023

First came the data analyst, then came the Data Quality specialist. Data analysts require accurate data to develop business intelligence and, unless someone else is cleaning the data, they must also perform this task. It is time-consuming and interferes with […]

May 19, 2023

In the early days of business analysis and underwriting, data was managed with simply a pen and paper and, of course, Excel spreadsheets. As technology has advanced, databases, warehouses, and data lakes have enabled information to be collected, stored, and […]

May 18, 2023

Organizations want Data Governance, a formalized practice that connects different components – roles, processes, communications, metrics, and tools – for its benefits. Company-wide data represents a resource that will “become more valuable than people ever anticipated,” according to David McGraw, […]

May 12, 2023

Data is central to modern businesses. However, most companies fumble their approach to Data Management and fail to draw insights as a result. Data Management might seem like a back-office function, but it is critical to a modern company’s success. […]

May 11, 2023

Data catalog tools work with data catalogs to make them more efficient. Data catalogs typically come with tools included as part of the data catalog package. The tools included with data catalogs have been developed to support data quality, analytics, […]

May 1, 2023

Many organizations have mapped out the systems and applications of their data landscape. Many have documented their most critical business processes. Many have modeled their data domains and key attributes. But only very few have succeeded in connecting the knowledge […]

April 11, 2023

The enormous amount of data in circulation has allowed enterprises to automate, advance, or accelerate business development with the help of agile methodologies. The automation advancements require rigorous testing for business operations or software development. Thus, it is crucial to […]

April 10, 2023

Like an invisible virus, “dirty data” plagues today’s business world. That is to say, inaccurate, incomplete, and inconsistent data is proliferating in today’s “big data”-centric world. Working with dirty data costs companies millions of dollars annually. It decreases the efficiency […]

April 3, 2023

In July 2021, one of the world’s leading banks revealed a loss of $5.5 billion due to a default by one of its customers. The bank identified the “failure of management and controls” in its investment banking arm as the […]

March 30, 2023

Sustained economic volatility and a global recession have forced enterprise leaders to make difficult decisions. Some are reducing headcount and scaling down operational overhead to become more agile, while others have implemented cost-saving measures, such as cutting tech spend, to […]

March 14, 2023

Large organizations want to create a flexible environment to innovate and respond quickly based on new data insights. But at the same time, these businesses want some structure for good Data Quality, data fit for consumption, simplifying and speeding up […]

March 8, 2023

When the Navy SEALS embraced its motto, “Slow is smooth, and smooth is fast,” they may as well have been discussing building data models in the same breath. The SEALS chose the phrase to remind its participants not to rush […]

February 15, 2023

Data is a valuable asset to the U.S. government and the public. Making it accessible and usable intensifies democracy in the country. It also promotes effectiveness in the government, as well as efficiency in each branch. Project Open Data is […]

February 13, 2023

For growth-minded organizations, the ability to effectively respond to market conditions, competitive pressures, and customer expectations is dependent on one key asset: data. But having just massive troves of data isn’t enough. The key to being truly data-driven is having […]

February 10, 2023

The arrival of Web3 confirms our entry into an era of user-governed applications. This means developers must emphasize responsiveness and deliver on-demand data insights. Likewise, at the back end, they must build a sturdy testing environment that prepares the application […]