Tag: data pipeline

January 19, 2024

Ascend.io, the leader in data pipeline automation, is announcing a new integration with dbt, the pioneer of analytics engineering, that addresses the need for a third-party orchestration tool for dbt models. Ascend for dbt not only offers advanced orchestration capabilities […]

November 15, 2023

Those who want to design universal data pipelines and ETL testing tools face a tough challenge because of the vastness and variety of technologies: Each data pipeline platform embodies a unique philosophy, architectural design, and set of operations. Some platforms […]

November 7, 2023

One of the biggest challenges in a hybrid cloud environment is sharing data across applications. Some organizations are discovering that the same automation tools they use to orchestrate data pipelines on-premises, can also improve data sharing in a hybrid environment. […]

June 19, 2023

In part one of this article, we discussed how data testing can specifically test a data object (e.g., table, column, metadata) at one particular point in the data pipeline. While this technique is practical for in-database verifications – as tests […]

October 20, 2021

The desire to analyze data that will drive insights and competitive differentiation is older than computing itself. Digitization just speeded things up. Richard Miller Devens used the term “business intelligence” as far back as 1865. The LEO computer was calculating […]

August 30, 2021

DataOps, which focuses on automated tools throughout the ETL development cycle, responds to a huge challenge for data integration and ETL projects in general. ETL projects are increasingly based on agile processes and automated testing. ETL (i.e., extract, transform, load) […]

July 2, 2021

If there’s one key component for AI success, it’s data. But even organizations steeped in data and well-versed in the use of analytics can struggle to establish reliable, automated data pipelines to fuel machine learning strategies. Discover Financial Services found […]