Tag: data pipeline

Software & Systems

Ascend for dbt Solves the Challenge of Efficient, Affordable, and Optimized Data Pipeline Orchestration

January 19, 2024

Via: Database Trends and Applications, the leader in data pipeline automation, is announcing a new integration with dbt, the pioneer of analytics engineering, that addresses the need for a third-party orchestration tool for dbt models. Ascend for dbt not only offers advanced orchestration capabilities […]

Software & Systems

Choosing Tools for Data Pipeline Test Automation

November 15, 2023


Those who want to design universal data pipelines and ETL testing tools face a tough challenge because of the vastness and variety of technologies: Each data pipeline platform embodies a unique philosophy, architectural design, and set of operations. Some platforms […]

BI Categories, Data Mining

Building Seamless Data Pipelines in a Hybrid Cloud Environment

November 7, 2023

Via: CMSWire

One of the biggest challenges in a hybrid cloud environment is sharing data across applications. Some organizations are discovering that the same automation tools they use to orchestrate data pipelines on-premises, can also improve data sharing in a hybrid environment. […]

BI Users, Data Analyst

Testing and Monitoring Data Pipelines: Part Two

June 19, 2023


In part one of this article, we discussed how data testing can specifically test a data object (e.g., table, column, metadata) at one particular point in the data pipeline. While this technique is practical for in-database verifications – as tests […]

BI Users, Business Users

Lay a data pipeline: Exposing the gaps in today’s business intelligence market

October 20, 2021

Via: CIO

The desire to analyze data that will drive insights and competitive differentiation is older than computing itself. Digitization just speeded things up. Richard Miller Devens used the term “business intelligence” as far back as 1865. The LEO computer was calculating […]

BI Categories, Data Mining

DataOps Highlights the Need for Automated ETL Testing (Part 1)

August 30, 2021


DataOps, which focuses on automated tools throughout the ETL development cycle, responds to a huge challenge for data integration and ETL projects in general. ETL projects are increasingly based on agile processes and automated testing. ETL (i.e., extract, transform, load) […]

BI Categories, Data Mining

Discover transforms data pipeline for AI success

July 2, 2021

Via: CIO

If there’s one key component for AI success, it’s data. But even organizations steeped in data and well-versed in the use of analytics can struggle to establish reliable, automated data pipelines to fuel machine learning strategies. Discover Financial Services found […]