A new press release reports, “Ascend, provider of the world’s first Autonomous Dataflow Service, today released a technical preview of Queryable Dataflows, a new capability to accelerate end-to-end data development that brings the interactivity of data warehouses to the scale of data pipelines. For the first time, data engineers can directly query incremental stages of any Dataflow without changing tools or disrupting the development process. Powered by the Dataflow Control Plane, interactive queries are not only optimized for any scale of data but can be immediately productionized as new Dataflow stages in a single click. With the ability to explore, profile, and prototype now seamlessly integrated within the data development process, data engineers can build and productionize pipelines faster than ever before.”

Sean Knapp, CEO and founder of Ascend, commented, “For too long, data engineers have had to trade off the scale and performance of carefully tuned pipelines with the interactivity of warehouses. Making incremental stages of data pipelines queryable is challenging, requiring advanced layers of caching, persistence, lineage tracking, and data invalidation. As a result, engineering teams invest huge amounts of time determining which stages of pipelines to persist and where – what belongs back in the data lake and what belongs in a warehouse… With the introduction of Queryable Dataflows, data engineers are freed from these unnecessary tradeoffs and can directly interact with data from any stage of any Dataflow as if it were a data warehouse. By breaking through the boundaries between pipelines and warehouses, we both ease pipeline development as well as more seamlessly integrate the data development lifecycle.”

Read more at Business Wire.

Image used under license from Shutterstock.com