by Angela Guess

A recent press release reports, “Qubole, the cloud big data-as-a-service company, and Snowflake Computing, the only data warehouse built for the cloud, today announced a new partnership that enables organizations to use Apache Spark in Qubole with data stored in Snowflake. With the new integration between cloud services, data teams are able to build, train and put in production powerful machine learning (ML) and artificial intelligence (AI) models in Spark using information stored in Snowflake. The integration also enables data engineers to use Qubole to read and write data in Snowflake for advanced data preparation such as data wrangling and data augmentation to refine existing Snowflake data sets.”

The release goes on, “Qubole provides an enterprise cloud data platform for all types of big data workloads. It enables organizations to operationalize data lakes through infrastructure automation and cloud optimizations for leading open source engines. The new partnership automates the connection between Qubole and Snowflake, eliminating the complexity of manually configuring Spark and reducing the time to train and deploy ML and/or AI models with Snowflake data. This integration also provides one-time, secure credential management between Qubole and Snowflake, and access to Snowflake data through Scala and Python via Qubole’s Dataframe API for Apache Spark.”

Read more at Globe Newswire.

Photo credit: Qubole