The new operators will help enterprises integrate Vertex AI’s generative AI models into data pipelines orchestrated by Apacher Airflow and its managed workflow orchestration service Cloud Composer.
Credit: Uladzik Kryhin / Shutterstock
Google Cloud has introduced three new Apache Airflow operators within its AI service, Vertex AI.
Apache Airflow, which can be thought of as an upgraded version of a cron job scheduler written in Python, helps enterprises connect data systems so that data flows between them.
Essentially, Airflow paves the way for developers to understand how data flows between two data systems inside an enterprise.
The new Airflow operators include —TextGenerationModelPredictOperator, TextEmbeddingModelGetEmbeddingsOperator, and GenerativeModelGenerateContentOperator — which can be used to generate text predictions, text embeddings, and other content generation, the company said in a blog post.
These integrations will open up new ways for enterprises to perform data analytics using pipelines and will result in use cases such as automated insights, …