Dataproc is a fully managed and highly scalable service for running Apache Hadoop, Apache Spark, Apache Flink, Presto, open source tools and frameworks. Use Dataproc for data lake modernization, ETL, and secure data science, at scale, integrated with Google Cloud

This Plugin Extension is compatible with AutoSys, dSeries, ESP and CA 7 Workload Automation solutions and it allows you to easily integrate Google Dataproc and allow your enterprise workload automation solution to manage the scheduling of these workflows. You are instantly inheriting the advanced capabilities of your enterprise solution to deliver your digital transformation quicker and more successfully.

By extending your existing enterprise automation to Google Dataproc  you maintain end-to-end visibility, regain centralized command and control, alerting, SLA management, reporting and auditing.

Features

• List, Start and Stop Cluster

• Submit Job to cluster -submit and submitAsOperation

• Workflow Template instantiate -Normal and Inline

• View execution log for problem diagnosis

• Alert on failure of Google DataProc

• Incorporate Google DataProc processing in existing enterprise automation workflows including dependency enforcement

Documentation