Spark via REST

Submitting Spark Jobs via the built-in REST API


When you use spark-submit (or spark-submit2), then you need an Agent on the edge nodes of the cluster. In many Hadoop Shops that is not a prefered solution.

This One Automation Export has a set of objects to submit via the REST API that is available in any Spark Installation (see http://arturmkrtchyan.com/apache-spark-hidden-rest-api#).

Video - https://automic.box.com/s/bry6f8rkudhhjwrob39bli5qqasfgv4w

  • Job Submission
  • Job Submission and Waiting for Completion 
  • Job Kill
  • Create dynamic HTML page to reference Spark Output 

 

No content available.
Please log in using your Broadcom account to download this plugin.
Please log in using your Broadcom account to download this plugin.
Products Workload Automation, Automic Automation
Versions 12.x, 12.1
Solution Area Data
Operating Systems Linux, Windows
Last update 2018-05-02 12:13:36.0
Supported by
Community Source spark-via-rest

Broadcom does not support, maintain or warrant Solutions, Templates, Actions and any other content published on the Community and is subject to Broadcom Community Terms and Conditions.