Skip to content

spark-submit 1.1.0

Compare
Choose a tag to compare
@PApostol PApostol released this 13 Nov 14:47
· 44 commits to master since this release

Features

  • Addition of spark_submit.SparkJob.get_submit_cmd() method
  • Introduction of spark_submit.SparkJob.concluded attribute to keep track of submitted job

Improvements

  • Improve spark_submit.system_info() functionality
  • More generic status polling
  • Minor refactoring