Skip to content

spark-submit 1.2.0

Compare
Choose a tag to compare
@PApostol PApostol released this 09 Dec 18:30
· 38 commits to master since this release

Features

  • Added optional timeout argument for spark_submit.SparkJob.submit()

Improvements

  • Improve support for Yarn and Kubernetes clusters on polling and killing submitted tasks

Misc/Internal

  • Use dedicated file for default arguments and Spark states
  • Use consistent path separators where possible