spark-submit 1.2.0
Features
- Added optional
timeout
argument forspark_submit.SparkJob.submit()
Improvements
- Improve support for Yarn and Kubernetes clusters on polling and killing submitted tasks
Misc/Internal
- Use dedicated file for default arguments and Spark states
- Use consistent path separators where possible