Issue link

Resolves #408

What changes have been made

• Created a function that checks for env variables in the DDPJobDefinition, and looks for the PIP_INDEX_URL and/or PIP_TRUSTED_HOST keys. If these keys are found, pip will leverage the dedicated index location provided with the mentioned env variables.

This allows the user to submit a job with the provided env variables for pip.

Verification steps

• Checkout this PR
• Install codeflare-sdk in your kubernetes cluster. Probably easiest way is to run poetry build, then install the generated wheel with pip install codeflare_sdk-0.0.0.dev0-py3-none-any.whl.
• Clone the codeflare-sdk repository.
• Run through the guided-demo notebook 2_basic_jobs.ipynb.
• Add the env vars to the JobDefinition such as this example:

jobdef = DDPJobDefinition(
    name="mnisttest",
    script="mnist.py",
    env={"PIP_INDEX_URL": "https://pypi.org/simple", 
        "PIP_TRUSTED_HOST": "pypi.org"},
    # script="mnist_disconnected.py", # training script for disconnected environment
    scheduler_args={"requirements": "requirements.txt"}
)
job = jobdef.submit(cluster)

• Go to your dashboard, look for your submitted job, and look at the Runtime environment used:
  
• Dependencies are installed from the trusted source provided.

Checks

• I've made sure the tests are passing.
• Testing Strategy
  • Unit tests
  • Manual tests
  • Testing is not required for this change