Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run preTest actions during release verification workflow #1274

Merged
merged 1 commit into from
Jan 8, 2025

Conversation

corymhall
Copy link
Contributor

The ci-mgmt config has a configuration property for preTest jobs. These are run during the test workflow before the tests themselves are run. Since the verify release workflow runs the same tests we should also run these preTest steps. For example, in pulumi-aws we have preTest jobs to get AWS credentials which are required to run the tests in the verify release workflow.

re pulumi/pulumi-aws#5049, re #1265

The ci-mgmt config has a configuration property for `preTest` jobs.
These are run during the `test` workflow before the tests themselves are
run. Since the verify release workflow runs the same tests we should
also run these `preTest` steps. For example, in `pulumi-aws` we have
`preTest` jobs to get AWS credentials which are required to run the
tests in the verify release workflow.

re pulumi/pulumi-aws#5049, re #1265
@corymhall corymhall requested a review from a team January 8, 2025 16:38
Copy link
Member

@iwahbe iwahbe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is stretching the definition of .Config.Actions.PreTest, but since release verification is basically just running an example test, I think this is ok.

@corymhall corymhall added this pull request to the merge queue Jan 8, 2025
Merged via the queue into master with commit 8531096 Jan 8, 2025
7 checks passed
@corymhall corymhall deleted the corymhall/verify-release-pretest branch January 8, 2025 20:14
@danielrbradley
Copy link
Member

@corymhall we might need to revert this as it's caused a P1 in azure – master is broken. Pre-test currently has the assumption that it's only run in the test job, which has some addition setup including gotestfmt.

I would agree this is a slightly odd place to call preTest as release verification isn't running any tests - just downloading and executing the released SDKs and provider binary.

Since the verify release workflow runs the same tests

I don't think this is true. We don't run any Go tests in the verify job.

danielrbradley added a commit that referenced this pull request Jan 10, 2025
iwahbe added a commit to pulumi/pulumi-junipermist that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-scm that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-meraki that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-sdwan that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-ise that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-dbtcloud that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-harness that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-artifactory that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-pagerduty that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-okta that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-pagerduty that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-auth0 that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-datadog that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-tailscale that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-vault that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-okta that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-gitlab that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-postgresql that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-snowflake that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-newrelic that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-auth0 that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-hcloud that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-cloudflare that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-vault that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-datadog that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-postgresql that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-gitlab that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-hcloud that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-digitalocean that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in the `provider/`
directory, we get a maintained test script and avoid overloading the `actions.preTest`
hook to run tests.

Related to pulumi/ci-mgmt#1276, pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-cloudflare that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
iwahbe added a commit to pulumi/pulumi-digitalocean that referenced this pull request Jan 10, 2025
By using ci-mgmt's intended solution for running integration tests in
the `provider/` directory, we get a maintained test script and avoid
overloading the `actions.preTest` hook to run tests.

Related to pulumi/ci-mgmt#1276,
pulumi/ci-mgmt#1274 (comment)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants