Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report failing thresholds alongside results #36

Open
OscarBarrett opened this issue Aug 23, 2022 · 0 comments
Open

Report failing thresholds alongside results #36

OscarBarrett opened this issue Aug 23, 2022 · 0 comments

Comments

@OscarBarrett
Copy link

During runs only the passing thresholds are reported.

comparison.results.forEach((res) => {
log(chalk.greenBright(res));
});

Failing thresholds are not reported until the end of the test suite.
If you have a test suite that takes several minutes this means you need to wait to see exactly what thresholds failed and by how much.
Failing thresholds should be logged alongside passing ones so failures can be identified during the run.

An example use case is if you have enabled retries. e.g. if you retry failed tests several times, it's useful to be able to see the what the failed values were to adjust thresholds to match.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant