Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove ability to skip stories in tests. #358

Merged
merged 1 commit into from
Jun 24, 2024

Conversation

dblock
Copy link
Member

@dblock dblock commented Jun 21, 2024

Description

Potentially controversial @nhtruong :)

I find the skip: true option harmful. I fail to see when I'd want to use this. Either I run individual tests (supported with --tests) or the entire suite. Disabling a solo test story seems to be an invitation for skipping something that's flaky, for example. If I really want to disable one locally, I can just comment it out.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: dblock <dblock@amazon.com>
Copy link

github-actions bot commented Jun 21, 2024

Changes Analysis

Commit SHA: 84a53cd
Comparing To SHA: 33aa91a

API Changes

Summary

NO CHANGES

Report

The full API changes report is available at: https://github.com/opensearch-project/opensearch-api-specification/actions/runs/9619311822/artifacts/1626225968

API Coverage

Before After Δ
Covered (%) 483 (47.31 %) 483 (47.31 %) 0 (0 %)
Uncovered (%) 538 (52.69 %) 538 (52.69 %) 0 (0 %)
Unknown 24 24 0

Copy link
Collaborator

@nhtruong nhtruong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's just a feature that's present in many test frameworks. It's for WIP tests or turning off flaky tests while working on solutions to resolve the flaky tests. Since we're not building an app with interwoven components, the need for this feature is very small. I'm okay with removing it to avoid it being abused.

@dblock dblock merged commit feb3ea0 into opensearch-project:main Jun 24, 2024
10 checks passed
@dblock dblock deleted the delete-skip branch June 24, 2024 21:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants