Skip to content

Commit

Permalink
docs: partial reports can be submitted (#3179)
Browse files Browse the repository at this point in the history
* docs: reports rules updated

Signed-off-by: Mattia Lavacca <lavacca.mattia@gmail.com>

* address comments

Signed-off-by: Mattia Lavacca <lavacca.mattia@gmail.com>

---------

Signed-off-by: Mattia Lavacca <lavacca.mattia@gmail.com>
  • Loading branch information
mlavacca committed Aug 9, 2024
1 parent 98a84b6 commit 35a5daf
Showing 1 changed file with 15 additions and 4 deletions.
19 changes: 15 additions & 4 deletions conformance/reports/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -121,7 +121,18 @@ comply with the following rules:
- `mode`: it is the mode of the implementation used to run the tests. If different
from `default`, it must correspond to a specific setup of the implementation.
- Test result: in order to have a report valid to be accepted, all the profiles
need to have the `result` fields (core and extended) set to `success`. It means
that all the core conformance tests have been successfully run as well as all
the tests related to the supported extended features. No reports with partial
or failing results can be accepted.
need to have the `result` fields (core and extended) set to `success` or `partial`.
`partial` reports will be displayed separately from the `success` ones in the
[implementations table][implementations-table].

A `success` report implies **all** the following:
- all the core conformance tests have been successfully run
- all the tests related to the supported extended features have been successfully
run.

A `partial` report implies **at least one** of the following:
- some core conformance tests have been skipped
- some tests related to the supported extended features have been skipped
- the conformance test run required some steps unexpected by the suite.

[implementations-table]: https://gateway-api.sigs.k8s.io/implementations/v1.1/

0 comments on commit 35a5daf

Please sign in to comment.