Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[TRACKER] 9.1.0 collection test failures #1

Open
34 of 48 tasks
gotmax23 opened this issue Dec 3, 2023 · 11 comments
Open
34 of 48 tasks

[TRACKER] 9.1.0 collection test failures #1

gotmax23 opened this issue Dec 3, 2023 · 11 comments

Comments

@gotmax23
Copy link
Collaborator

gotmax23 commented Dec 3, 2023 •
edited
Loading

(All the collections that have been retired from Ansible 10.3.0 or otherwise no longer have sanity test failures in that version should be checked off.)

./main.py -i data/9/ansible-9.1.0-sanity.yaml -t build/ansible-build-data/9/ansible-9.1.0-tags.yaml -u data/9/ansible-9.1.0-missing-upstreams.yaml failures --bullet="- [ ]" --reverse | wl-copy
@gotmax23 gotmax23 changed the title [TRACKER] Collection test failures [TRACKER] 9.1.0 collection test failures Jan 23, 2024
@Andersson007 Andersson007 mentioned this issue Jan 24, 2024
Merged
@patchback patchback bot mentioned this issue Jan 24, 2024
Merged
@mariolenz
Copy link

mariolenz commented Jan 27, 2024 •
edited
Loading

I think you can ignore some of those collections since they'll be removed from Ansible 10 anyway:

@mariolenz
Copy link

BTW I see purestorage.fusion on your list. It looks like this collection will be deprecated. So maybe you can ignore this, too.

@mariolenz
Copy link

mariolenz commented Feb 17, 2024 •
edited
Loading

BTW I see purestorage.fusion on your list. It looks like this collection will be deprecated. So maybe you can ignore this, too.

@gotmax23 This collection has been deprecated by it's maintainers and will be removed from Ansible 10: ansible-community/ansible-build-data#374

@gotmax23
Copy link
Collaborator Author

gotmax23 commented Aug 22, 2024 •
edited
Loading

Results for 10.3.0 are listed below and also represented in https://github.com/ansible-community/package-test-results/tree/main/rendered/10.3.0. Some of the duplicates from above may have been fixed in git but never released. Other have not fixed all the issues or not responded at all.

(Duplicates that are already listed in the issue description and that have had issues filled already should be checked off here.)

  • cisco.intersight
    15582 validate-modules
  • cisco.ucs
    9502 validate-modules
  • ovirt.ovirt
    136 WRONG_HASH
    113 yamllint
    66 validate-modules
    60 compile-python-3.10
    60 compile-python-3.11
    60 compile-python-3.12
    59 compile-python-3.7
    59 compile-python-3.8
    59 compile-python-3.9
    11 ansible-doc
    1 WRONG_GALAXY_YML_NAME
  • community.network
    654 BANNED_SANITY
  • netapp_eseries.santricity
    342 validate-modules
    3 ansible-doc
    2 yamllint
  • check_point.mgmt
    261 validate-modules
    4 WRONG_HASH
  • google.cloud
    186 validate-modules
  • theforeman.foreman
    122 yamllint
  • wti.remote
    85 validate-modules
    7 ansible-doc
    4 yamllint
  • ansible.posix
    9 validate-modules
  • sensu.sensu_go
    7 validate-modules
    1 WRONG_HASH
  • netapp.ontap
    4 validate-modules
  • chocolatey.chocolatey
    3 validate-modules
  • cyberark.conjur
    2 yamllint
    1 validate-modules
  • cyberark.pas
    2 WRONG_HASH
    1 validate-modules
  • ibm.spectrum_virtualize
    3 WRONG_HASH
  • kubernetes.core
    3 BANNED_SANITY
  • awx.awx
    1 BANNED_SANITY
    1 WRONG_HASH
  • community.mongodb
    2 yamllint
  • community.okd
    2 BANNED_SANITY
  • ibm.storage_virtualize
    2 WRONG_HASH
  • inspur.ispim
    2 WRONG_HASH
  • kubevirt.core
    2 WRONG_HASH
  • openstack.cloud
    2 yamllint

@gotmax23
Copy link
Collaborator Author

gotmax23 commented Aug 22, 2024 •
edited
Loading

Followed up with:

(Will follow up again in a couple weeks)

@gotmax23
Copy link
Collaborator Author

@gundalow followed up with

(We should follow up again in a couple weeks)

@gotmax23
Copy link
Collaborator Author

gotmax23 commented Aug 22, 2024 •
edited
Loading

are also a problem. The maintainer says that our results are broken and differ from the results reported by Automation Hub. Perhaps there are sanity ignore entries that are not included in the git repository. Otherwise, I am at a loss.

@gotmax23
Copy link
Collaborator Author

@gundalow, any idea what's going on with the Cisco collections? Looking at the output in https://console.redhat.com/ansible/automation-hub/repo/published/cisco/intersight/import-log/, it seems that AH doesn't run the validate-modules test which is one that we require to pass.

@gotmax23
Copy link
Collaborator Author

A discussion about community.network has been started in https://forum.ansible.com/t/should-we-remove-community-network-from-the-ansible-community-package/8030.

@felixfontein
Copy link

are also a problem. The maintainer says that our results are broken and differ from the results reported by Automation Hub. Perhaps there are sanity ignore entries that are not included in the git repository. Otherwise, I am at a loss.

It turned out that this is actually due to a bug in ansible-test (ansible/ansible#83842). On the other hand, if Automation Hub's sanity tests accepted it, it means that AH doesn't run the validate-modules sanity test. This basically means that successful import in AH doesn't mean that all sanity tests pass. (But it also doesn't mean that the ones not run fail...)

@gotmax23
Copy link
Collaborator Author

gotmax23 commented Sep 11, 2024 •
edited
Loading

10.4.0

(Duplicates that are already listed in the issue description and that have had issues filled already should be checked off here.)

  • ovirt.ovirt
    136 WRONG_HASH
    113 yamllint
    66 validate-modules
    60 compile-python-3.10
    60 compile-python-3.11
    60 compile-python-3.12
    59 compile-python-3.7
    59 compile-python-3.8
    59 compile-python-3.9
    11 ansible-doc
    1 WRONG_GALAXY_YML_NAME
  • community.network
    654 BANNED_SANITY
  • netapp_eseries.santricity
    342 validate-modules
    3 ansible-doc
    2 yamllint
  • check_point.mgmt
    261 validate-modules
    4 WRONG_HASH
  • google.cloud
    203 validate-modules
  • theforeman.foreman
    122 yamllint
  • wti.remote
    85 validate-modules
    4 WRONG_HASH
  • ansible.posix
    9 validate-modules
  • sensu.sensu_go
    7 validate-modules
    1 WRONG_HASH
  • dellemc.openmanage
    4 WRONG_HASH
  • netapp.ontap
    4 validate-modules
  • chocolatey.chocolatey
    3 validate-modules
  • cyberark.conjur
    2 yamllint
    1 validate-modules
  • cyberark.pas
    2 WRONG_HASH
    1 validate-modules
  • ibm.spectrum_virtualize
    3 WRONG_HASH
  • kubernetes.core
    3 BANNED_SANITY
  • awx.awx
    1 BANNED_SANITY
    1 WRONG_HASH
  • community.mongodb
    2 yamllint
  • community.okd
    2 BANNED_SANITY
  • ibm.storage_virtualize
    2 WRONG_HASH
  • inspur.ispim
    2 WRONG_HASH
  • kubevirt.core
    2 WRONG_HASH
  • openstack.cloud
    2 yamllint
  • cisco.intersight
    1 WRONG_HASH
  • dellemc.enterprise_sonic
    1 WRONG_HASH

Total: 25 collections

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mariolenz @felixfontein @gotmax23