Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(integ): run all CDK integ tests with -v #10503

Merged
merged 3 commits into from
Sep 24, 2020
Merged

Conversation

rix0rrr
Copy link
Contributor

@rix0rrr rix0rrr commented Sep 24, 2020

Now that we suppress output of non-failing tests, it becomes
all the more important to have detailed information for failing tests.


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license

Now that we suppress output of non-failing tests, it becomes
all the more important to have detailed information for failing tests.
@rix0rrr rix0rrr requested a review from a team September 24, 2020 08:20
@rix0rrr rix0rrr self-assigned this Sep 24, 2020
@mergify mergify bot added the contribution/core This is a PR that came from AWS. label Sep 24, 2020
@mergify
Copy link
Contributor

mergify bot commented Sep 24, 2020

Title does not follow the guidelines of Conventional Commits. Please adjust title before merge.

@rix0rrr rix0rrr changed the title core(integ): run all CDK integ tests with -v chore(integ): run all CDK integ tests with -v Sep 24, 2020
@@ -178,7 +178,7 @@ export class TestFixture {
}

public async cdk(args: string[], options: CdkCliOptions = {}) {
return this.shell(['cdk', ...args], {
return this.shell(['cdk', '-v', ...args], {
Copy link
Contributor

@iliapolo iliapolo Sep 24, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rix0rrr To see these logs in the regression suites for the current release this needs to be patched to the previous tests as well..added do-not-merge

@iliapolo iliapolo added the pr/do-not-merge This PR should not be merged at this time. label Sep 24, 2020
@rix0rrr rix0rrr removed the pr/do-not-merge This PR should not be merged at this time. label Sep 24, 2020
@aws-cdk-automation
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: AutoBuildProject6AEA49D1-qxepHUsryhcu
  • Commit ID: 7f03604
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@mergify
Copy link
Contributor

mergify bot commented Sep 24, 2020

Thank you for contributing! Your pull request will be updated from master and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

@mergify mergify bot merged commit c8e72e5 into master Sep 24, 2020
@mergify mergify bot deleted the huijbers/verbose-integ branch September 24, 2020 11:13
rix0rrr added a commit that referenced this pull request Sep 24, 2020
mergify bot pushed a commit that referenced this pull request Sep 24, 2020
Reverts #10503

We can't actually do this. There are tests that check that the output of the `cdk` command is *exactly* "some value", and adding the logging in breaks the expectation.

Revert the `-v` to allow the tests to go back to passing 90% of the time.
mergify bot pushed a commit that referenced this pull request Sep 25, 2020
Following up on #10503, enabling verbose logging for integ tests. 
opt out for tests that relies on exact match of the output:

* 'cdk synth' - match the output of `synth`. 
* 'Two ways of shoing the version' - This one is tricker. Since `--version` is implemnted using `.version()` of `yargs` it ignores the `-v` argument, but `version` (no dash) which is our implementation respect it. 
```
$cdk version -v
CDK toolkit version: 1.63.0 (build 7a68125)
.... blah blah                                                                                                                                                                                                                          
```
 vs:

```
$cdk --version -v 
1.63.0 (build 7a68125)
```

----

*By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contribution/core This is a PR that came from AWS.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants