Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(ecs): container port ranges in port mappings #26692

Merged
merged 23 commits into from
Aug 22, 2023
Merged

feat(ecs): container port ranges in port mappings #26692

merged 23 commits into from
Aug 22, 2023

Conversation

ste93cry
Copy link
Contributor

@ste93cry ste93cry commented Aug 9, 2023

Amazon ECS supports container port ranges for port mapping since quite a bit, however the ContainerDefinition L2 construct does not expose a way to set them. Right now, the only viable solution I found to use the feature is using Escape Hatches. Within this PR, the containerPortRange property is added to the PortMapping object and mapped back to the underlying L1 construct.

The current implementation contains a breaking change: since setting both a port range and a single fixed port doesn't make sense, I had to mark optional all the properties of PortMapping, hence the containerPort property changed its type from non-nullable to nullable. The downside of the proposed solution is that now all the properties are optional and the compiler doesn't complain if an empty object is passed as port mapping. I added some runtime checks to ensure that a valid object is created, but I didn't find a better way to do it at compile time that is also compatible with the transformation done by jsii.

Closes #23509.


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license

@github-actions github-actions bot added beginning-contributor [Pilot] contributed between 0-2 PRs to the CDK effort/small Small work item – less than a day of effort feature-request A feature should be added or improved. labels Aug 9, 2023
@aws-cdk-automation aws-cdk-automation requested a review from a team August 9, 2023 22:19
@github-actions github-actions bot added the p1 label Aug 9, 2023
Copy link
Collaborator

@aws-cdk-automation aws-cdk-automation left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The pull request linter has failed. See the aws-cdk-automation comment below for failure reasons. If you believe this pull request should receive an exemption, please comment and provide a justification.

A comment requesting an exemption should contain the text Exemption Request. Additionally, if clarification is needed add Clarification Request to a comment.

@aws-cdk-automation aws-cdk-automation dismissed their stale review August 10, 2023 21:34

✅ Updated pull request passes all PRLinter validations. Dismissing previous PRLinter review.

Copy link
Contributor

@rix0rrr rix0rrr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this. It seems like a rather involved change so I want to make sure I understand the possible implications before we ship it.

@mergify mergify bot dismissed rix0rrr’s stale review August 14, 2023 18:53

Pull request has been modified.

Copy link
Contributor

@rix0rrr rix0rrr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm also considering that the breaking change you are making (switching a property from required to optional) is not allowed if the structure you're doing this in is exposed to be read by customer code somewhere.

Someone could have written this code:

const somePort: number = container.portMapping.containerPort;
console.log(somePort);

This code used to be fine, but after your change will fail to compile with number | undefined is not assignable to number.

That type of change is not allowed.

packages/aws-cdk-lib/aws-ecs/lib/base/task-definition.ts Outdated Show resolved Hide resolved
@ste93cry
Copy link
Contributor Author

ste93cry commented Aug 17, 2023

I'm also considering that the breaking change you are making (switching a property from required to optional) is not allowed if the structure you're doing this in is exposed to be read by customer code somewhere.

Unfortunately, I don't think there is any other way to implement this feature within the current code as containerPort and containerPortRange are mutually exclusive. I tried more complicated solutions involving two interfaces and type unions but then jsii is incompatible, so I'm stuck 🤷‍♂️

@rix0rrr
Copy link
Contributor

rix0rrr commented Aug 17, 2023

I agree this is not optimal. Something we could consider is passing values through the token system. We could do something like:

class PortRange implements cdk.IResolvable {
  public readonly creationStack: string[] = [];
  public readonly typeHint?: cdk.ResolutionTypeHint;
  public readonly isPortRange = true;

  public static of(startPort: number, endPort: number): number {
    return cdk.Token.asNumber(new PortRange(startPort, endPort));
  }

  public static tryDetect(port: number): PortRange | undefined {
    const x = cdk.Tokenization.reverseNumber(port);
    return x && (x as any).isPortRange ? x as PortRange : undefined;
  }

  private constructor(public readonly startPort: number, public readonly endPort: number) {  }

  public resolve(_context: cdk.IResolveContext) {
    // This should not end up in a CFN template, so does not need to implement
    // resolve()
    throw new Error('PortRange may only be passed to ECS PortMapping\'s containerPort');
  }

  public toString(): string {
    return cdk.Token.asString(this);
  }
}

This is using some dark token magic, but it will work. We can use that to smuggle a PortRange object in the containerPort variable that normally accepts a number.

We would use that instead of adding a new property.

Demo:

const x = PortRange.of(1000, 2000);
console.log(x);
// -1.8881545897087535e+289

console.log(PortRange.tryDetect(x));
/*
PortRange {
  startPort: 1000,
  endPort: 2000,
  creationStack: [],
  typeHint: 'string'
}
*/

@rix0rrr
Copy link
Contributor

rix0rrr commented Aug 17, 2023

Or the following, which is not as nice but much more simple:

const portMapping: PortMapping = {
  containerPort: 0,  // Magic value
  portRange: '1000-2000',
};

Potentially with a const to give a nice name to the 0.

This is probably preferable for understandability and discoverability.

@ste93cry
Copy link
Contributor Author

ste93cry commented Aug 17, 2023

Or the following, which is not as nice but much more simple:

If I understand correctly, you would leave containerPort non-nullable and you would ask users to set it to a magic value when they want to use the containerPortRange, right? Doesn't this complicate things for the end user as he needs to know about this quirk?

@rix0rrr
Copy link
Contributor

rix0rrr commented Aug 17, 2023

f I understand correctly, you would leave containerPort non-nullable and you would ask users to set it to a magic value when they want to use the containerPortRange, right?

Indeed.

Doesn't this complicate things for the end user as he needs to know about this quirk?

Yes, but it's not all that bad.

  • First of all, we will put an example in the README, and 90% of users will just copy/paste that.
  • Second, we will put this information in the docstring of both properties, so anyone inspecting the API or reading the popup in their IDE will see what needs to happen.
  • Third, we will put in runtime validation saying if you supply 'portRange' you must set containerPort to 0 and if you set containerPort to 0, you must supply portRange, making it very clear what the deal is.

As much as the trick feels neat, this is more discoverable than pulling in the magic PortRange class.

@ste93cry
Copy link
Contributor Author

I have to admit that, before opening this PR, I thought a lot about adding a PortRange class with named constructors, but I didn't know it was possible to do it using tokens as backing store. As a user, I find suboptimal to have to know that there is a magic value that changes the behaviour of the object, but on the other side, having to know that a property typehinted as number magically accepts a value obtained from a cdk.IResolvable object is suboptimal too. I pushed the changes and the PR is ready for another round of review. In a future major version of CDK it may be cool to revert to the solution of two nullable properties, if BC is allowed in that case.

@ste93cry ste93cry requested a review from rix0rrr August 18, 2023 00:54
@ste93cry
Copy link
Contributor Author

I have implemented all the requested changes. There are still some outstanding points above, feel free to mark the conversations as done if you are satisfied with the replies or add more feedback on how I should proceed.

@ste93cry ste93cry requested a review from rix0rrr August 18, 2023 13:47
rix0rrr
rix0rrr previously approved these changes Aug 18, 2023
Copy link
Contributor

@rix0rrr rix0rrr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll ship it! Thanks for this.

@mergify
Copy link
Contributor

mergify bot commented Aug 18, 2023

Thank you for contributing! Your pull request will be updated from main and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

@aws-cdk-automation aws-cdk-automation removed the pr/needs-maintainer-review This PR needs a review from a Core Team Member label Aug 18, 2023
@mergify
Copy link
Contributor

mergify bot commented Aug 18, 2023

Thank you for contributing! Your pull request will be updated from main and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

@ste93cry
Copy link
Contributor Author

It seems that Mergify can't rebase the PR because, while it was open, the GitHub workflows were changed, and the app does not have the appropriate permissions to update them. Should I rebase manually?

@mergify mergify bot dismissed rix0rrr’s stale review August 18, 2023 16:25

Pull request has been modified.

rix0rrr
rix0rrr previously approved these changes Aug 18, 2023
@ste93cry
Copy link
Contributor Author

Build is now failing because of different NodeJS version used for a resource in the integration test I've added. Do I have to update the snapshot or can you do it for me?

@rix0rrr rix0rrr changed the title feat(ecs): add support for container port ranges for port mapping feat(ecs): container port ranges in port mappings Aug 21, 2023
@mergify mergify bot dismissed rix0rrr’s stale review August 21, 2023 09:44

Pull request has been modified.

rix0rrr
rix0rrr previously approved these changes Aug 21, 2023
@ste93cry
Copy link
Contributor Author

Thanks for updating the test snapshot. Unfortunately, there is one more problem that makes the build fail, but seems to be unrelated 😭 Maybe another pull of the changes from the main branch can solve it?

@mergify mergify bot dismissed rix0rrr’s stale review August 22, 2023 08:46

Pull request has been modified.

rix0rrr
rix0rrr previously approved these changes Aug 22, 2023
@mergify
Copy link
Contributor

mergify bot commented Aug 22, 2023

Thank you for contributing! Your pull request will be updated from main and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

@mergify mergify bot dismissed rix0rrr’s stale review August 22, 2023 11:18

Pull request has been modified.

@mergify
Copy link
Contributor

mergify bot commented Aug 22, 2023

Thank you for contributing! Your pull request will be updated from main and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

@aws-cdk-automation
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: AutoBuildv2Project1C6BFA3F-wQm2hXv2jqQv
  • Commit ID: aa7cb6d
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@mergify mergify bot merged commit 4997bca into aws:main Aug 22, 2023
9 checks passed
@mergify
Copy link
Contributor

mergify bot commented Aug 22, 2023

Thank you for contributing! Your pull request will be updated from main and then merged automatically (do not update manually, and be sure to allow changes to be pushed to your fork).

@ste93cry ste93cry deleted the add-container-port-range-support-for-ecs branch August 22, 2023 14:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
beginning-contributor [Pilot] contributed between 0-2 PRs to the CDK effort/small Small work item – less than a day of effort feature-request A feature should be added or improved. p1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

(aws-ecs): PortMapping should support ContainerPortRange
3 participants