Skip to content

Commit 78af355

Browse files
authored
feat(stepfunctions): add support for custom WriterConfig fields for ResultWriter in Distributed Map (#33772) and (#33601) (#33831)
feat(stepfunctions): Create a new ResultWriterV2 class to support WriterConfig in ResultWriter object in Distributed Map Closes #33772 and #33601. Reason for making this change: A new property `WriterConfig` was added under ResultWriter property of Distributed Map. `WriterConfig` contains OutputType and Transformation Ref: https://docs.aws.amazon.com/step-functions/latest/dg/input-output-resultwriter.html#input-output-resultwriter-field-contents `ItemReader` also supports "JSONL" as the `InputType`. It's currently missing in the enum. Ref: https://docs.aws.amazon.com/step-functions/latest/dg/input-output-itemreader.html#itemreader-field-contents Changes: * Created a copy of ResultWriter as ResultWriterV2 to avoid introducing a breaking change to ResultWriter. * Consumers will need to set feature`@aws-cdk/aws-stepfunctions:useDistributedMapResultWriterV2` to true in the context. * Create new class `WriterConfig` and add `writerConfig` property under `ResultWriterV2` in Distributed Map. * Add `OutputType` and `Transformation` properties under `WriterConfig`. * Add Warning when ResultWriter is empty. * Add the missing `JSONL` type which is a part of `InputType` `ItemReader` of Distributed Map. * Permissions - No additions. But removed the permission to put object when just `writerConfig` is specified. * * Also added the missing `JSONL` from `InputType` in the `ItemReader` of Distributed Map. * Add a unit test and an integ test. - [x] My code adheres to the [CONTRIBUTING GUIDE](https://github.com/aws/aws-cdk/blob/main/CONTRIBUTING.md) and [DESIGN GUIDELINES](https://github.com/aws/aws-cdk/blob/main/docs/DESIGN_GUIDELINES.md) ---- *By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license*
1 parent 9ffa244 commit 78af355

File tree

79 files changed

+151875
-23812
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

79 files changed

+151875
-23812
lines changed

packages/@aws-cdk-testing/framework-integ/test/aws-stepfunctions/test/integ.distributed-map-csv-delimiter-with-result-writer-v2.js.snapshot/DistributedMapCsvDelimiterDefaultTestDeployAssert47A59939.assets.json

+33
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)