Skip to content

fix: envelope is not taken into account with built-in types #960

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Merged
Show file tree
Hide file tree
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,8 @@
import org.aspectj.lang.annotation.Around;
import org.aspectj.lang.annotation.Aspect;
import org.aspectj.lang.annotation.Pointcut;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import software.amazon.lambda.powertools.validation.Validation;
import software.amazon.lambda.powertools.validation.ValidationConfig;

Expand All @@ -36,6 +38,8 @@
*/
@Aspect
public class ValidationAspect {
private static final Logger LOG = LoggerFactory.getLogger(ValidationAspect.class);

@SuppressWarnings({"EmptyMethod"})
@Pointcut("@annotation(validation)")
public void callAt(Validation validation) {
Expand All @@ -59,7 +63,9 @@ && placedOnRequestHandler(pjp)) {
JsonSchema inboundJsonSchema = getJsonSchema(validation.inboundSchema(), true);

Object obj = pjp.getArgs()[0];
if (obj instanceof APIGatewayProxyRequestEvent) {
if (validation.envelope() != null && !validation.envelope().isEmpty()) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could there be cases where customer functionality changes because of this reordering?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Potentially, if they have an envelope specified (which is not used today). It will be used after update.

validate(obj, inboundJsonSchema, validation.envelope());
} else if (obj instanceof APIGatewayProxyRequestEvent) {
APIGatewayProxyRequestEvent event = (APIGatewayProxyRequestEvent) obj;
validate(event.getBody(), inboundJsonSchema);
} else if (obj instanceof APIGatewayV2HTTPEvent) {
Expand Down Expand Up @@ -105,7 +111,7 @@ && placedOnRequestHandler(pjp)) {
KinesisAnalyticsStreamsInputPreprocessingEvent event = (KinesisAnalyticsStreamsInputPreprocessingEvent) obj;
event.getRecords().forEach(record -> validate(decode(record.getData()), inboundJsonSchema));
} else {
validate(obj, inboundJsonSchema, validation.envelope());
LOG.warn("Unhandled event type {}, please use the 'envelope' parameter to specify what to validate", obj.getClass().getName());
}
}
}
Expand All @@ -131,7 +137,7 @@ && placedOnRequestHandler(pjp)) {
KinesisAnalyticsInputPreprocessingResponse response = (KinesisAnalyticsInputPreprocessingResponse) result;
response.getRecords().forEach(record -> validate(decode(record.getData()), outboundJsonSchema));
} else {
validate(result, outboundJsonSchema, validation.envelope());
LOG.warn("Unhandled response type {}, please use the 'envelope' parameter to specify what to validate", result.getClass().getName());
}
}

Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
/*
* Copyright 2020 Amazon.com, Inc. or its affiliates.
* Licensed under the Apache License, Version 2.0 (the
* "License"); you may not use this file except in compliance
* with the License. You may obtain a copy of the License at
* http://www.apache.org/licenses/LICENSE-2.0
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*
*/
package software.amazon.lambda.powertools.validation.handlers;

import com.amazonaws.services.lambda.runtime.Context;
import com.amazonaws.services.lambda.runtime.RequestHandler;
import com.amazonaws.services.lambda.runtime.events.SQSEvent;
import software.amazon.lambda.powertools.validation.Validation;

public class SQSWithCustomEnvelopeHandler implements RequestHandler<SQSEvent, String> {

@Override
@Validation(inboundSchema = "classpath:/schema_v7.json", envelope = "records[*].powertools_json(body).powertools_json(Message)")

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One last thing, notices how records in the envelope JMSPath starts with a lower-case r but that in the schema it starts with an upper-case R. Also, on your website documentation for builtin events, you're specifying the path with a capital R. When I was trying to build my custom envelope starting from the builtin events didn't really help. Also I am not sure but it's worth checking if JMSPaths are case-sensitive.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You are actually right, the issue is that using the aws-lambda-java-events library, SQSEvent has a "records" (r) field while the true event has a "Records" (R).

The validation library uses the event library, which is actually wrong when talking about JMESPath which looks at the real JSON... The test should have envelope = "Records[*].powertools_json(body).powertools_json(Message)" with big R. I can change this to reflect the reality. We may end up with breaking changes. @msailes wdyt ?

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi Jerome,
I don't think that updating the test to have a big R would work, not sure maybe worth to check. I was more thinking that updating the documentation to have a small r would be the simpler option here.

In any case, I don't think this is related to this PR, so I think this PR does need to be updated.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually I was thinking about correcting the code to match the truth (R) and make the test with R pass. Small r should not work as the real event has big R...

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree with you @jeromevdl

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see e54c4d9

Maybe not related to the PR, but we have to fix it anyway

public String handleRequest(SQSEvent input, Context context) {
return "OK";
}
}
Original file line number Diff line number Diff line change
Expand Up @@ -101,6 +101,15 @@ public void validate_SQS() {
assertThat(handler.handleRequest(event, context)).isEqualTo("OK");
}

@Test
public void validate_SQS_CustomEnvelopeTakePrecedence() {
PojoSerializer<SQSEvent> pojoSerializer = LambdaEventSerializers.serializerFor(SQSEvent.class, ClassLoader.getSystemClassLoader());
SQSEvent event = pojoSerializer.fromJson(this.getClass().getResourceAsStream("/sqs_message.json"));

SQSWithCustomEnvelopeHandler handler = new SQSWithCustomEnvelopeHandler();
assertThat(handler.handleRequest(event, context)).isEqualTo("OK");
}

@Test
public void validate_Kinesis() {
PojoSerializer<KinesisEvent> pojoSerializer = LambdaEventSerializers.serializerFor(KinesisEvent.class, ClassLoader.getSystemClassLoader());
Expand Down
22 changes: 22 additions & 0 deletions powertools-validation/src/test/resources/sqs_message.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
{
"Records": [
{
"messageId": "d9144555-9a4f-4ec3-99a0-fc4e625a8db2",
"receiptHandle": "7kam5bfzbDsjtcjElvhSbxeLJbeey3A==",
"body": "{\n \"Message\": \"{\\n \\\"id\\\": 43242,\\n \\\"name\\\": \\\"FooBar XY\\\",\\n \\\"price\\\": 258\\n}\"}",
"attributes": {
"ApproximateReceiveCount": "1",
"SentTimestamp": "1601975709495",
"SenderId": "AROAIFU457DVZ5L2J53F2",
"ApproximateFirstReceiveTimestamp": "1601975709499"
},
"messageAttributes": {

},
"md5OfBody": "0f96e88a291edb4429f2f7b9fdc3df96",
"eventSource": "aws:sqs",
"eventSourceARN": "arn:aws:sqs:eu-central-1:123456789012:TestLambda",
"awsRegion": "eu-central-1"
}
]
}