feat(construct): add webcrawler construct (#474)

feat(web-crawler): add web crawler construct

---------

Co-authored-by: Sergey Pugachev <[email protected]>

Author: krokoko

README.md

@@ -82,6 +82,7 @@ The following constructs are available in the library:
 | [SageMaker model deployment (Hugging Face)](./src/patterns/gen-ai/aws-model-deployment-sagemaker/README_hugging_face.md) | Deploy a foundation model from Hugging Face to an Amazon SageMaker endpoint. | Amazon SageMaker | 
 | [SageMaker model deployment (Custom)](./src/patterns/gen-ai/aws-model-deployment-sagemaker/README_custom_sagemaker_endpoint.md) | Deploy a foundation model from an S3 location to an Amazon SageMaker endpoint. | Amazon SageMaker |
 | [Content Generation](./src/patterns/gen-ai/aws-contentgen-appsync-lambda/) | Generate images from text using Amazon titan-image-generator-v1 or stability.stable-diffusion-xl model.  | AWS Lambda, Amazon Bedrock, AWS AppSync | 
+| [Web crawler](./src/patterns/gen-ai/aws-web-crawler/) | Crawl websites and RSS feeds on a schedule and store changeset data in an Amazon Simple Storage Service bucket.  | AWS Lambda, AWS Batch, AWS Fargate, Amazon DynamoDB  | 
 
 **L2 Constructs**
 

apidocs/README.md

@@ -15,6 +15,7 @@
 ### Enumerations
 
 - [ConstructName](enums/ConstructName.md)
+- [CrawlerTargetType](enums/CrawlerTargetType.md)
 
 ### Classes
 
@@ -33,13 +34,15 @@
 - [SageMakerEndpointBase](classes/SageMakerEndpointBase.md)
 - [SageMakerInstanceType](classes/SageMakerInstanceType.md)
 - [SummarizationAppsyncStepfn](classes/SummarizationAppsyncStepfn.md)
+- [WebCrawler](classes/WebCrawler.md)
 
 ### Interfaces
 
 - [AdapterProps](interfaces/AdapterProps.md)
 - [BaseClassProps](interfaces/BaseClassProps.md)
 - [ContainerImageConfig](interfaces/ContainerImageConfig.md)
 - [ContentGenerationAppSyncLambdaProps](interfaces/ContentGenerationAppSyncLambdaProps.md)
+- [CrawlerTarget](interfaces/CrawlerTarget.md)
 - [CustomSageMakerEndpointProps](interfaces/CustomSageMakerEndpointProps.md)
 - [DockerLambdaCustomProps](interfaces/DockerLambdaCustomProps.md)
 - [HuggingFaceSageMakerEndpointProps](interfaces/HuggingFaceSageMakerEndpointProps.md)
@@ -52,6 +55,7 @@
 - [QaAppsyncOpensearchProps](interfaces/QaAppsyncOpensearchProps.md)
 - [RagAppsyncStepfnOpensearchProps](interfaces/RagAppsyncStepfnOpensearchProps.md)
 - [SummarizationAppsyncStepfnProps](interfaces/SummarizationAppsyncStepfnProps.md)
+- [WebCrawlerProps](interfaces/WebCrawlerProps.md)
 
 ### Variables
 

apidocs/classes/BaseClass.md

@@ -18,6 +18,8 @@
 
   ↳↳ [`ContentGenerationAppSyncLambda`](ContentGenerationAppSyncLambda.md)
 
+  ↳↳ [`WebCrawler`](WebCrawler.md)
+
 ## Table of contents
 
 ### Constructors