It continues. You add another Lambda function to validate the files, which launches a Step Function state machine, which launches an AWS Glue job, which runs an AWS Glue crawler to update the data catalog. You use SNS for failure notifications, and store the template in S3 or CodeCommit. For continuous integration, you use CodePipeline. When a new Python file hits CodeCommit, CodeBuild automatically integrates it and runs unit tests for continuous delivery and end-to-end testing.
It continues. You add another Lambda function to validate the files, which launches a Step Function state machine, which launches an AWS Glue job, which runs an AWS Glue crawler to update the data catalog. You use SNS for failure notifications, and store the template in S3 or CodeCommit. For continuous integration, you use CodePipeline. When a new Python file hits CodeCommit, CodeBuild automatically integrates it and runs unit tests for continuous delivery and end-to-end testing.