Skip to content

Latest commit

 

History

History
 
 

sqs_lambda_to_batch_fargate

README.md

Stability: Stable

AWS Batch on Fargate Consumer stack

The code in this directory deploys an AWS Cloud Development Kit (AWS CDK) stack capable of running integration tests.

This stack can be deployed in isolation; however, it serves a purpose in this repository's test automation architecture.

Specifically, an Amazon Simple Queue Service (Amazon SQS) topic consumes messages from a cross-account Amazon Simple Notification Service (Amazon SNS) topic. Amazon SQS then triggers an AWS Lambda function that submits a new AWS Batch job containing test commands.

weathertop-comp-2.png

System requirements

  • npm (node.js)
  • python 3.7
  • AWS access key and secret for AWS user with permissions to create the preceding resources

Environment variables

Before continuing, save your language name as an environment variable called LANGUAGE_NAME.

For example, if your language is Java, use:

export LANGUAGE_NAME=javav2

Also, save the AWS account ID of the AWS account that is currently emitting events for this stack to process.

export PRODUCER_ACCOUNT_ID=12345678901

Lastly, save the name of the SNS topic that will be producing the previously mentioned events. If created using this Producer CDK code, it will look something like this:

export FANOUT_TOPIC_NAME=ProducerStack-fanouttopic6EFF7954-pYvxBdNPbEWM

AWS CDK setup and deployment

First, install the AWS CDK:

sudo npm install -g aws-cdk

You can check the toolkit version with this command:

cdk --version

Now you are ready to create a virtualenv:

python3 -m venv .venv

Activate your virtualenv:

source .venv/bin/activate

Install the required dependencies:

pip install -r requirements.txt

At this point you can now synthesize the AWS CloudFormation template for this code.

cdk synth

If everything looks good, go ahead and deploy. This step will actually make changes to your AWS cloud environment.

cdk bootstrap
cdk deploy

To clean up, issue this command:

cdk destroy

To exit the virtualenv python environment:

deactivate

Useful commands

  • cdk ls List all stacks in the app
  • cdk synth Emit the synthesized CloudFormation template
  • cdk deploy Deploy this stack to your default AWS account/Region
  • cdk diff Compare deployed stack with current state
  • cdk docs Open CDK documentation

This code has been tested and verified to run with AWS CDK 2.70.0 (build c13a0f1).