Skip to content

Adobe Experience Manager (AEM) infrastructure builder on AWS using CloudFormation stacks

License

Notifications You must be signed in to change notification settings

shinesolutions/aem-aws-stack-builder

Repository files navigation

Build Status

AEM AWS Stack Builder

A set of Ansible playbooks for building Adobe Experience Manager (AEM) architectures on AWS using CloudFormation stacks.

Stack Builder has been designed with a focus on modularity, allowing the separation between network and application components, while also providing a flexible way to support multiple architectures that run a combination of the following components:

  • author-primary - contains AEM Author running in primary mode
  • author-standby - contains AEM Author running in standby mode
  • publish - contains AEM Publish
  • author-dispatcher - contains AEM Dispatcher with author-dispatcher configuration, sitting in front of author component
  • publish-dispatcher - contains AEM Dispatcher with publish-dispatcher configuration, sitting in front of publish component
  • orchestrator - contains AEM Orchestrator
  • chaos-monkey - contains Chaos Monkey
  • author-publish-dispatcher - contains AEM Author, AEM Publish, and AEM Dispatcher

Stack Builder currently supports the following AEM architectures:

  • Full Set (diagram) - includes AEM Author, Publish, and Dispatcher on separate EC2 instances with blue-green deployment, auto-recovery, auto-scaling, backup, and compaction support, suitable for all types (e.g. production, staging, testing, and development) of environments
  • Consolidated (diagram) - includes AEM Author, Publish, and Dispatcher on a single EC2 instance, suitable for development environments

Other than the above AEM architectures, Stack Builder also provides the following utilities:

  • Stack Manager(diagram) - includes AEM Stack Manager, set of AWS Lambda functions that will execute AEM functionalities via an SSM agent
  • Network - includes CloudFormation templates for creating VPC, subnets, and some sample NAT Gateway and Bastion set up

Please note that even though AEM AWS Stack Builder is specific for AWS, we would like to support other cloud provider(s) as well and contributions are welcome. If you have a need to run AEM on other technology stacks, please start a discussion by creating a GitHub issue or email us at opensource@shinesolutions.com.

Installation

  • Install the following required tools:
  • Either clone AEM AWS Stack Builder git clone https://github.com/shinesolutions/aem-aws-stack-builder.git or download one of the released versions
  • Resolve the Python packages dependencies by running make deps

Usage

  • Set up the required AWS resources
  • Create configuration file
  • Set up the configuration files by running make config config_path=<path/to/config/dir>
  • Download open source library artifacts and upload them to S3 by running make library config_path=<path/to/config/dir>

Network

Ensure configuration file for network has been set up.

Create VPC, subnets, along with other network resources:

make create-network stack_prefix=<network_stack_prefix> config_path=<path/to/config/dir>

Alternatively, if you don't have the permission to create network resources, you can create a network-exports stack that contains the details of your subnets.

make create-network-exports stack_prefix=<network_stack_prefix> config_path=<path/to/config/dir>

AEM Full-Set Architecture

AEM Full-Set Architecture Diagram

Ensure configuration file for AEM Full-Set architecture has been set up.

The simplest way to create this AEM architecture is by standing up both full set prerequisites and main stacks in one go:

make create-full-set stack_prefix=<fullset_stack_prefix> config_path=<path/to/config/dir>

However, it is also possible to separate the prerequisites from the main stacks. A use case scenario for this set up is when you want to keep the prerequisites stack around while creating/deleting the main stack within an environment, this allows you to cut some cost and to speed up environment standing up time from the second time onward.

Create prerequisites stack which contains the instance profiles, security groups, and messaging SNS SQS resources:

make create-full-set-prerequisites stack_prefix=<fullset_prerequisites_stack_prefix> config_path=<path/to/config/dir>

Create main stack which contains EC2 and Route53 resources:

make create-full-set-main stack_prefix=<fullset_main_stack_prefix> prerequisites_stack_prefix=<fullset_prerequisites_stack_prefix> config_path=<path/to/config/dir>

AEM Consolidated Architecture

AEM Consolidated Architecture Diagram

Ensure configuration file for AEM Consolidated architecture has been set up.

The simplest way to create this AEM architecture is by standing up both full set prerequisites and main stacks in one go:

make create-consolidated stack_prefix=<consolidated_stack_prefix> config_path=<path/to/config/dir>

It is also possible to separate the prerequisites from the main stacks. A use case scenario for this set up is when you want to reuse the same prerequisites stack for multiple main stacks. Please note that having a one to many mapping between prerequisites stack to multiple main stacks is only applicable for development environments, and not for production.

Create prerequisites stack which contains the instance profiles and security groups:

make create-consolidated-prerequisites stack_prefix=<consolidated_prerequisites_stack_prefix> config_path=<path/to/config/dir>

Create main stack which contains EC2 and Route53 resources:

make create-consolidated-main stack_prefix=<consolidated_main_stack_prefix> prerequisites_stack_prefix=<consolidated_prerequisites_stack_prefix> config_path=<path/to/config/dir>

AEM Stack Manager

AEM Stack Manager Diagram

Ensure configuration file for AEM Stack Manager has been set up.

Create AEM Stack Manager stacks:

make create-stack-manager stack_prefix=<stack_manager_stack_prefix> config_path=<path/to/config/dir>

More

Further information about AEM AWS Stack Builder: