Skip to content

Commit

Permalink
merge
Browse files Browse the repository at this point in the history
  • Loading branch information
zzeppozz committed Dec 19, 2024
1 parent a666fe5 commit c78dd28
Showing 1 changed file with 30 additions and 7 deletions.
37 changes: 30 additions & 7 deletions _sphinx_config/pages/aws/logging.rst
Original file line number Diff line number Diff line change
Expand Up @@ -15,20 +15,43 @@ under that log group will be created for every run of the function.
Workflow steps executed in EC2 instance
========================================

EC2 instances which execute steps will send Docker logs to a Log Group created for this
purpose, **bison_task**. A stream will be created for each task, with logging
statements for all runs in the same stream.
EC2 instances which execute steps will redirect Docker logs to an AWS Cloudwatch Log
Group created for this purpose, **bison_task**. A stream will be created for each task,
with logging statements for all runs in the same stream.

This logging is configured in the Docker compose file for each task. Use the task name
defined in the EC2 Launch Template version for the task. For task calc_stats, this
is the logging configuration of the compose file::
This logging is configured in the Docker compose file (example below) for each task.
Use the task name defined in the EC2 Launch Template version for the task.

AWS permissions
=====================================

Add CloudWatchFullAccess to the role used to launch the EC2 instance and execute the
task.

AWS Cloudwatch
=================

* Create a log group (ex: bison_task)
* Under the log group, create a log stream (ex: annotate_riis)


In Docker compose File
=====================================

compose.annotate_riis.yml::

logging:
driver: awslogs
options:
awslogs-region: us-east-1

awslogs-group: bison_task_calc_stats
awslogs-stream: calc_stats

TODO: Create a new log group for each lambda- initiated EC2 workflow task, with a new
stream (named with timestamp) for each execution.
stream (named with timestamp) for each execution::

awslogs-group: bison_task
awslogs-stream: annotate_riis


0 comments on commit c78dd28

Please sign in to comment.