Skip to content

Commit

Permalink
[sdlf-stage-glue] Glue Worker Type configurable through cfn parameter
Browse files Browse the repository at this point in the history
  • Loading branch information
cnfait committed Nov 20, 2024
1 parent 1987c9a commit 75d8610
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion sdlf-stage-glue/src/glue.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -94,6 +94,11 @@ Parameters:
Default: 10
MinValue: 2
MaxValue: 100
pGlueWorkerType:
Description: Worker type to use for the Glue job
Type: String
Default: G.1X
AllowedValues: [G.1X, G.2X, G.4X, G.8X, G.025X]
# the ideal would be to fetch ssm:/SDLF/VPC/Enabled and not ask the user to set this variable to true manually.
# however between AWS::SSM::Parameter::Value<String> not working in CloudFormation modules,
# Fn::ImportValue not being accepted in CloudFormation modules template fragments,
Expand Down Expand Up @@ -503,7 +508,7 @@ Resources:
lPostMetadata: !GetAtt rLambdaPostMetadataStep.Arn
lError: !GetAtt rLambdaErrorStep.Arn
lTransform: sdlf-legislators-glue-job
lWorkerType: "G.1X"
lWorkerType: !Ref pGlueWorkerType
lNumberOfWorkers: !Ref pGlueNumberOfWorkers
# lArguments:
lCrawlerName: "sdlf-legislators-stage-crawler"
Expand Down

0 comments on commit 75d8610

Please sign in to comment.