Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow HOURLY granularity #962

Open
5 tasks
iakov-aws opened this issue Oct 8, 2024 · 3 comments
Open
5 tasks

Allow HOURLY granularity #962

iakov-aws opened this issue Oct 8, 2024 · 3 comments

Comments

@iakov-aws
Copy link
Collaborator

iakov-aws commented Oct 8, 2024

Some customer have a big CUR. To improve performance we suggest a workaround to change time granularity to daily to reduce 24 times the volume of data.

TimeUnit: HOURLY

Need to update legacy and data collection:

Make sure to:

  • allow only allowed values
  • have a default as HOURLY
  • explain in the doc that HOURLY is recommended
  • update 3 fields
  • bonus points for the same for data-exports

Current workaround: Granularity can be changed added manually after deployment (and before backfill). Or (preferably) by changing the code before deployment.

- TimeUnit: HOURLY
+ TimeUnit: DAILY
@yprikhodko
Copy link
Collaborator

yprikhodko commented Oct 8, 2024

++ include explanation in the doc the change process from hourly to daily:

  1. Delete current stack in payer account (Update of the stack won't work as TimeUnit is a Replacement parameter and replacement CloudFormation cannot update a stack when a custom-named resource requires replacing. Rename cid and update
  2. Delete S3 bucket with current hourly CUR in payer account
  3. Delete hourly data in S3 bucket in data collection account
  4. Deploy https://github.com/aws-samples/aws-cudos-framework-deployment/blob/main/cfn-templates/cur-aggregation.yaml stack in payer account and choose Daily as parameter
  5. Request backfill of the new CUR via support case

@iakov-aws
Copy link
Collaborator Author

iakov-aws commented Oct 8, 2024

So basically we need to remove and create the stacks in both source and destination accounts with full bucket removal. This is quite an update 😓
.

@yprikhodko
Copy link
Collaborator

No need to re-deploy stack in destination account, only data cleanup to delete/backup old hourly data

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants