All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog and this project adheres to Semantic Versioning.
- Add
external_iam_role
to allow Airflow Pulumi tests to pass
- Updates standard athena policy to add 'glue:GetTableVersions'
- Add London region for Amazon Bedrock
- Add Amazon Bedrock permissions
- added Get/Put Object Tagging permissions for S3 readwrite access
- added GetTableMetadata to Athena read policy
- added kms permissions
- updated pypi action for trusted publisher
- implemented backwards compatibility for secrets
- added readwrite option for secrets
- add deny option to s3 access
- Updated dependencies.
- Loosened jsonschema version requirements.
- Added schema validation
- Removed support for Python 3.6
- Added details on how to update on PyPi
- Added Github action for linting
- Target bucket for Athena query temporary files can now be selected in config (or left out to use default)
- Changed default query dump bucket from alpha-athena-query-dump to mojap-athena-query-dump
- Can select multiple query dump buckets by putting a list in config
- Added a test for multiple query dump buckets
- Added some type hints
- Updated
parameterized
module dependency to align withetl_manager
- Updated Athena read and write policy templates to remove permissions to
ListBucket
onaws-athena-query-results-*
and improve consistency
- Added additional permissions to glue jobs to write logs and metrics correctly
- Updated project toml
- Depreciated as project toml was not updated
- Reverting version back to v3.1.0 and releasing as a new version
- Seperated out list bucket policy into two seperate Sids for clarity
- Started using
pyproject.toml
- Updated UTs and CI to GitHub Actions
- Started using
pyproject.toml
- Added secrets parameters and access for users
- Updated yaml read based on this
- Added
alpha-athena-dump
bucket to list bucket iam actions - required to work withs3tools
package
- removed f-strings and changed python requirements to 3.5 and above
- s3 action
GetBucketLocation
added to thelist
Sid in the IAM templates.
- s3 action
ListAllMyBuckets
added to thelist
Sid in the IAM templates.
Inital release