The S3 Data Reader contains the S3 specific configuration required to allow the Data Service to read data from AWS S3 using alpakka s3.
The read
method in the S3DataReader first checks if the user has access to the bucket within S3, and if so, downloads the LeafResource via Alpakkas S3 download API.
To choose the s3-data-reader as the technology in your Palisade deployment, you can do so by running the following:
java -Dloader.path=s3-data-reader/target -jar data-service.jar
Or by configuring the implementation in the relevant yaml files:
data:
implementation: s3
To configure the Alpakka S3 Resource Service, read the specific yaml, and the inline comments by each value, for example:
alpakka.s3:
aws:
# If this section is absent, the fallback behavior is
# to use the same configuration as if credentials.provider = default
credentials:
# default: as described in software.amazon.awssdk.auth.credentials.DefaultCredentialsProvider docs,
# attempts to get the credentials from either:
# - environment variables
# - system properties
# - credentials file
# - EC2 credentials service
# - IAM / metadata
provider: default