Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

need docs for config setting for aws endpoint work under localstack #61

Closed
richard-mauri opened this issue Jun 3, 2021 · 3 comments
Closed

Comments

@richard-mauri
Copy link

richard-mauri commented Jun 3, 2021

Either a first class config or via an ENV variable would be ok.

I have tried to set the endpoint in the s3_default_options but no luck.

input {
  s3snssqs {
    region                     => "us-east-1"
    access_key_id              => "local"
    secret_access_key          => "local"
    s3_default_options         => { "endpoint" => "http://localstack:4566/" }
    queue                      => "queue1"
    type                       => "s3-logs"
    tags                       => ["s3-sqs-test"]
    sqs_skip_delete            => false
    codec                      => json
    from_sns                   => false
  }
} 

See also: aws/aws-cli#4454 (comment)

@richard-mauri
Copy link
Author

@richard-mauri
Copy link
Author

richard-mauri commented Jun 7, 2021

I got it to connect ok using "endpoint" config.
I wish the documentation for this.

Note to other people that are trying to connectfrom a docker logstash to a localstack running in docker, that you should have them in the same docker bridge network and you must set the env variable HOSTNAME_EXTERNAL for the localstack container to the name of the docker network (see: aws/aws-sdk-java#2342)

input {
  s3snssqs {
    region                     => "us-east-1"
    endpoint                   => "http://localstack:4566/"
    access_key_id              => "test"
    secret_access_key          => "test"
    s3_default_options         => { "force_path_style" => true }
    queue                      => "queue1"
    type                       => "s3-logs"
    tags                       => ["s3-sqs-test"]
    sqs_skip_delete            => false
    codec                      => json
    from_sns                   => false
  }
}

@richard-mauri richard-mauri changed the title need a config setting for aws endpoint-url to work under localstack need docs for config setting for aws endpoint work under localstack Jun 7, 2021
@cherweg
Copy link
Owner

cherweg commented Apr 19, 2022

I‘ll update the documentation. Thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants