Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[🔌 Provider]: AWS SQS #2963

Open
lohrm-stabl opened this issue Jan 2, 2025 · 5 comments
Open

[🔌 Provider]: AWS SQS #2963

lohrm-stabl opened this issue Jan 2, 2025 · 5 comments
Assignees
Labels
Enhancement New feature or request Provider Providers related issues

Comments

@lohrm-stabl
Copy link

Describe the provider you want to add
As a developer, I want to receive and send alerts from and to SQS.

Describe your use case
This will enable us to use and integrate keep into our cloud architecture.
With that we can call a lambda from that queue and execute custom code for integration in our platform.
It will also be a lot cheaper for us to use keep, because instead of keep querying our database all the time, we can simply check critical values during preprocessing and notify keep.

Are you already using Keep?
No

Additional context
Add any other context or screenshots about the provider request here.

@lohrm-stabl lohrm-stabl added the Provider Providers related issues label Jan 2, 2025
@dosubot dosubot bot added the Enhancement New feature or request label Jan 2, 2025
@shahargl
Copy link
Member

shahargl commented Jan 2, 2025

hey @lohrm-stabl, thanks for opening this issue :)

would love to learn about how you want to get alerts from SQS:

  1. do you mean smth like Keep's Kafka integration which reads events from the queue and parse them as alert?
  2. will the alert have a schema? what schema it would be?
  3. is some tool generating these alerts/events? if so - what tools?

in general, it will help me to get something like:

as Keep user, I want to connect X (SQS queue?) and read (?) events every interval and parse them with schema Y?

@lohrm-stabl
Copy link
Author

lohrm-stabl commented Jan 2, 2025

Hey @shahargl sure,

1. do you mean smth like Keep's Kafka integration which reads events from the queue and parse them as alert?
2. will the alert have a schema? what schema it would be?
3. is some tool generating these alerts/events? if so - what tools?
  1. I am not familiar woth the Kafka integration but it sounds exactly like what we need (for our first use case).
  2. Support for custom JSON schemas would be great but I'm also happy with a given one.
  3. Custom software

so we actually have two use cases: Notify about alerts via SQS:
we have an internal preprocessing which gets its data from Kinesis Data Streams, enhances the data and writes it out to different databases. We also perform some basic checks to make sure the data is fine. From there we currently raise some alerts by sending them to SQS. We are thinking about replacing our current alerting solution which reads from this queue. We are free to adjust the format to a generic one keephq supports. We could also just call some HTTP API directly (there is probably also a Python library for that?) to submit/notify our events, but the queue seems like a better idea.

As a keep user, I want to connect our AWS SQS queue where we submit alerts in a given format to raise them in keep.

The second one: Get processed alerts via SQS.

Similar to how you notify telegram channels or send out emails for events, I would like to get an event submitted to our SQS queue, so we can further process it. Without to deep keep knowledge, I think a possible workaround would be to create a public API, set that up as a webhook, and configure an AWS Lambda behind that API to parse the request and submit it to an AWS queue.

As a keep user, I want to connect an AWS SQS queue to receive and react to alerts raised in keep.

@shahargl
Copy link
Member

shahargl commented Jan 2, 2025

Amazing! Let me draft something you can test 👌

@35C4n0r
Copy link
Contributor

35C4n0r commented Jan 5, 2025

@shahargl I'd love to work on this :)

@shahargl
Copy link
Member

shahargl commented Jan 5, 2025

@35C4n0r assigned!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Enhancement New feature or request Provider Providers related issues
Projects
None yet
Development

No branches or pull requests

3 participants