Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Create an ECS integration to SS4O #1474

Open
derek-ho opened this issue Mar 20, 2023 · 3 comments
Open

[FEATURE] Create an ECS integration to SS4O #1474

derek-ho opened this issue Mar 20, 2023 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@derek-ho
Copy link
Collaborator

derek-ho commented Mar 20, 2023

Security Dashboards is tightly following Elastic's ECS schema - if we have an integration for ECS it will help with security analytics integration use case, as well as folks who are transferring data from elastic to opensearch

@derek-ho derek-ho added enhancement New feature or request untriaged labels Mar 20, 2023
@YANG-DB YANG-DB self-assigned this Mar 20, 2023
@YANG-DB YANG-DB removed the untriaged label Mar 20, 2023
@YANG-DB
Copy link
Member

YANG-DB commented Mar 20, 2023

are you referring for AWS - ECS integration ?

@derek-ho
Copy link
Collaborator Author

Updated description - I am talking about elastic's ECS https://www.elastic.co/guide/en/ecs/current/index.html

@YANG-DB
Copy link
Member

YANG-DB commented Mar 20, 2023

I think we should approach this in a gradual manner - Integration by Integration ...
As soon as we are presented with a new log-based Integration request - it should also be accompanied with the appropriate catalog-component representing its fields content...

Currently our schema catalog approach supports incrementally adding new log type support which formulate a components sub categories under the category section of the schema.

Each of these component (sub-categories) represent some scope of fields that address the relevant domain they are associated to (cloud, registry, file-system, Network ...)

NginX example: For the first Integration of the NginX web server, we added the http.mapping support to reflect the needs for the Nginx integration for http based log fields

In a similar manner, once we will be introduced with a requirement for K8 Integrations - for example, we will add the appropriate compound fields mapping to the Observability logs folder and thus allow the Integration template to explicitly declare its dependency on that component.

This mechanism helps the Integrations loading process to know which compound template it need to add to the root log template sso_logs_mapping template .

Once the template generation is complete - it will be able to support the integration's data-stream ingested documents

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants