Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DOCS-27 - Update docs for Network Sensor end-of-life #4662

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 6 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions blog-cse/2024-11-08-application-update.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
---
title: November 8, 2024 - Application Update
keywords:
- cloud siem
image: https://help.sumologic.com/img/sumo-square.png
hide_table_of_contents: true
---

### Cloud SIEM network sensor end-of-life

The Sumo Logic Product Team is discontinuing our on-premise network sensor feature for Sumo Logic Cloud SIEM. The feature will no longer receive updates as of 8 November 2024, and support ends as of 31 January 2025. We fully support a customer or partner managed [Zeek network sensor](/docs/cse/sensors/ingest-zeek-logs/) as a data source for our Cloud SIEM product that will provide equivalent monitoring of your network.
jpipkin1 marked this conversation as resolved.
Show resolved Hide resolved

Learn more [here](/docs/cse/sensors/network-sensor-end-of-life/).
12 changes: 6 additions & 6 deletions docs/cse/sensors/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,12 @@ import useBaseUrl from '@docusaurus/useBaseUrl';
In this section, we'll introduce the following concepts:

<div className="box-wrapper" >
<div className="box smallbox card">
<div className="container">
<a href="/docs/cse/sensors/ingest-zeek-logs"><img src={useBaseUrl('img/icons/logs.png')} alt="Document icon" width="40"/><h4>Ingest Zeek Logs</h4></a>
<p>Learn how to collect Zeek (Bro) logs and ingest them to Cloud SIEM.</p>
</div>
</div>
<div className="box smallbox card">
<div className="container">
<a href="/docs/cse/sensors/sensor-download-locations"><img src={useBaseUrl('img/icons/operations/sensor.png')} alt="Database icon" width="40"/><h4>Sensor Download Locations</h4></a>
Expand All @@ -36,10 +42,4 @@ In this section, we'll introduce the following concepts:
<p>Learn how to collect Log Sensor status and data to support troubleshooting efforts.</p>
</div>
</div>
<div className="box smallbox card">
<div className="container">
<a href="/docs/cse/sensors/ingest-zeek-logs"><img src={useBaseUrl('img/icons/logs.png')} alt="Document icon" width="40"/><h4>Ingest Zeek Logs</h4></a>
<p>Learn how to collect Zeek (Bro) logs and ingest them to Cloud SIEM.</p>
</div>
</div>
</div>
87 changes: 45 additions & 42 deletions docs/cse/sensors/ingest-zeek-logs.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,46 +12,9 @@ This topic has instructions for ingesting Zeek logs into Cloud SIEM. 

Cloud SIEM uses [Zeek](https://zeek.org/) (formerly known as Bro) for network visibility. Zeek is an open source network analysis framework that organizes packets into flows, decodes common protocols, performs file extraction, SSL certificate validation, OS fingerprinting and more. Zeek can be extended through plugins for additional detection capabilities.

## Best collection method: Network Sensor
## Supported collection method: Sumo Logic Source

Sumo Logic recommends using Cloud SIEM’s Network Sensor to collect Zeek logs and upload them to an HTTP Source on a Sumo Logic Hosted Collector. This is far and away the preferred method: it ensures that supported Bro policies are enabled and that the supported Bro output format is configured. It also results in the creation of Cloud SIEM Records from the raw Zeek log messages. For instructions, see [Network Sensor Deployment Guide](/docs/cse/sensors/network-sensor-deployment-guide). 

The Network Sensor extracts files observed over cleartext protocols that match selected MIME types. You can configure what types will be extracted using the [extracted_file_types](/docs/cse/sensors/network-sensor-deployment-guide) property in the Network Sensor’s configuration file, `trident-sensor.cfg`. By default the sensor will upload password-protected zip files and the following types of executables:

* `application/x-dosexec`
* `application/x-msdownload`
* `application/x-msdos-program`

:::note
YARA [file analysis](/docs/cse/rules/import-yara-rules) is supported only for files extracted by the Network Sensor. If you use
your own Zeek deployment and ingest logs using a Sumo Logic Source you cannot also upload extracted files. 
:::

### Filtering Zeek logs

This section describes two methods you can use to filter the logs that the Network Sensor sends to Cloud SIEM.

* You can configure a Berkeley Packet Filter (BPF) filter using the [filter](/docs/cse/sensors/network-sensor-deployment-guide) parameter in Network Sensor’s configuration file, `trident-sensor.cfg`. This is the most efficient filtering mechanism as it is performed before Network Sensor processing.

The value of the `filter` parameter is an expression that begins with `not`. This example expression ensures the that the Network Sensor won't process any traffic involving host `a.b.c.com` or host `d.e.f.com`:

`not ( host a.b.c.com ) and not ( host d.e.f.com )`

For information about BPF filter syntax, see https://biot.com/capstats/bpf.html.

* You can also filter by Zeek log type using the [skipped_log_types](/docs/cse/sensors/network-sensor-deployment-guide) property in `trident-sensor.cfg`. The default value of `skipped_log_types` is:

```
dpd,weird,syslog,pe,tunnel,communication,conn-summary,known_hosts,software,stdout.stderr,loaded_scripts,ntp
```

You can add additional Zeek log types to the list to exclude them.

The BPF filter is applied before `skipped_log_types`. So, given the example BPF filter above, if you add `dns` to the `skipped_log_types` value, you won't ingest logs related to traffic involving hosts `a.b.c.com` or `d.e.f.com`, and you won't ingest DNS data.

## Alternative collection method: Sumo Logic Source 

Although the Network Sensor is the preferred method for collecting Zeek logs, there is an alternative. If you already have a Zeek deployment, you can collect logs using a Sumo Logic Collector and Source.
If you already have a Zeek deployment, you can collect logs using a Sumo Logic Collector and Source.

:::note
This method requires that your Zeek logs are in JSON format. 
Expand All @@ -60,7 +23,6 @@ This method requires that your Zeek logs are in JSON format. 
### Configure a Sumo Logic Source

In this step, you configure a Sumo Logic Source on an Sumo Logic Installed Collector. Choose the appropriate Source type based on:

* If you already have a method of forwarding Zeek logs in JSON format in Syslog format to a collector in your environment, you can use a Syslog Source to ingest the logs.
* If you’re not set up to use Syslog, and have Zeek log files stored on a filesystem, you can use a Local File Source to ingest the logs.

Expand All @@ -85,8 +47,8 @@ After installing the `json-streaming-logs` package, follow these instructions to
1. On the **Sumo Logic Ingest Mappings** page, click **Create**.<br/><img src={useBaseUrl('img/cse/ingest-mappings.png')} alt="Ingest mappings" style={{border: '1px solid gray'}} width="800"/>
1. On the **Create Sumo Logic Mapping** page:
1. **Source Category**. Enter the Source Category value you assigned to the Source you configured above in [Configure a Sumo Logic Source](#configure-a-sumo-logic-source).
1. **Format**. Choose Bro/Zeek JSON.
1. **Event ID**. Enter *_path*.
1. **Format**. Choose **Bro/Zeek JSON**.
1. **Event ID**. Enter `{_path}`.
1. **Enabled**. Use the slider to enable the mapping if you’re ready to receive Zeek logs.
1. Click **Create**.<br/><img src={useBaseUrl('img/cse/create-mapping.png')} alt="Create mapping" style={{border: '1px solid gray'}} width="600"/>

Expand Down Expand Up @@ -141,3 +103,44 @@ Perform these steps for each of the FERs.
1. **Scope**. Click **Specific Data**.
1. **Parse Expression**. Enter the parse expression shown in the table above for the field the rule will extract.
1. Click **Save**.<br/><img src={useBaseUrl('img/cse/example-fer.png')} alt="Example FER" style={{border: '1px solid gray'}} width="400"/>


## Unsupported collection method: Network Sensor

:::caution End-of-Life
This section describes using the Cloud SIEM Network Sensor. [Network Sensor has reached its end of life](/docs/cse/sensors/network-sensor-end-of-life/). Instead, use Zeek. For more information, see [Supported collection method: Sumo Logic Source](#supported-collection-method-sumo-logic-source) above.
:::

You can use Cloud SIEM’s Network Sensor to collect Zeek logs and upload them to an HTTP Source on a Sumo Logic Hosted Collector. This method ensures that supported Bro policies are enabled and that the supported Bro output format is configured. It also results in the creation of Cloud SIEM Records from the raw Zeek log messages. For instructions, see [Network Sensor Deployment Guide](/docs/cse/sensors/network-sensor-deployment-guide).

The Network Sensor extracts files observed over cleartext protocols that match selected MIME types. You can configure what types will be extracted using the [extracted_file_types](/docs/cse/sensors/network-sensor-deployment-guide) property in the Network Sensor’s configuration file, `trident-sensor.cfg`. By default the sensor will upload password-protected zip files and the following types of executables:

* `application/x-dosexec`
* `application/x-msdownload`
* `application/x-msdos-program`

:::note
YARA [file analysis](/docs/cse/rules/import-yara-rules) is supported only for files extracted by the Network Sensor. If you use your own Zeek deployment and ingest logs using a Sumo Logic Source you can't also upload extracted files.
:::

### Filtering Zeek logs

This section describes two methods you can use to filter the logs that the Network Sensor sends to Cloud SIEM.

* You can configure a Berkeley Packet Filter (BPF) filter using the [filter](/docs/cse/sensors/network-sensor-deployment-guide) parameter in Network Sensor’s configuration file, `trident-sensor.cfg`. This is the most efficient filtering mechanism as it is performed before Network Sensor processing.

The value of the `filter` parameter is an expression that begins with `not`. This example expression ensures the that the Network Sensor won't process any traffic involving host `a.b.c.com` or host `d.e.f.com`:

`not ( host a.b.c.com ) and not ( host d.e.f.com )`

For information about BPF filter syntax, see https://biot.com/capstats/bpf.html.

* You can also filter by Zeek log type using the [skipped_log_types](/docs/cse/sensors/network-sensor-deployment-guide) property in `trident-sensor.cfg`. The default value of `skipped_log_types` is:

```
dpd,weird,syslog,pe,tunnel,communication,conn-summary,known_hosts,software,stdout.stderr,loaded_scripts,ntp
```

You can add additional Zeek log types to the list to exclude them.

The BPF filter is applied before `skipped_log_types`. So, given the example BPF filter above, if you add `dns` to the `skipped_log_types` value, you won't ingest logs related to traffic involving hosts `a.b.c.com` or `d.e.f.com`, and you won't ingest DNS data.
3 changes: 2 additions & 1 deletion docs/cse/sensors/log-sensor-troubleshooting.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,9 @@ title: Log Sensor Troubleshooting
description: Learn how to collect Log Sensor status and data to support troubleshooting efforts.
---


:::caution end-of-life
The Cloud SIEM Log Sensor has reached end of life and is no longer supported. Please migrate to a Sumo Logic Hosted Collector or Installed Collector. For more information, see the [end of life notice](https://app.getbeamer.com/cloudsiementerprise/en/end-of-life-notice-_-cloud-siem-enterprise-sensors). 
:::

The Cloud SIEM Log Sensor collects log data and sends it to the legacy Cloud SIEM server. (The Log Sensor does not send log data to the Sumo Logic platform. Sumo Logic collectors serve that purpose.)

Expand Down
5 changes: 5 additions & 0 deletions docs/cse/sensors/network-sensor-deployment-guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,11 @@ description: Learn about Network Sensor deployment planning, standard sensor pla
---

import useBaseUrl from '@docusaurus/useBaseUrl';
import SensorEOL from '../../reuse/cloud-siem-network-sensor-eol.md';

:::caution end-of-life
<SensorEOL/>
:::

This section has instructions for deploying the Cloud SIEM Network Sensor. It covers deployment planning, standard sensor placement, sensor requirements, installation, general configuration, and helpful commands. 

Expand Down
5 changes: 5 additions & 0 deletions docs/cse/sensors/network-sensor-troubleshooting.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,11 @@ description: Learn how to troubleshoot problems with the Cloud SIEM Network Sens
---

import useBaseUrl from '@docusaurus/useBaseUrl';
import SensorEOL from '../../reuse/cloud-siem-network-sensor-eol.md';

:::caution end-of-life
<SensorEOL/>
:::

The Cloud SIEM Network Sensor is a flexible network security monitor that monitors IP networks and collects flow and protocol session data, building audit records of network communications. As with all network sensors, performance is a key consideration for proper operation and comprehensive data collection. The installation of the Cloud SIEM network sensor configures the sensor with reasonable defaults for many environments. For other environments, such as high throughput deployments, Sumo Logic advises the use of a supported 3rd party Bro/Zeek sensor offering or a custom Zeek cluster deployment.

Expand Down
8 changes: 7 additions & 1 deletion docs/cse/sensors/sensor-download-locations.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,14 @@ title: Sensor Download Locations
description: The Cloud SIEM Network sensor can be downloaded from a static URL that is specific to your Cloud SIEM deployment.
---

import useBaseUrl from '@docusaurus/useBaseUrl';
import SensorEOL from '../../reuse/cloud-siem-network-sensor-eol.md';

The Cloud SIEM Network sensor can be downloaded from a static URL that is specific to your Cloud SIEM deployment. Each Sumo Logic deployment has URLs used to download sensor software. If you are not sure which endpoint to use, see How can I determine which endpoint I should use?
:::caution end-of-life
<SensorEOL/>
:::

The Cloud SIEM Network Sensor can be downloaded from a static URL that is specific to your Cloud SIEM deployment. Each Sumo Logic deployment has URLs used to download sensor software. If you are not sure which endpoint to use, see How can I determine which endpoint I should use?

## Installing the Network sensor

Expand Down
1 change: 1 addition & 0 deletions docs/reuse/cloud-siem-network-sensor-eol.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
This article describes using the Cloud SIEM Network Sensor. [Network Sensor has reached its end of life](/docs/cse/sensors/network-sensor-end-of-life/). Instead, use Zeek. For more information, see [Ingest Zeek Logs](/docs/cse/sensors/ingest-zeek-logs/).
2 changes: 1 addition & 1 deletion sidebars.ts
Original file line number Diff line number Diff line change
Expand Up @@ -2805,11 +2805,11 @@ integrations: [
collapsed: true,
link: {type: 'doc', id: 'cse/sensors/index'},
items: [
'cse/sensors/ingest-zeek-logs',
'cse/sensors/sensor-download-locations',
'cse/sensors/network-sensor-deployment-guide',
'cse/sensors/network-sensor-troubleshooting',
'cse/sensors/log-sensor-troubleshooting',
'cse/sensors/ingest-zeek-logs',
],
},
{
Expand Down
Binary file modified static/img/cse/create-mapping.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified static/img/cse/ingest-mappings.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading