Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs(demo/signal-processing): Add note on index violation when re-running #175

Merged
merged 1 commit into from
Mar 18, 2025
Merged

docs(demo/signal-processing): Add note on index violation when re-running #175

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions docs/modules/demos/pages/signal-processing.adoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -65,6 +65,9 @@ image::signal-processing/notebook.png[]

The notebook reads the measurement data in windowed batches using a loop, computes some predictions for each batch and persists the scores in a separate timescale table.

NOTE: Re-running the notebook *will* result in errors, due to collisions in indexed data created by these batch scores.
Nifi is used to simulate the ingestion of streamed data by performing a one-off import and then re-calibrating the timestamps so that each batch created by the notebook will always "find" new data. Re-running the notebook will mean that batched (but *not* aggregated i.e. the timestamps are not altered) data will be written to the database a second time, resulting in a violation of a unique index constraint.

=== Adding libraries

There are two ways of doing this:
Expand Down