TellurideUI

TellurideUI collaborates with TelluridePipeline and TellurideSensor to provide an example of a Broadway pipeline consuming a stream of simulated IoT sensor reading messages from a RabbitMQ queue, in batches, computing some simple aggregate metrics over the stream of messages, and then publishing those metrics in a batch-oriented way to a queue on RabbitMQ by way of the BroadwayRabbitMQ producer. The point of this example is not the domain, which is contrived, but the mechanics of Broadway and Rabbit MQ working together.

TellurideUI implements a Phoenix LiveView dashboard that provides configuration and visualization of the Broadway pipeline. Here's an example screenshot:

Full Size

See Getting Started below for instructions on starting this example.

Stack

Elixir

Phoenix Framework (including LiveView)

RabbitMQ

Tailwind CSS 2

Alpine JS

with:

• amqp library
• TailwindUI

Getting Started

1. Start RabbitMQ.

A docker-compose.yaml that includes RabbitMQ is provided in telluride_pipeline. Start RabbitMQ by executing:

cd telluride_pipeline/
docker-compose up -d

2. Start TelluridePipeline by executing:

cd telluride_pipeline/
iex -S mix

To run the telluride_pipeline tests:

mix test --only telemetry_broadway

3. Start TellurideSensor by executing:

cd telluride_sensor/
iex -S mix

4. Start TellurideUI by executing:

cd telluride_ui/
mix phx.server

and then point your browser at http://localhost:4000

Consulting or Partnership

If you need help with your Elixir projects, contact [email protected] or visit https://brsg.io.

Acknowledgements

This project was inspired by Marlus Saraiva's ElixirConf 2019 talk Build Efficient Data Processing Pipelines.

License and Copyright

Copyright 2021 - Blue River Systems Group, LLC - All Rights Reeserved

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.