Project README

Data Download

Download the required data from the following link:
Data Download Link

Training and Merged Data

Training and Merged Data Link

---

How to Start Kafka

In Linux

Start Zookeeper:

/path/to/kafka/bin/zookeeper-server-start.sh /path/to/kafka/config/zookeeper.properties  

Start Kafka server:

/path/to/kafka/bin/kafka-server-start.sh /path/to/kafka/config/server.properties  

In WSL

Start Zookeeper:

 /path/to/kafka/bin/zookeeper-server-start.sh /path/to/kafka/config/zookeeper.properties 

Start Kafka server:

/path/to/kafka/bin/kafka-server-start.sh /path/to/kafka/config/server.properties   

---

Kafka Consumer Code Execution

Run the Kafka consumer code:

consumer_and_load_to_hbase.ipynb  

---

Kafka Producer Code Execution

Run the Kafka producer code:

producer.ipynb  

---

Data format, training, validation:

Model weight is in checkpoints folder

model.ipynb  

---