GitHub - DmitryIvanoff/dsbda_hw2: Program which calculates linux syslog priority count by hours

DmitryIvanoff / dsbda_hw2 Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Program which calculates linux syslog priority count by hours

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
app.py		app.py
app_test.py		app_test.py
readme.txt		readme.txt
script.sh		script.sh

Repository files navigation

 * Software: Spark 2.4(RDD API),Cassandra 3.11,Python3.6
 * Usage of script.sh:
     sudo ./script.sh [-i] <logfile>

Task : 
   Program which calculate linux (Ubuntu 18.04 LTS's used) syslog priority (is given by 7 - debug, 6 -info, 5 - notice, 4 - warning, 3-error, 2 - crit, 1- alert, 0 - emerg,panic) count by hours

 - Ingest technology:
     bash
 - Storage technology:
     Apache Cassandra 3.11
 - Computation technology:
     Apache Spark RDD