Skip to content

This repository code file aims to generate random data, which can be assumed of type streaming, in the context of big data, if you connect this source program to a Kinesis Data Stream it becomes Streaming Source.

Notifications You must be signed in to change notification settings

VadlamudiNaveen/SDS-Streaming-Data-Simulator-

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Streaming-Data-Simulator

This repository code file aims to generate random data, which can be assumed of type streaming in the context of big data. if you make a connection to a Kinesis Data Stream it becomes Streaming Source.

Here are the below Experiments You can perform with this code.

  • Task 1: Run this Program in Multiple consoles and check the resource monitor of your computer, And boom feel the Eureka.
  • Task 2: Run this Program in the console and check the time taken to generate the data for each upper bound. So that you get a vivid picture of it.
  • Task 3: Run this Program Multiple times and Bench mark the results and analyse how much time will it take to generate 1 Billion Records.

Single Console Output:

Screenshot

Multiple Console Output:

Screenshot

About

This repository code file aims to generate random data, which can be assumed of type streaming, in the context of big data, if you connect this source program to a Kinesis Data Stream it becomes Streaming Source.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages