Skip to content

sametozcan/spark-example

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

1- Packaging configurations

Maven is used for packaging. Run "mvn clean install" under project directory to obtain jar

2- Run Configurations

The application can be run using spark-submit

--master argument is mandatory.

You can use any other spark configuration setting with spark-submit

Application takes three mandatory arguments:

-firstInputFilePath

-secondInputFilePath

-outputFilePath

Ex:

spark-submit --class com.holidaycheck.main.App --master local[*] spark-example-1.0.jar f1.json f2.json result.json

spark-submit --class com.holidaycheck.main.App --master spark://127.0.0.1:7077 spark-example-1.0.jar f1.json f2.json result.json

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages