-
Notifications
You must be signed in to change notification settings - Fork 76
Apache Oozie Features
The Hadoop Plugin comes with tasks to execute Apache Oozie commands and upload zip artifacts to versioned directories on HDFS.
Please note that we are no longer actively using Apache Oozie at LinkedIn. Although the Apache Oozie-related code is covered by unit tests, it is possible that the Apache Oozie tasks may fall into a non-working state.
In addition, instead of providing full documentation for each task, we will refer you to the source code to understand the various options.
The Apache Oozie tasks will read configuration information from this file. Run ./gradlew writeOoziePluginJson
to create a default .ooziePlugin.json
file and then edit this file to provide information about your own Oozie instance.
See OozieConstants.groovy for more information about the configuration values you should provide.
This task will execute the Oozie command specified on the command line by -Pcommand=commandName
.
All of the standard Oozie commands are supported, including submit
, run
, suspend
, resume
, start
, status
and kill
.
See OozieCommandTask.groovy for more information about using this task.
This task will upload the zip artifact specified in the .ooziePlugin.json
file to a versioned directory on HDFS.
See OozieUploadTask.groovy for more information about using this task.