-
Notifications
You must be signed in to change notification settings - Fork 174
Open
Labels
feature requiredFunctionalities must haveFunctionalities must have
Description
Is your feature request related to a problem? Please describe.
currently, Auron's code is tightly coupled to Spark. since we are planning to support more engines like Flink, we need an auron-core
module to support a minimal working set of the native execution abilities.
Describe the solution you'd like
- decouple native engine code to Spark. for example,
SparkUDFWrapper
should be renamed toUDFWrapper
. - add
auron-core
maven module, which has JNI bridge, native execution wrapper, and a set of interfaces required by JNI. specified deps like Spark or Scala should be removed. -
auron-spark-extension
module should be derived onauron-core
with all interfaces implemented.
after all these task finished, we can support more engines from auron-core
like auron-flink-extension
.
Describe alternatives you've considered
Additional context
merrily01
Metadata
Metadata
Assignees
Labels
feature requiredFunctionalities must haveFunctionalities must have