Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Medium

Please provide a clear description of problem this feature solves

At present, Morpheus only allows writing to Databricks delta tables through a stage-based method. Unfortunately, this capability isn't available when constructing an inference pipeline using a modular approach. To address this limitation, implementing a 'Databricks Writer Module' would enable direct writing of results to the Delta Lake.

Describe your ideal solution

def _data_bricks_delta_lake_writer(builder: mrc.Builder):
module_config = builder.get_current_module_config()

Additional context

I have already created "databricks_writer_module" in consultation with @drobison00 .
Will raise pull request shortly.

Code of Conduct

• I agree to follow this project's Code of Conduct
• I have searched the open feature requests and have found no duplicates for this feature request