[FEA]: Cleanup dependencies.yaml

[dagardner-nv]

Is this a new feature, an improvement, or a change to existing functionality?

Improvement

How would you describe the priority of this feature request

Critical (currently preventing usage)

Please provide a clear description of problem this feature solves

Our dependencies.yaml needs to be cleaned up to reflect recent refactoring of Morpheus itself.

Describe your ideal solution

TBD

Additional context

No response

Code of Conduct

• I agree to follow this project's Code of Conduct
• I have searched the open feature requests and have found no duplicates for this feature request

[dagardner-nv]

Some ideas:

• Right now we have a lot of optional deps like langchain which require installing the examples yaml, however this is needed for much of the code in morpheus_llm so the dep isn't really specific to an example.
• We should consider making the following packages optional:
  • beautifulsoup4
  • databricks-cli
  • databricks-connect
  • elasticsearch
  • feedparser
  • milvus / pymilvus
  • pytest-kafka
  • python-confluent-kafka
  • python-graphviz
  • sqlalchemy