Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: Error running example modular DFP pipelines #1431

Closed
2 tasks done
efajardo-nv opened this issue Dec 13, 2023 · 0 comments · Fixed by #1429
Closed
2 tasks done

[BUG]: Error running example modular DFP pipelines #1431

efajardo-nv opened this issue Dec 13, 2023 · 0 comments · Fixed by #1429
Assignees
Labels
bug Something isn't working dfp [Workflow] Related to the Digital Fingerprinting (DFP) workflow

Comments

@efajardo-nv
Copy link
Contributor

efajardo-nv commented Dec 13, 2023

Version

24.03

Which installation method(s) does this occur on?

Docker

Describe the bug.

Getting error running any of the modular DFP examples.

Minimum reproducible example

No response

Relevant log output

Traceback (most recent call last):
  File "/workspace/examples/digital_fingerprinting/production/morpheus/dfp_integrated_training_batch_pipeline.py", line 276, in <module>
    run_pipeline(obj={}, auto_envvar_prefix='DFP', show_default=True, prog_name="dfp")
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/workspace/examples/digital_fingerprinting/production/morpheus/dfp_integrated_training_batch_pipeline.py", line 272, in run_pipeline
    pipeline.run()
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/morpheus/pipeline/pipeline.py", line 636, in run
    asyncio.run(self.run_async())
  File "/opt/conda/envs/morpheus/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/opt/conda/envs/morpheus/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete
    return future.result()
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/morpheus/pipeline/pipeline.py", line 614, in run_async
    await self.join()
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/morpheus/pipeline/pipeline.py", line 375, in join
    await self._mrc_executor.join_async()
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/morpheus/controllers/mlflow_model_writer_controller.py", line 226, in on_data
    reg_model_name = self.user_id_to_model(user_id=user)
  File "/opt/conda/envs/morpheus/lib/python3.10/site-packages/morpheus/controllers/mlflow_model_writer_controller.py", line 130, in user_id_to_model
    return self._model_name_formatter.format(**kwargs)
KeyError: 'source'

Code of Conduct

  • I agree to follow Morpheus' Code of Conduct
  • I have searched the open bugs and have found no duplicates for this bug report
@efajardo-nv efajardo-nv added bug Something isn't working dfp [Workflow] Related to the Digital Fingerprinting (DFP) workflow labels Dec 13, 2023
@efajardo-nv efajardo-nv self-assigned this Dec 13, 2023
rapids-bot bot pushed a commit that referenced this issue Dec 13, 2023
- Fix modular DFP benchmark and examples after `DFPArgParser`updates from PR #1245
- Shorten `load` file paths in example control messages
- Doc fixes

Fixes #1431
Fixes #1432

## By Submitting this PR I confirm:
- I am familiar with the [Contributing Guidelines](https://github.com/nv-morpheus/Morpheus/blob/main/docs/source/developer_guide/contributing.md).
- When the PR is ready for review, new or existing tests cover these changes.
- When the PR is ready for review, the documentation is up to date with these changes.

Authors:
  - Eli Fajardo (https://github.com/efajardo-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #1429
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working dfp [Workflow] Related to the Digital Fingerprinting (DFP) workflow
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

1 participant