-
Notifications
You must be signed in to change notification settings - Fork 72
[Usage]: import ucm_custom_ops报错ModuleNotFoundError: No module named 'ucm_custom_ops' #804
Copy link
Copy link
Open
Labels
Description
Your current environment
ERROR 03-11 02:58:23 [multiproc_executor.py:487] import ucm_custom_ops
ERROR 03-11 02:58:23 [multiproc_executor.py:487] ModuleNotFoundError: No module named 'ucm_custom_ops'
ERROR 03-11 02:58:23 [multiproc_executor.py:487] WorkerProc failed to start.
ERROR 03-11 02:58:23 [multiproc_executor.py:487] Traceback (most recent call last):
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "/vllm-workspace/vllm/vllm/v1/executor/multiproc_executor.py", line 461, in worker_main
ERROR 03-11 02:58:23 [multiproc_executor.py:487] worker = WorkerProc(*args, **kwargs)
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "/vllm-workspace/vllm/vllm/v1/executor/multiproc_executor.py", line 357, in __init__
ERROR 03-11 02:58:23 [multiproc_executor.py:487] self.worker.init_device()
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "/vllm-workspace/vllm/vllm/worker/worker_base.py", line 606, in init_device
ERROR 03-11 02:58:23 [multiproc_executor.py:487] self.worker.init_device() # type: ignore
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/worker_v1.py", line 140, in init_device
ERROR 03-11 02:58:23 [multiproc_executor.py:487] self._init_worker_distributed_environment()
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "/vllm-workspace/vllm-ascend/vllm_ascend/worker/worker_v1.py", line 340, in _init_worker_distributed_environment
ERROR 03-11 02:58:23 [multiproc_executor.py:487] ensure_ucm_sparse_initialized(self.vllm_config)
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "/workspace/unified-cache-management/ucm/sparse/state.py", line 52, in ensure_ucm_sparse_initialized
ERROR 03-11 02:58:23 [multiproc_executor.py:487] _UCM_SPARSE_AGENT = UcmSparseFactory.create_sparse_method(
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "/workspace/unified-cache-management/ucm/sparse/factory.py", line 39, in create_sparse_method
ERROR 03-11 02:58:23 [multiproc_executor.py:487] sparse_method_cls = cls._registry[sparse_method_name]()
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "/workspace/unified-cache-management/ucm/sparse/factory.py", line 25, in loader
ERROR 03-11 02:58:23 [multiproc_executor.py:487] module = importlib.import_module(module_path)
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "/usr/local/python3.10.17/lib/python3.10/importlib/__init__.py", line 126, in import_module
ERROR 03-11 02:58:23 [multiproc_executor.py:487] return _bootstrap._gcd_import(name[level:], package, level)
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "<frozen importlib._bootstrap_external>", line 883, in exec_module
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
ERROR 03-11 02:58:23 [multiproc_executor.py:487] File "/workspace/unified-cache-management/ucm/sparse/gsa_on_device/gsa_on_device.py", line 9, in <module>
ERROR 03-11 02:58:23 [multiproc_executor.py:487] import ucm_custom_ops
ERROR 03-11 02:58:23 [multiproc_executor.py:487] ModuleNotFoundError: No module named 'ucm_custom_ops'
跑的是0.3.0-release分支,按官网文档安装和编译的,跑gsa_on_device用例报错ucm_custom_ops,是编译时候什么依赖项没加吗,编译添加了export ENABLE_SPARSE=TRUE环境变量,编译也没报错。
麻烦解答,谢谢
How would you like to use ucm.
I want to run inference of a [specific model](put link here). I don't know how to integrate it with unified.
Reactions are currently unavailable