Skip to content

Latest commit

 

History

History
80 lines (61 loc) · 3.13 KB

installation.md

File metadata and controls

80 lines (61 loc) · 3.13 KB
Raw

Installation

Requirements

Ensure your system fulfills the following requirements:

Using Docker Container

The recommended way of using the Triton Model Navigator is to build a Docker container with all necessary dependencies:

$ make docker

Running the Triton Model Navigator inside the container requires additional volumes mapping:

  • -v /var/run/docker.sock:/var/run/docker.sock allows to communicate with host Docker Daemon to run additional containers required in some steps
  • -v <path-to-model-catalog>:<path-to-model-catalog> the path to the catalog where your model is being stored
  • -v <path-to-workdir>:<path-to-workdir> the path where Model Navigator commands are executed inside container

Understanding volumes mounting and workspace

The commands executed by the Triton Model Navigator creates workspace directory to store the artifacts and share them between the steps. Additionally, some steps are run inside a separate Docker container maintained by the Triton Model Navigator.

In order to run the Triton Model Navigator inside the Docker container the commands must be executed from mounted host path.

Running the Triton Model Navigator container:

$ docker run -it \
--gpus 1 \
-v /var/run/docker.sock:/var/run/docker.sock \
-v <path-to-model-catalog>:<path-to-model-catalog> \
-v <path-to-workdir>:<path-to-workdir> \
-w <path-to-workdir> \
--net host \
--name model-navigator \
model-navigator /bin/bash

root@hostname:<path-to-workdir>#

Additional constraints when using triton_launch_mode=docker:

  • The mappings of volumes inside the container must match the host path name, example: -v <host-path-name>:<host-path-name>
  • Use --ipc=host mode running model-navigator container

Installing from the Source

The Model Navigator can be installed from the source:

$ make install

If you are using this approach, you need to install DCGM. In order to install it on Ubuntu 20.04, run:

$ export DCGM_VERSION=2.0.13
$ wget -q https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/datacenter-gpu-manager_${DCGM_VERSION}_amd64.deb && \
dpkg -i datacenter-gpu-manager_${DCGM_VERSION}_amd64.deb

The additional packages required:

$ sudo apt install wkhtmltopdf