Skip to content

This is a simple demonstration for running Tensorflow inception v3 model on TensorRT

Notifications You must be signed in to change notification settings

jeng1220/Tensorflow_Inception_v3_TensorRT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This is a simple demonstration for running Tensorflow inception v3 model on TensorRT

Requirement

  • TensorRT 3.0 GA
  • cuDNN 7 for CUDA 9.0
  • Cmake 3.8 (natively support CUDA, refer to link)

Environment Variables

export PATH=/usr/local/cuda/bin:$PATH

CUDA_LIB=/usr/local/cuda/lib64
export LIBRARY_PATH=$CUDA_LIB:$LIBRARY_PATH
export LD_LIBRARY_PATH=$CUDA_LIB:$LD_LIBRARY_PATH

CUDA_INC=/usr/local/cuda/include:/usr/local/cuda/samples/common/inc
export C_INCLUDE_PATH=$CUDA_INC:$C_INCLUDE_PATH
export CPLUS_INCLUDE_PATH=$CUDA_INC:$CPLUS_INCLUDE_PATH

Build

$ mkdir -p build
$ cd build
$ cmake -DCMAKE_BUILD_TYPE=Release ..
$ make -j4

Run

$ ./build/bin/inception3_basic -h
$ ./build/bin/inception3_basic -u ./data/inception_v3.uff -i ./data/panda.ppm -l ./data/imagenet_slim_labels.txt

Appendix

Prepare Model and Label

The network model, label and images (PPM format) have been prepared at data folder. Following text shows where and how to get these files.

  1. Refer to link and download Tensorflow inception v3 model.
$ wget "https://storage.googleapis.com/download.tensorflow.org/models/inception_v3_2016_08_28_frozen.pb.tar.gz"
$ tar zxvf inception_v3_2016_08_28_frozen.pb.tar.gz
  1. Then, follow instructions from TensorRT User Guide to convert pb file to UFF file.
python3 /usr/lib/python3.5/dist-packages/uff/bin/convert_to_uff.py tensorflow --input-file inception_v3_2016_08_28_frozen.pb -o inception_v3.uff -O InceptionV3/Predictions/Reshape_1

Prepare PPM Image

PPM images as input image format can be referred to link. The default input image size of inception v3 is width=299, height=299 and channel=3.

  1. kolourpaint, a free software can resize image and convert JPEG, PNG image to PPM format.

About

This is a simple demonstration for running Tensorflow inception v3 model on TensorRT

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published