Skip to content

Commit 130a09b

Browse files
committed
Updated and regenerated documentation.
1 parent bc81942 commit 130a09b

File tree

3 files changed

+31
-1
lines changed

3 files changed

+31
-1
lines changed

config/tf/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,5 +4,5 @@ There is a recipe available for [TensorFlow with LIBXSMM](https://libxsmm.readth
44

55
# TensorFlow Serving
66

7-
Similarly, there is a recipe available for [TensorFlow Serving with LIBXSMM](https://libxsmm.readthedocs.io/tfserving/) ([PDF](https://github.com/hfp/libxsmm/raw/master/documentation/tfserving.pdf)).
7+
For experimentation, there is a recipe available for [TensorFlow Serving with LIBXSMM](tfserving.md). Please note this recipe is likely outdated and not intended for production use.
88

config/tf/tfserving.md

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
# TensorFlow Serving with LIBXSMM
2+
3+
The TensorFlow Serving framework uses TensorFlow underneath and adds a web-based client/server infrastructure, which can serve requests for inference on an already trained model. The [TensorFlow Serving repository](https://github.com/hfp/tensorflow-serving) (as cloned below) is tracking the master revision of the [original Serving framework](https://github.com/tensorflow/serving) and it is modified to use a [fork of TensorFlow](https://github.com/hfp/tensorflow) which by itself uses a recent revision of LIBXSMM and the Eigen library (see [here](tensorflow.md)).
4+
5+
```bash
6+
git clone https://github.com/hfp/tensorflow-serving.git
7+
```
8+
9+
It is recommended to use a recent GNU Compiler Collection to build TensorFlow (v5.1 and later). With any [recent Bazel version](https://github.com/bazelbuild/bazel/releases), the desired compiler version can be added to the environment:
10+
11+
```bash
12+
export PATH=/path/to/gcc/bin:${PATH}
13+
export LD_LIBRARY_PATH=/path/to/gcc/lib64:/path/to/gcc/lib:${LD_LIBRARY_PATH}
14+
export LIBRARY_PATH=/path/to/gcc/lib64:${LIBRARY_PATH}
15+
```
16+
17+
To build the Serving framework execute the following command:
18+
19+
```bash
20+
bazel build --verbose_failures -c opt --cxxopt=-D_GLIBCXX_USE_CXX11_ABI=0 \
21+
--copt=-O2 --copt=-fopenmp-simd --copt=-DLIBXSMM_OPENMP_SIMD \
22+
--define tensorflow_xsmm=1 --define tensorflow_xsmm_convolutions=1 \
23+
--define tensorflow_xsmm_backward_convolutions=1 \
24+
--copt=-mfma --copt=-mavx2 \
25+
--action_env TF_REVISION="master" \
26+
tensorflow_serving/...
27+
```
28+
29+
If specific target flags are desired (instead of `-mfma -mavx2`), please refer to the [TensorFlow with LIBXSMM](tensorflow.md#specific-codepath) document. This document can be referred for more details in general.
30+

xconfigure.pdf

2 KB
Binary file not shown.

0 commit comments

Comments
 (0)