Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
ameen-91 committed Nov 29, 2024
1 parent 2bd305f commit f22fb24
Showing 1 changed file with 7 additions and 1 deletion.
8 changes: 7 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,11 +35,17 @@ pip install infero

Here is a simple example of how to use Infero:

```bash
infero pull [hf_model_name]
```

To run a model:

```bash
infero run [hf_model_name]
```

To run a model with 8-bit quantization:
With 8-bit quantization:

```bash
infero run [hf_model_name] --quantize
Expand Down

0 comments on commit f22fb24

Please sign in to comment.