Skip to content

Commit 8fb9568

Browse files
authored
chore(model gallery): add ibm-granite_granite-4.0-micro (#6376)
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 4132085 commit 8fb9568

File tree

1 file changed

+14
-0
lines changed

1 file changed

+14
-0
lines changed

gallery/index.yaml

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -49,6 +49,20 @@
4949
- filename: ibm-granite_granite-4.0-h-micro-Q4_K_M.gguf
5050
sha256: 48376d61449687a56b3811a418d92cc0e8e77b4d96ec13eb6c9d9503968c9f20
5151
uri: huggingface://bartowski/ibm-granite_granite-4.0-h-micro-GGUF/ibm-granite_granite-4.0-h-micro-Q4_K_M.gguf
52+
- !!merge <<: *granite4
53+
name: "ibm-granite_granite-4.0-micro"
54+
urls:
55+
- https://huggingface.co/ibm-granite/granite-4.0-micro
56+
- https://huggingface.co/bartowski/ibm-granite_granite-4.0-micro-GGUF
57+
description: |
58+
Granite-4.0-Micro is a 3B parameter long-context instruct model finetuned from Granite-4.0-Micro-Base using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets. This model is developed using a diverse set of techniques with a structured chat format, including supervised finetuning, model alignment using reinforcement learning, and model merging. Granite 4.0 instruct models feature improved instruction following (IF) and tool-calling capabilities, making them more effective in enterprise applications.
59+
overrides:
60+
parameters:
61+
model: ibm-granite_granite-4.0-micro-Q4_K_M.gguf
62+
files:
63+
- filename: ibm-granite_granite-4.0-micro-Q4_K_M.gguf
64+
sha256: bd9d7b4795b9dc44e3e81aeae93bb5d8e6b891b7e823be5bf9910ed3ac060baf
65+
uri: huggingface://bartowski/ibm-granite_granite-4.0-micro-GGUF/ibm-granite_granite-4.0-micro-Q4_K_M.gguf
5266
- &ernie
5367
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
5468
name: "baidu_ernie-4.5-21b-a3b-thinking"

0 commit comments

Comments
 (0)