Skip to content

Commit 2188e85

Browse files
committed
add result of Swallow-70b-instruct-hf
1 parent f83d49c commit 2188e85

File tree

5 files changed

+187
-0
lines changed

5 files changed

+187
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -150,6 +150,7 @@ Model outputs:
150150

151151
| Model | Win Rate | Loss Rate | Win Rate Adjusted |
152152
|----------------------------------------------------------|----------|-----------|-------------------|
153+
| tokyotech-llm--Swallow-70b-instruct-hf | 46.2 | 42.5 | 51.9 |
153154
| llm-jp--llm-jp-13b-instruct-lora-jaster-dolly-oasst-v1.0 | 28.7 | 62.5 | 33.1 |
154155
| rinna--japanese-gpt-neox-3.6b-instruction-ppo | 13.8 | 13.8 | 18.8 |
155156
| rinna--japanese-gpt-neox-3.6b-instruction-sft-v2 | 8.8 | 82.5 | 13.1 |
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
{
2+
"model_id": "tokyotech-llm--Swallow-70b-instruct-hf",
3+
"model_name_or_path": "tokyotech-llm/Swallow-70b-instruct-hf",
4+
"lora_model_name_or_path": null,
5+
"tokenizer_name_or_path": null,
6+
"prompt_template": "以下に、あるタスクを説明する指示があります。リクエストを適切に完了するための回答を記述してください。\n\n### 指示:\n{instruction}\n\n### 応答:\n",
7+
"generation_config": {
8+
"do_sample": true,
9+
"max_length": 2048,
10+
"temperature": 0.99,
11+
"top_p": 0.95
12+
}
13+
}
Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
{
2+
"model_id": "tokyotech-llm--Swallow-70b-instruct-hf",
3+
"model_name_or_path": "tokyotech-llm/Swallow-70b-instruct-hf",
4+
"lora_model_name_or_path": null,
5+
"tokenizer_name_or_path": null,
6+
"prompt_template": "以下に、あるタスクを説明する指示があります。リクエストを適切に完了するための回答を記述してください。\n\n### 指示:\n{instruction}\n\n### 応答:\n",
7+
"generation_config": {
8+
"do_sample": true,
9+
"max_length": 2048,
10+
"temperature": 0.99,
11+
"top_p": 0.95
12+
}
13+
}

0 commit comments

Comments
 (0)