docs: add notebook for openai finetuning with kili #1259
Conversation
|
Check out this pull request on See visual diffs & provide feedback on Jupyter Notebooks. Powered by ReviewNB |
| @@ -0,0 +1,2081 @@ | |||
| { | |||
There was a problem hiding this comment.
I think that here you should explain that each line of this file is an input text and its class, separated by an "|"
Also, I would change the code like this instead:
with open(...) as f: lines = f.readlines()lines = [line.split("|") for line in lines]
content_array = [line[0] for line in lines]
categories_array = [line[1] for line in lines]
external_id_array = [f"text_{i}" for i, _ in enumerate(content_array)]
Reply via ReviewNB
There was a problem hiding this comment.
1: addressed in NB
2. Will address this in version 2.0 of the NB
| @@ -0,0 +1,2081 @@ | |||
| { | |||
There was a problem hiding this comment.
| @@ -0,0 +1,2081 @@ | |||
| { | |||
There was a problem hiding this comment.
you can say that as of now, only GPT3 models can be finetuned : https://platform.openai.com/docs/models/gpt-3
Reply via ReviewNB
| @@ -0,0 +1,2081 @@ | |||
| { | |||
There was a problem hiding this comment.
There was a problem hiding this comment.
This is based on what I found in OpenAI's documentation.
| @@ -0,0 +1,2081 @@ | |||
| { | |||
There was a problem hiding this comment.
Line #22. exported_class = (nested_field[0]['name'])
I would just use exported_class = json_data["latestLabel"]["jsonResponse"]['CLASSIFICATION_JOB']['categories'][0]["name"]
or use the label parsing
Reply via ReviewNB
There was a problem hiding this comment.
To be done in version 2.0 of the NB
| @@ -0,0 +1,2081 @@ | |||
| { | |||
There was a problem hiding this comment.
There was a problem hiding this comment.
Done. Added a line with !head /content/kili-fine-tune.jsonl
| @@ -0,0 +1,2081 @@ | |||
| { | |||
There was a problem hiding this comment.
Line #2. sample_text2 = "Most Of Beijing To Be Tested For COVID-19 Amid Lockdown Worry. While only 70 cases have been found since the outbreak surfaced, authorities have followed a “zero-COVID” approach to try to prevent a further spread of the virus."
remove this line?
Reply via ReviewNB
There was a problem hiding this comment.
Commented out. This is a sample line in case if someone wanted to experiment a bit more.
| @@ -0,0 +1,2081 @@ | |||
| { | |||
There was a problem hiding this comment.
explain that we start at 801 to assign new external ids
you can use the same code I gave above in the notebook, not dict needed for that
Reply via ReviewNB
| @@ -0,0 +1,2081 @@ | |||
| { | |||
There was a problem hiding this comment.
There was a problem hiding this comment.
II agree. Maybe I'll run it by Jean L, just in case.
Jonas1312
changed the title
No description provided.