diff --git a/notebooks/drafts/olmo_peft.ipynb b/notebooks/drafts/olmo_peft.ipynb index be64537..d346156 100644 --- a/notebooks/drafts/olmo_peft.ipynb +++ b/notebooks/drafts/olmo_peft.ipynb @@ -48,7 +48,7 @@ "cell_type": "markdown", "metadata": {}, "source": [ - "Next, we set up the [`LoraConfig`](https://huggingface.co/docs/peft/en/package_reference/lora#peft.LoraConfig). This config specifies which layers we apply the LoRA adapters to" + "Next, we set up the [`LoraConfig`](https://huggingface.co/docs/peft/en/package_reference/lora#peft.LoraConfig). This config specifies which layers we apply the LoRA adapters to (`target_modules`); the rank and scaling factor for the adapters (`r` and `lora_alpha`); and the dropout rate (`lora_dropout`)." ] }, {