Skip to content

Files

Latest commit

 

History

History
This branch is 3 commits behind rasbt/LLMs-from-scratch:main.

05_dataset-generation

Generating Datasets for Instruction Finetuning

This folder contains utility code that can be used for generating a dataset for instruction finetuning.

  • llama3-ollama.ipynb: A notebook that creates a synthetic instruction finetuning dataset using Llama 3 and Ollama

  • reflection-gpt4.ipynb: A notebook that implements an instruction dataset refinement step based on reflection-tuning