Discussions

• 1 You must be logged in to vote

  🙏

  DPO on Mistral Instruct model

  RishabhMaheshwary asked Jul 13, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  google/gemma-2-27b-it QLORA

  CyberNativeAI asked Jul 12, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to finetune DeepSeek-v2 236B

  Jiayi-Pan asked Jul 11, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Adapt custom llama2_chat tokenize to work with llama3

  LeDuySon asked Jul 2, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  Can I use AutoModelForSequenceClassification?

  cristobalmackenzie asked Jul 1, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Problem Launching Training for LLaMA-3 with KTO Strategy

  sklyar61 asked Jun 18, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Train For Language translation

  nichellehouston asked May 7, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Issue with Decoding Preprocessed Data

  sklyar61 asked Jun 7, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Gemma Qlora Error : 'GemmaConfig' object has no attribute 'mlp_bias'

  hanhee1126 asked Jun 1, 2024 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  What happens if there are null values in the dataset?

  mlmonk asked May 17, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Continue the pre-training step

  miguelwon asked Apr 19, 2024 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Why is it recommend to set load_in_8bit: true for LORA finetuning?

  rudolpheric asked May 12, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  how to "Load different dataset formats, use custom formats"

  johnnyhansen-away asked Mar 25, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  SIGBUS error while using multiprocessor training.

  shahzaibbaig123 asked May 5, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Lora & push merged model to HF

  noelo asked Apr 29, 2024 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  DPO doesn't work with inference

  cinjon asked Apr 29, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Why does Wandb revert to a single dot at the end?

  cinjon asked Apr 25, 2024 in Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  🙏

  LLaMA-3-8B FFT with FDSP (2x4090s)

  s-smits asked Apr 24, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  A random doubt regarding using fineutned model

  chiragbrudite asked Apr 24, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  how can i finetune lora with local dataset file?

  genesiz7 asked Apr 23, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  multi GPU, where every gpu is different

  draganjovanovich asked Apr 21, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  It really sucks that gptq lora training is always broken in this repo.

  markrmiller started Apr 21, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Fine-Tuning Llama-3-70B with QLora: Is 8 H100 80GB SXM5 Overkill?

  monk1337 asked Apr 20, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Axolotl for Base Model Inference

  Maaalik asked Apr 18, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  ChatML format with Inference mode?

  cinjon asked Apr 17, 2024 in Q&A · Unanswered

  

  

  0