Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Suggestion: Gemma 2 9B and 27B. #3

Closed
kaykyr opened this issue Jun 27, 2024 · 2 comments
Closed

Suggestion: Gemma 2 9B and 27B. #3

kaykyr opened this issue Jun 27, 2024 · 2 comments

Comments

@kaykyr
Copy link

kaykyr commented Jun 27, 2024

Imagine how these models could performs even better using SPPO.

@angelahzyuan
Copy link
Collaborator

angelahzyuan commented Jun 30, 2024

Thank you for your suggestions. Check our latest release at https://huggingface.co/UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3. With a 53.27 LC-win rate.

@kaykyr
Copy link
Author

kaykyr commented Jul 2, 2024

I appreciate it! Thanks!

Can you share the code for this 9B model? I intent to do the same for 27B.

@kaykyr kaykyr closed this as completed Jul 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants