Mistral-on-AWS

A collection of notebooks and samples to get started with Mistral models on AWS. Open a PR if you would like to contribute! 🔀

What's New ⭐⭐

• Fine-tune Mixtral 8*7b with PyTorch FSDP and Q-Lora on Amazon SageMaker!

• Leveraging Long Context with Mistral Large 2!

• Latest Releases:

  1. Apply Amazon Bedrock Guardrails to Mistral Large 2
  2. Fine-tune Mixtral 8*7b with PyTorch FSDP and Q-Lora on Amazon SageMaker
  3. Leveraging Mistral Large 2's Long Context Window

Getting Started 🔌

1. Please visit Amazon Bedrock user guide on how to enable model access.
2. The notebooks are executed from SageMaker studio with Data Science 3.0 image.

Security

See CONTRIBUTING for more information.

Distributors

• AWS
• Mistral

License

This library is licensed under the MIT-0 License. See the LICENSE file.