Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Support for Gemini Models – Leverage Larger Context Windows and Cost Benefits #475

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

pcontact
Copy link

Description:

Overview:
This PR introduces support for Gemini models, which offer larger context windows and reduced costs. These benefits enable developers to provide more detailed instructions (prompts) to guide the agents, enhancing overall performance.

Changes Made:

  • New GeminiConfig:

    • Added a new GeminiConfig class in camel/config.py that removes the unsupported logit_bias argument. This change addresses the ticket regarding Gemini models’ incompatibility with logit_bias.
  • Updated Files:

    • Modified files to integrate Gemini model support:
      • camel/agents/chat_agent.py
      • camel/configs.py
      • camel/model_backend.py
      • camel/typing.py
      • camel/utils.py
      • run.py

Rationale:
Gemini models are chosen for their ability to handle larger context windows, allowing more extensive and precise prompt instructions. Their lower cost also makes them an attractive option, facilitating better guidance for agents without increasing expenses.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant