Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug] HybridCache not subscriptable #1047

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

[Bug] HybridCache not subscriptable #1047

wants to merge 7 commits into from

Commits on Oct 10, 2024

  1. reset cache

    @hudson-ai
    hudson-ai committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    55f55a1 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. use crop when we can, get past_length via get_seq_length

    @hudson-ai
    hudson-ai committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    94c61a1 View commit details
    Browse the repository at this point in the history

  2. additionally reset cache if we are overflowing it...

    @hudson-ai
    hudson-ai committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    8e20e09 View commit details
    Browse the repository at this point in the history

  3. use built-in reset method when available

    @hudson-ai
    hudson-ai committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    78dbb79 View commit details
    Browse the repository at this point in the history

  4. Double cache size when we can instead of just resetting

    @hudson-ai
    hudson-ai committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    a5d5e75 View commit details
    Browse the repository at this point in the history

  5. remap hf_device_map

    @hudson-ai
    hudson-ai committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    99fbdb9 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Merge branch 'main' into transformers_cache

    @hudson-ai
    hudson-ai authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    8d17370 View commit details
    Browse the repository at this point in the history