Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PreRelease: v0.1.0 #2

Merged
merged 41 commits into from
Jul 2, 2024
Merged

PreRelease: v0.1.0 #2

merged 41 commits into from
Jul 2, 2024

Commits on Jun 5, 2024

  1. Feature(MInference): build the basic MInference framework

    @iofu728
    iofu728 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    f841592 View commit details
    Browse the repository at this point in the history

  2. Feature(MInference): support InfiniteBench

    @iofu728
    iofu728 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    37cd987 View commit details
    Browse the repository at this point in the history

  3. Feature(MInference): add Needle in A Haystack script

    @iofu728
    iofu728 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    f5e3595 View commit details
    Browse the repository at this point in the history

  4. Feature(MInference): add ppl script

    @iofu728
    iofu728 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    847776d View commit details
    Browse the repository at this point in the history

  5. Feature(MInference): add RULER

    @iofu728
    iofu728 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    5347d8c View commit details
    Browse the repository at this point in the history

  6. Feature(MInference): add benchmark e2e

    @iofu728
    iofu728 committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    adc194f View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Feature(MInference): support vLLM and add examples

    @iofu728
    iofu728 committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    e48038e View commit details
    Browse the repository at this point in the history

  2. Feature(MInference): Use CUDAExtention to build indexing kernel inste… 

    …ad of PyCUDA

Co-authored-by: Chengruidong Zhang <[email protected]>
    @iofu728 @Starmys
    iofu728 and Starmys committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    e28a73c View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2024

  1. Feature(MInference): add benchmark experiments

    @iofu728
    iofu728 committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    e3569ed View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2024

  1. Feature(MInference): add onepage

    @iofu728
    iofu728 committed Jun 8, 2024
    Configuration menu
    Copy the full SHA
    ce133f3 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. experiments documents

    @liyucheng09
    liyucheng09 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    db8998e View commit details
    Browse the repository at this point in the history

  2. Feature(MInference): add search scripts

    @iofu728
    iofu728 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    c354d98 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. Feature(MInference): add streaming example

    @iofu728
    iofu728 committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    7022371 View commit details
    Browse the repository at this point in the history

  2. Feature(MInference): update logo and demo

    @iofu728
    iofu728 committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    a7ac35d View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2024

  1. experiment commands test passed - warning disabled

    @liyucheng09
    liyucheng09 committed Jun 15, 2024
    Configuration menu
    Copy the full SHA
    ed7a439 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2024

  1. Feature(MInference): add FAQ

    @iofu728
    iofu728 committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    6053545 View commit details
    Browse the repository at this point in the history

  2. Feature(MInference): fix the bibtex

    @iofu728
    iofu728 committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    834c6ec View commit details
    Browse the repository at this point in the history

  3. Feature(MInference): add license 

    Co-authored-by: Yucheng Li <[email protected]>
Co-authored-by: Chengruidong Zhang <[email protected]>
    @iofu728 @liyucheng09 @Starmys
    3 people committed Jun 16, 2024
    Configuration menu
    Copy the full SHA
    538e476 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2024

  1. Feature(MInference): support GLM-4 and Qwen2

    @iofu728
    iofu728 committed Jun 23, 2024
    Configuration menu
    Copy the full SHA
    c754284 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Feature(MInference): fix the kv cache cpu bias issue

    @iofu728
    iofu728 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    70f05f9 View commit details
    Browse the repository at this point in the history

  2. Feature(MInference): support kv cache cpu device

    @iofu728
    iofu728 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    a206fb2 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Fix(MInference): fix config get issue

    @iofu728
    iofu728 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    abc5aba View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. Feature(MInference): update experiments details

    @iofu728
    iofu728 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    010b708 View commit details
    Browse the repository at this point in the history

  2. add GLM-4 to RULER

    @liyucheng09
    liyucheng09 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    a4cf850 View commit details
    Browse the repository at this point in the history

  3. Feature(MInference): update logo and T5 sparsity

    @iofu728
    iofu728 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    3cf46d4 View commit details
    Browse the repository at this point in the history

  4. Feature(MInference): update the logo

    @iofu728
    iofu728 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    ce1c243 View commit details
    Browse the repository at this point in the history

  5. Feature(MInference): update the logo

    @iofu728
    iofu728 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    8341e4f View commit details
    Browse the repository at this point in the history

  6. Feature(MInference): update the title

    @iofu728
    iofu728 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    264ea01 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. bug fixed - GLM-4

    @liyucheng09
    liyucheng09 committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    6b401a8 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. bug fix - ruler with StreamingLLM

    @liyucheng09
    liyucheng09 committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    be92526 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2024

  1. patch GLM-4 with InfLLM

    @liyucheng09
    liyucheng09 committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    3743bbe View commit details
    Browse the repository at this point in the history

  2. Feature(MInference): fix the KV retrieval and math find evaluation

    @iofu728
    iofu728 committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    3581688 View commit details
    Browse the repository at this point in the history

  3. Feature(MInference): update FAQ

    @iofu728
    iofu728 committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    9c4b960 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2024

  1. Feature(MInference): update logo

    @iofu728
    iofu728 committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    db22985 View commit details
    Browse the repository at this point in the history

  2. Feature(MInference): update FAQ

    @iofu728
    iofu728 committed Jun 30, 2024
    Configuration menu
    Copy the full SHA
    0aff9c3 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Feature(MInference): update the pip release script, logo, and copyright

    @iofu728
    iofu728 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    fbfd9fb View commit details
    Browse the repository at this point in the history

  2. Feature(MInference): update the example

    @iofu728
    iofu728 committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    882dcc6 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Feature(MInference): add supported models

    @iofu728
    iofu728 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    2c48613 View commit details
    Browse the repository at this point in the history

  2. fix bugs in vllm patch

    @liyucheng09
    liyucheng09 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    ceba21b View commit details
    Browse the repository at this point in the history

  3. Feature(MInference): prepare for release

    @iofu728
    iofu728 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    a9583e0 View commit details
    Browse the repository at this point in the history

  4. Feature(MInference): remove unittest

    @iofu728
    iofu728 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    1c414a4 View commit details
    Browse the repository at this point in the history