Skip to content

@EleutherAI EleutherAI

Change the repository type filter

All

    Repositories list

    162 repositories

    • delphi

      Public
      Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models know themselves through automated interpretability.
      Python
      •
      Apache License 2.0
      •25•169•4•2•Updated Apr 23, 2025Apr 23, 2025

    • open-r1

      Public
      Fully open reproduction of DeepSeek-R1
      Python
      •
      Apache License 2.0
      •2.2k•1•0•0•Updated Apr 22, 2025Apr 22, 2025

    • sparsify

      Public
      Sparsify transformers with SAEs and transcoders
      Python
      •
      MIT License
      •70•520•0•0•Updated Apr 22, 2025Apr 22, 2025

    • elk

      Public
      Keeping language models honest by directly eliciting knowledge encoded in their activations.
      Python
      •
      MIT License
      •33•199•15•10•Updated Apr 21, 2025Apr 21, 2025

    • gpt-neox

      Public
      An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
      transformerslanguage-modelgpt-3deepspeed-library
      Python
      •
      Apache License 2.0
      •1k•7.2k•64•26•Updated Apr 20, 2025Apr 20, 2025

    • lm-evaluation-harness

      Public
      A framework for few-shot evaluation of language models.
      transformerlanguage-modelevaluation-framework
      Python
      •
      MIT License
      •2.3k•8.7k•379•116•Updated Apr 18, 2025Apr 18, 2025

    • POSER

      Public
      Poser: Unmasking Alignment Faking LLMs by Manipulating Their Internals
      Python
      •1•1•0•0•Updated Apr 18, 2025Apr 18, 2025

    • rllm

      Public
      Democratizing Reinforcement Learning for LLMs
      Jupyter Notebook
      •
      MIT License
      •285•0•0•0•Updated Apr 16, 2025Apr 16, 2025

    • Megatron-LM

      Public
      Ongoing research training transformer models at scale
      Python
      •
      Other
      •2.7k•0•0•0•Updated Apr 15, 2025Apr 15, 2025

    • tyche

      Public
      Precisely estimating the volume of basins in neural net parameter space corresponding to interpretable behaviors
      Jupyter Notebook
      •
      Apache License 2.0
      •0•6•0•0•Updated Apr 9, 2025Apr 9, 2025

    • rtopk

      Public
      https://github.com/xiexi51/RTopK PyTorch wrapper
      Cuda
      •
      MIT License
      •0•1•0•0•Updated Apr 5, 2025Apr 5, 2025

    • DeeperSpeed

      Public
      DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
      Python
      •
      Apache License 2.0
      •4.3k•166•0•1•Updated Apr 1, 2025Apr 1, 2025

    • ccs

      Public
      Python
      •
      MIT License
      •6•6•1•4•Updated Mar 21, 2025Mar 21, 2025

    • mixture-of-depths

      Public
      MIT License
      •0•0•0•0•Updated Mar 17, 2025Mar 17, 2025

    • pythia

      Public
      The hub for EleutherAI's work on interpretability and learning dynamics
      Jupyter Notebook
      •
      Apache License 2.0
      •183•2.5k•26•5•Updated Mar 13, 2025Mar 13, 2025

    • cookbook

      Public
      Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
      Python
      •
      Apache License 2.0
      •40•786•9•0•Updated Mar 3, 2025Mar 3, 2025

    • cupbearer

      Public
      A library for mechanistic anomaly detection
      Jupyter Notebook
      •
      MIT License
      •10•6•0•0•Updated Feb 26, 2025Feb 26, 2025

    • clearnets

      Public
      Python
      •
      MIT License
      •0•4•0•0•Updated Feb 18, 2025Feb 18, 2025

    • polyapprox

      Public
      Closed-form polynomial approximations to neural networks
      Python
      •
      MIT License
      •0•12•0•0•Updated Jan 31, 2025Jan 31, 2025

    • transformer-reasoning

      Public
      Experiments in transformer knowledge and reasoning
      Jupyter Notebook
      •
      MIT License
      •19•10•0•0•Updated Jan 30, 2025Jan 30, 2025

    • TransformerEngine

      Public
      A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
      Python
      •
      Apache License 2.0
      •407•0•0•0•Updated Jan 29, 2025Jan 29, 2025

    • sae_overlap

      Public
      Acompanying code for our research on SAE feature overlap when trained on different seeds.
      Jupyter Notebook
      •
      Apache License 2.0
      •1•3•0•0•Updated Jan 28, 2025Jan 28, 2025

    • mdl

      Public
      Minimum Description Length probing for neural network representations
      Python
      •
      MIT License
      •2•19•0•2•Updated Jan 28, 2025Jan 28, 2025

    • aria-utils

      Public
      MIDI tokenizers and pre-processing utils.
      Python
      •
      Apache License 2.0
      •1•1•0•0•Updated Jan 27, 2025Jan 27, 2025

    • concept-erasure

      Public
      Erasing concepts from neural representations with provable guarantees
      Python
      •
      MIT License
      •15•227•3•2•Updated Jan 27, 2025Jan 27, 2025

    • aria

      Public
      Python
      •
      Apache License 2.0
      •11•46•0•0•Updated Dec 24, 2024Dec 24, 2024

    • ngrams-across-time

      Public
      Jupyter Notebook
      •
      MIT License
      •0•4•0•0•Updated Dec 14, 2024Dec 14, 2024

    • website

      Public
      New website for EleutherAI based on Hugo static site generator
      HTML
      •5•4•0•2•Updated Dec 12, 2024Dec 12, 2024

    • training-jacobian

      Public
      Jupyter Notebook
      •
      Apache License 2.0
      •2•21•0•0•Updated Dec 11, 2024Dec 11, 2024

    • aria-amt

      Public
      Efficient and robust implementation of seq-to-seq automatic piano transcription.
      Python
      •
      Apache License 2.0
      •9•36•0•0•Updated Dec 2, 2024Dec 2, 2024