distributed-computing

Making large AI models cheaper, faster and more accessible

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

Automate code & data workflows with interactive Elixir notebooks

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Accelerated deep learning R&D

zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.

Training and serving large-scale neural networks with auto parallelization.

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

A list of papers about distributed consensus.

Open-source software for volunteer computing and grid computing.

Bare bone examples of machine learning in TensorFlow

Microsoft Graph Engine

Master Federated Learning in 2 Hours—Run It on Your PC!

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

Everything about federated learning, including research papers, books, codes, tutorials, videos and beyond