BigBuffers has been deprecated and is replaced internally by CloudBuffers and Unlocal, which we expect to open source.
BigBuffers is a cross platform serialization library architected for maximum memory efficiency and large data sets.
BigBuffers is a fork of FlatBuffers with 64 bit indexes, to supports buffers >2Gb. Both projects allow you to directly access serialized data without parsing/unpacking it first, while still having great forwards/backwards compatibility... but they are not wire-compatible.
Browse our docs directory for more details, including differences.
Primary platforms (in use by maintainers):
- Windows
- MacOS
- Linux
Secondary platforms (maintainers welcome):
- Android
- And any others with a recent C++ compiler.
- C#
- C (use our fork of flatcc in 64-bit mode)
So far we are only using C & C# so have concentrated on modernising these language implementations and have removed unsupported languages from the repo. If you are interested in upgrading the FlatBuffers code to add BigBuffers support for any other languages, please create a PR here. FlatBuffers provides a good starting point for these languages and we would welcome them back into the repo:
- C++
- Go
- Python
- Rust
- JavaScript
- TypeScript
- Dart
- Java
- Lobster
- Lua
- PHP
Submit an issue or PR as per our CONTRIBUTING page.
Please see the Security Policy for reporting vulnerabilities.
BigBuffers, like FlatBuffers, is licensed under the Apache License, Version 2.0. See LICENSE.txt for the full license text.
