oxen remote download
now recursively works with directories- Fix create branch logic on server side
- Fix csv parsing with carriage returns
- Improve APIs
- Improve internal error handling
- Improve liboxen crate.io docs
- Bump rust edition to 2021
- Bump all dependencies to latest
- Code organization
- Creating liboxen crates.io package
- API to fetch commit history given a committish base..head
- API to check if commits are mergeable
oxen diff
can take two different files or a committish to compare- Add pagination on output of log command
- Add --head and --tail to
oxen df
command - Better error handling and messages
- Cloning non-existent remote
- Pushing to non-existent remote
- remote df on an empty DataFrame
- Can rename local branch with
oxen branch -m <name>
- Auto detect delimiter for csv's and try to infer
- Can specify delimiter csv files for
oxen df
command with-d
- Can specify delimiter via API for remote df
- Can specify delimiter csv files for
- Add progress bar to
oxen rm
- (#93) Set rocksdb MAX_OPEN_FILES to 128, and allow it to be set via environment variable
- Add
oxen remote ls
command to view what files are on your remote branch
- Fully resolve path for
oxen remote add
command and check if it is in the repo directory before requiring-p
flag - Fix pagination on directories
- Fix
oxen rm -r
with a trailing slash on the directory - Fix error message when trying to push and a remote is not set
- Remote staging area
oxen remote status
oxen remote add file.png
oxen remote commit -m "committing without cloning data"
oxen remote diff path/to/file.png
- Remote DataFrame CLI interface
oxen remote df annotations/train.csv
oxen remote df annotations/train.csv --add-row 'file.png,label'
- DF api on DataFrames where we cannot detect the schema
- Fix cloning an empty remote repo
- Server confirms on push that you are synced to the correct tree
- Speed up restoring commit on checkout
- Fix bug with checking out version files that have not been synced
- Fix bug with adding new api key for host (replaces now instead of append)
- Add instructions / build for x86_64
- Bump dependencies flagged in dependabot
- rocksdb, dotenv, reqwest, time
- Add health endpoint with disk usage info
- Update
oxen rm
to be more consistent withgit rm
functionality- Add
-r
flag to recursively remove directories that have been committed - Add
--staged
flag to remove staged changes that you do not want to commit.
- Add
- Added Windows Support and builds to CI
- Added Mac builds for OSX 11 and OSX 12
- Add support for .oxenignore file
- Fix start server usage message
- Get rid of unnecessary warnings on adding empty csvs
- Features
- Default to pulling
main
on clone and add--shallow
flag
- Default to pulling
- Bug Fixes
- Prevent accidental double push
- Support can unstaging a staged directory
- Features
- Stats endpoint on repo
- Consistent pagination params, page_num -> page
- Better logging
- Upgrade cargo 1.67.0
- Features
- GET requests for downloading data
- Features
- Checks version with oxen-server to verify we have an up to date client
- Bug Fixes
- Fix reading CSVs with quotes and newlines
- Fix page_size and page_num params for DataFrames
- Fix partial pull then full
- Fix pushing to a remote branch you are not currently on
- Features
- Push commit size before syncing data to make sure we have enough remote storage
- Add compute cache post commit to perform operations that we may want to cache per commit
- Update is_synced api to give more detailed information on sync status
- Add disk usage API for a namespace
- Add pagination for data frame api
- Add default for latest commit for an empty directory
- Add retry and sleep for pulling data
- Features
- Schema computation and naming now done in
oxen add
staging area before commit - Oxen Server API Changes
- entry and meta endpoints return resource, version, path and datatype
- Bump polars version
- Support for json and jsonl file schemas
- Add server driven warnings to CLI
- Schema computation and naming now done in
- Bug Fixes
- Infer schema from more lines (100 -> 10,000)
- Features
- Faster data download 🔥
- Chunked download data APIs
-
Features
- Faster data upload 🔥
- Chunked upload data APIs
-
Breaking Changes
- Removed CADF
- Remove
oxen index
commands
- Features
oxen df --unique
oxen rm
- Schema changes
- add "email" to Commit
- changed "timestamp" format on Commit to be RFC3339
- Features
- oxen-server
- HTTP APIs for fetching schemas and data frames
- return more robust metadata on listing directories
- oxen
- support for multi argument filters ie "label == person && is_correct == true"
- support for single or double quotes on aggregations
- oxen-server
- Bug Fixes
- fix restore tabular modified file
- Features
oxen add
accepts multiple values
- Bug fixes
oxen checkout
arg parsingoxen commit
files without extensions
- Bug fixes
- Better logging
- Don't fail silently on remote push
- Bug fixes
- Handle duplicate lines in tabular data files
- Fix
/dir
endpoint when no path is specified - Re-enable
/file
endpoint
- Add more tests to catch tabular data edge cases
oxen df
-a
for aggregations--sort
to sort by a field--reverse
to reverse the order
oxen schemas
create_index
subcommand to create an index on a fieldquery
subcommand to query an index
- Bug fixes on indexing DataFrames
Update oxen restore
oxen restore --staged <pathspec>
will remove a file or directory from stagingoxen restore <pathspec>
now works recursively
Performance Improvements:
oxen add
opening less db connectionsoxen push
faster local delta computation
Better Formatting
- Printing Schemas
Bug Fixes:
oxen pull
progress bar fixes, unpacking fixes- Extra print statements
- Add row level annotation tracking so that you can efficiently compare tabular data
- Add
oxen df
commands to help work with tabular data - Update underlying repository structure to be more efficient per directory and more efficient with tabular data
- Solidify underlying API routes for HTTP server
- Add optional authorization on Oxen Server
- Can delete remote branches