Name		Name	Last commit message	Last commit date
parent directory ..
assets		assets
jupyter		jupyter
Preprocess.py		Preprocess.py
README.md		README.md
ReadDataset.py		ReadDataset.py
docker-compose.yml		docker-compose.yml
lakeFS Hugging Face Mount Demo.ipynb		lakeFS Hugging Face Mount Demo.ipynb
lakeFS Mount Demo with Git Integration.ipynb		lakeFS Mount Demo with Git Integration.ipynb
lakeFS Mount Demo.ipynb		lakeFS Mount Demo.ipynb
predict.py		predict.py
train.py		train.py

README.md

Fast Data Loading and Reproducibility for Deep Learning Workloads with lakeFS Mount

Start by ⭐️ starring lakeFS open source project.

This demo includes a Jupyter Notebook which you can run on your local machine.

Docker installed on your local machine
Watch this video to understand the use case as well as the demo.
Contact lakeFS to get the lakeFS Everest binary for Linux x86_64 OS. Download and save the binary on your laptop.
OPTIONAL: Contact lakeFS to get the token for Fluffy if you want to provision lakeFS Enterprise server.

Start by cloning this repository:

git clone https://github.com/treeverse/lakeFS-samples && cd lakeFS-samples/01_standalone_examples/lakefs-mount-demo

You now have two options:

Run a Jupyter Notebook server with your existing lakeFS Server

If you have already installed lakeFS or are utilizing lakeFS cloud, all you need to run is the Jupyter notebook server:
```
docker compose up
```
Once you've finished, run the following to remove all the containers:
```
docker compose down
```
Don't have a lakeFS Server or Object Store?

If you want to provision a lakeFS Enterprise server as well as MinIO for your object store, plus Jupyter then first login to Treeverse Dockerhub by using the granted token so Fluffy proprietary image can be retrieved:
```
docker login -u externallakefs
```
then bring up the full stack:
```
docker compose --profile local-lakefs-enterprise up
```
Copy the Everest binary for Linux x86_64 OS on your laptop inside

"lakeFS-samples/01_standalone_examples/lakefs-mount-demo" folder.

JupyterLab UI http://localhost:8892/
lakeFS Enterprise (if provisioned) http://localhost:8084/ (AKIAIOSFOLKFSSAMPLES / wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY)
MinIO (if provisioned) http://localhost:9005/ (minioadmin/minioadmin)

Demo includes following 3 notebooks. Open any notebook from the JupyterLab UI and follow the instructions.

"lakeFS Mount Demo" notebook demonstrates how to mount lakeFS datasets on laptop or server as local filesystem.
"lakeFS Mount Demo with Git Integration" notebook demonstrates lakeFS Mount feature as well as how it integrates with Git. In this demo, Git is used to version control your code while lakeFS is used to version control your data and model.
"lakeFS Hugging Face Mount Demo" notebook demonstrates lakeFS Mount feature but uses Hugging Face dataset.