Dimension reduction algorithms for the MLExchange platform.
To get started, you will need:
First, build the dimension reduction image in terminal:
cd mlex_dimension_reduction
make build_docker
Once built, you can run the following examples:
make UMAP_example
which is equivalend to first make run_docker then python umap_run.py example_umap.yaml.
These examples utilize the information stored in the folder /data. The computed latent vectors will be saved in data/output.
If you are developing this library, there are a few things to note.
- Install development dependencies:
pip install .
pip install ".[dev]"
- Install pre-commit This step will setup the pre-commit package. After this, commits will get run against flake8, black, isort.
pre-commit install
- (Optional) If you want to check what pre-commit would do before commiting, you can run:
pre-commit run --all-files
- To run test cases:
python -m pytest
MLExchange Copyright (c) 2023, The Regents of the University of California, through Lawrence Berkeley National Laboratory (subject to receipt of any required approvals from the U.S. Dept. of Energy). All rights reserved.
If you have questions about your rights to use or distribute this software, please contact Berkeley Lab's Intellectual Property Office at [email protected].
NOTICE. This Software was developed under funding from the U.S. Department of Energy and the U.S. Government consequently retains certain rights. As such, the U.S. Government has been granted for itself and others acting on its behalf a paid-up, nonexclusive, irrevocable, worldwide license in the Software to reproduce, distribute copies to the public, prepare derivative works, and perform publicly and display publicly, and to permit others to do so.