Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Adds Cleanlab Studio Beta API functionality. This API will be used to upload datasets and run experimental jobs for customer POCs.
The main class that users will interact with is the
StudioBeta
class. This class has methods to upload datasets, run jobs, download results from a job, and list a user's datasets/jobs. TheBetaDataset
andBetaJob
classes provide information about a dataset/job and some methods to interact w/ the dataset/job.How to test
The experimental API is fully functional in staging. If you enable the
TEMPLATE_JOB_ENABLED
feature flag for yourself in staging, you can test running the job definition named "template" by running the following (can also test that you get an error if you try to run the job without the feature flag enabled):You can also test listing datasets and jobs: