Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SNOW-992407: Use FileSet module without additional requirements #78

Open
kylejcaron opened this issue Dec 15, 2023 · 2 comments
Open

SNOW-992407: Use FileSet module without additional requirements #78

kylejcaron opened this issue Dec 15, 2023 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@kylejcaron
Copy link

I'm finding the FileSet API really useful for jax/numpyro/pyro model development since I can use a torch dataloader and directly interface with snowflake without having to save anything locally. I'd love to not have to install pandas, sklearn, xgboost, lightgbm, and tensorflow in order to use the fileset api.

It would be great if this could have separate requirements, or be separated out, or have some of the clunky package requirements like those mentioned above be made optional

@github-actions github-actions bot changed the title Use FileSet module without additional requirements SNOW-992407: Use FileSet module without additional requirements Dec 15, 2023
@sfc-gh-wzhao
Copy link
Collaborator

Hi kylecaron,

Currently pandas, sklearn and xgboost are hard requirements, but all others are extra requirements that means unless installing via pip install snowflake-ml-python[lightgbm], pip install snowflake-ml-python[tensorflow] or pip install snowflake-ml-python[all], they won't be installed.

You could use pip install snowflake-ml-python or conda install snowflake-ml-python if you don't want to install these extra dependencies. For details, please refer to our docs at https://docs.snowflake.com/en/developer-guide/snowpark-ml/index#installing-snowpark-ml .

@sfc-gh-sdas
Copy link
Collaborator

are you still working on it? Can you work with dependencies on sklearn and xgboost?

@sfc-gh-dhung sfc-gh-dhung added the enhancement New feature or request label Jun 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants