New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Initial Polars support #1576

Open

richard-rogers wants to merge 48 commits into mainline from dev/richard/polars

Contributor

richard-rogers commented Oct 18, 2024 •

edited

Loading

Description

Support for logging Polars data frames.

Closes #1230

I have reviewed the Guidelines for Contributing and the Code of Conduct.

richard-rogers requested a review from jamie256

October 18, 2024 04:39

richard-rogers marked this pull request as draft

October 18, 2024 04:41

richard-rogers commented

View reviewed changes

.github/workflows/whylogs-ci.yml Outdated Show resolved Hide resolved

richard-rogers and others added 12 commits

November 5, 2024 15:32


          Initial Polars support

de3a8cb


          segments and udfs

9d60022


          make UDF pandas and polars tests work at the same time

66abf26


          work

b5bf95c


          pre-commit

b479979


          pre-commit

b974fbd

CI

1aad5ee


          allow 3.7

9243c6d


          Update .github/workflows/whylogs-ci.yml

dac3ecd


          skip polars in python 3.7

1ecb94f


          polars metric tests

ea0cce2


          fix docs

2e26e4e

richard-rogers force-pushed the dev/richard/polars branch from 4a92544 to 2e26e4e Compare

November 5, 2024 16:14

richard-rogers added 3 commits

November 5, 2024 18:59


          Merge branch 'mainline' into dev/richard/polars

303c78b


          Merge branch 'mainline' into dev/richard/polars

634aa08


          Merge branch 'mainline' into dev/richard/polars

74928ea

richard-rogers commented

View reviewed changes

python/tests/api/logger/test_logger_polars.py Outdated Show resolved Hide resolved


          Update python/tests/api/logger/test_logger_polars.py

89a649d

richard-rogers commented

View reviewed changes

python/tests/api/logger/test_logger_polars.py Outdated Show resolved Hide resolved


          Update python/tests/api/logger/test_logger_polars.py

9e66091

richard-rogers commented

View reviewed changes

python/tests/api/logger/test_logger_polars.py Outdated Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/tests/api/logger/test_logger_polars.py Outdated Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/tests/api/logger/test_logger_polars.py Outdated Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/tests/api/logger/test_logger_polars.py Outdated Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/tests/api/logger/test_logger_polars.py Outdated Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/tests/api/logger/test_logger_polars.py Outdated Show resolved Hide resolved


          Update python/tests/api/logger/test_logger_polars.py

6209bfd


          Update python/tests/core/metrics/test_metrics_polars.py

15c807c

richard-rogers commented

View reviewed changes

python/tests/core/test_performance_polars.py Outdated Show resolved Hide resolved


          Update python/tests/core/test_performance_polars.py

78e4a71

richard-rogers commented

View reviewed changes

python/tests/experimental/core/test_udf_schema_polars.py Outdated Show resolved Hide resolved


          Update python/tests/experimental/core/test_udf_schema_polars.py

bb4ec84

richard-rogers commented

View reviewed changes

python/tests/experimental/core/test_udf_schema_polars.py Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/tests/experimental/core/test_udf_schema_polars.py Outdated Show resolved Hide resolved


          Update python/tests/experimental/core/test_udf_schema_polars.py

82e9646

richard-rogers commented

View reviewed changes

python/whylogs/api/logger/__init__.py Outdated Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/whylogs/core/dataframe_wrapper.py Outdated Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/whylogs/core/dataframe_wrapper.py Outdated Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/whylogs/core/datatypes.py Outdated Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/whylogs/core/preprocessing.py Show resolved Hide resolved

richard-rogers commented

View reviewed changes

python/whylogs/experimental/core/udf_schema.py

                       except Exception as e:  # noqa
-                          new_df[new_col] = pd.Series([None])
+                          new_df[new_col] = df.apply_udf(lambda x: float("nan"))  # should be None, but can't infer type

Contributor Author

richard-rogers Nov 7, 2024

It might be better to just leave out the failed UDF's output column.

richard-rogers added 2 commits

November 7, 2024 05:56


          test fix

290cc62


          refactor

e5831a0

richard-rogers marked this pull request as ready for review

November 12, 2024 22:54


          Merge branch 'mainline' into dev/richard/polars

ed79946

richard-rogers commented

View reviewed changes

python/.pre-commit-config.yaml Outdated Show resolved Hide resolved

richard-rogers and others added 4 commits

November 14, 2024 00:31


          pre-commit


          pre-commit

2866ede


          Merge branch 'mainline' into dev/richard/polars

cd21e2d


          Merge branch 'mainline' into dev/richard/polars

74490c5

jamie256 reviewed

View reviewed changes

Contributor

jamie256 left a comment

Dependencies question about setuptools

python/pyproject.toml Outdated Show resolved Hide resolved

jamie256 and others added 6 commits

December 10, 2024 11:14


          Merge branch 'mainline' into dev/richard/polars

8d2846d


          move setup dependency

f2900b1


          use pandas stubs

6cf62bb


          Update python/whylogs/core/dataframe_wrapper.py

190b098


          Update python/whylogs/core/datatypes.py

3ec799e


          dont use stubs

dad1d17

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet