Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Petastorm break with pyarrow 13.0 or newer. Stable version of pyarrow is at 16.0 now. #805

Open
LauritsDixen opened this issue May 1, 2024 · 2 comments
Open

Petastorm break with pyarrow 13.0 or newer. Stable version of pyarrow is at 16.0 now. #805

LauritsDixen opened this issue May 1, 2024 · 2 comments

Comments

@LauritsDixen
Copy link

Several parts of pyarrow has changed and deprecated.

Running with 12.0 gives FutureWarnings of using objects that has deprecated since 5.0.0!

Here is such a warning.
/python3.11/site-packages/petastorm/etl/dataset_metadata.py:288: FutureWarning: ParquetDatasetPiece is deprecated as of pyarrow 5.0.0 and will be removed in a future version

Are there any plans of updating?
@selitvin
Copy link
Collaborator

selitvin commented May 3, 2024

I do not actively maintain the project. Would be happy to review a PR if you can put it up.

@westfly
Copy link

westfly commented Jul 9, 2024 •
edited
Loading

#754 this CR is a work-in-progress without implementing new dataset interface

@kiranzo kiranzo mentioned this issue Aug 27, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@westfly @selitvin @LauritsDixen