Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Plan to remove Spark 2.X in the next release #1196

Open
wudanzy opened this issue Jan 2, 2025 · 2 comments
Open

Plan to remove Spark 2.X in the next release #1196

wudanzy opened this issue Jan 2, 2025 · 2 comments

Comments

@wudanzy
Copy link
Collaborator

wudanzy commented Jan 2, 2025

We are planning to drop the support for Spark 2.4 in the next release.

The last Spark 2.4 release (2.4.8) is back in May 2021.

Please leave any comments if you have any concerns with dropping the support.
@wudanzy wudanzy pinned this issue Jan 2, 2025
@grazy27
Copy link
Contributor

grazy27 commented Jan 19, 2025

Wikipedia says the last supported version for Spark is 3.3, shall we also drop all previous versions including 3.2?
This would simplify codebase significantly

https://en.wikipedia.org/wiki/Apache_Spark#history

@wudanzy
Copy link
Collaborator Author

wudanzy commented Jan 20, 2025

I think that can be our next step, we can have more frequent release in the future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@wudanzy @grazy27