-
Notifications
You must be signed in to change notification settings - Fork 29k
Pull requests: apache/spark
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[DOCS] Add cross-session note to cache/persist public APIs
DOCS
PYTHON
SQL
#53401
opened Dec 9, 2025 by
yyanyy
Loading…
[SPARK-54647][PYTHON] Support User-Defined Aggregate Functions (UDAF)
PYTHON
SQL
#53400
opened Dec 9, 2025 by
Yicong-Huang
Loading…
[SPARK-54441][INFRA][FOLLOWUP] Save coverage even when an exception is raised
PYTHON
#53399
opened Dec 9, 2025 by
gaogaotiantian
Loading…
[SPARK-54572][PYTHON][FOLLOWUP] Rule out some process and add a warning for zip file
PYTHON
#53398
opened Dec 9, 2025 by
gaogaotiantian
Loading…
[SPARK-54646][BUILD] Upgrade
gcs-connector to 2.2.29
BUILD
#53397
opened Dec 8, 2025 by
dongjoon-hyun
Loading…
[SPARK-54645][BUILD] Upgrade Scala to 2.13.18
BUILD
DOCS
#53396
opened Dec 8, 2025 by
dongjoon-hyun
Loading…
[SPARK-54644][PYTHON][SS][TESTS] Always stop the query before await it
PYTHON
STRUCTURED STREAMING
#53394
opened Dec 8, 2025 by
gaogaotiantian
Loading…
[SPARK-54643][SDP][PYTHON][TESTS] Run missing pyspark pipelines tests in CI
BUILD
PYTHON
#53393
opened Dec 8, 2025 by
sryza
Loading…
[SPARK-54337][PS] Add support for PyCapsule to Pyspark
CORE
PANDAS API ON SPARK
PYTHON
SQL
#53391
opened Dec 8, 2025 by
devin-petersohn
Loading…
[SPARK-54634][SQL] Add clear error message for empty IN predicate
SQL
#53390
opened Dec 8, 2025 by
sahilkumarsingh
Loading…
[WIP][SPARK-54639][PYTHON] Avoid unnecessary Table creation in Arrow serializers
PYTHON
SQL
#53387
opened Dec 8, 2025 by
Yicong-Huang
•
Draft
[SPARK-54411][SS] Introduce Repartition Writer that Support Multi-CF
SQL
STRUCTURED STREAMING
#53386
opened Dec 8, 2025 by
zifeif2
Loading…
[SPARK-54637][CONNECT] Add SQL API test helpers to SparkConnectServerTest
CONNECT
SQL
#53384
opened Dec 8, 2025 by
juliuszsompolski
Loading…
[SPARK-54449][CORE] Storage Memory off heap size should be considered only when off heap is enabled
CORE
#53383
opened Dec 8, 2025 by
VindhyaG
Loading…
[SPARK-54636][BUILD][YARN] Correctly relocate Netty native libs for YARN ESS
BUILD
#53382
opened Dec 8, 2025 by
pan3793
Loading…
[SPARK-54620][SQL][3.5] Add safety check in ObservationManager to avoid Observation blocking
SQL
#53381
opened Dec 8, 2025 by
viirya
Loading…
[SPARK-54632][PYTHON] Add the option to use ruff for lint
BUILD
CONNECT
CORE
ML
PYTHON
SQL
#53378
opened Dec 7, 2025 by
gaogaotiantian
Loading…
[SPARK-54630][SQL] Add date_bucket function for arbitrary interval bucketing of dates
CONNECT
PYTHON
SQL
#53376
opened Dec 7, 2025 by
vinodkc
Loading…
[SPARK-27853][SQL] Enable custom partitioning logic for Dataset via Partitioner
SQL
#53375
opened Dec 7, 2025 by
yushesp
Loading…
[WIP][SPARK-54372][SQL] ANSI mode should reject avg/sum on timestamp types
SQL
#53373
opened Dec 7, 2025 by
ashrithb
Loading…
[SPARK-54629][CONNECT][TEST] Supplement test coverage for getString with BINARY type (UTF-8)
CONNECT
SQL
#53371
opened Dec 7, 2025 by
xu20160924
Loading…
[SPARK-54442][SQL][FOLLOWUP] Add codegen for TIME numeric conversion functions
SQL
#53370
opened Dec 7, 2025 by
vinodkc
Loading…
[SPARK-54583][SS] Add SQLConf to enable use of OffsetMap
SQL
STRUCTURED STREAMING
#53365
opened Dec 6, 2025 by
ericm-db
Loading…
[SPARK-54621][SQL] Merge Into Update Set * preserve nested fields if …coerceNestedTypes is enabled
SQL
#53360
opened Dec 6, 2025 by
szehon-ho
Loading…
[SPARK-54619][PYTHON] Add a sanity check for configuration numbers
CORE
PYTHON
#53359
opened Dec 5, 2025 by
gaogaotiantian
Loading…
Previous Next
ProTip!
Follow long discussions with comments:>50.