Search results

[SPARK-52980][PYTHON] Support Arrow Python UDTFs

BUILD

CORE

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51692

#51692 In apache/spark;

· allisonwang-db opened on Jul 28, 2025

[SPARK-52976][PYTHON] Fix Python UDF not accepting collated string as input param

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51688

#51688 In apache/spark;

· ilicmarkodb opened on Jul 28, 2025

[SPARK-52844][PYTHON][TESTS] Update black to 24.3.0

BUILD

CONNECT

CORE

DSTREAM

INFRA

ML

MLLIB

PANDAS API ON SPARK

PYTHON

SQL

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51687

#51687 In apache/spark;

· eschcam opened on Jul 28, 2025

[SPARK-52971] [PYTHON] Limit idle Python worker queue size

CORE

PYTHON

Status: Open (in progress).

apache/sparknumber 51684

#51684 In apache/spark;

· craiuconstantintiberiu opened on Jul 28, 2025

[SPARK-52930][CONNECT] Use DataType.Array/Map for Array/Map Literals

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51653

#51653 In apache/spark;

· heyihong opened on Jul 24, 2025

[SPARK-52943][PYTHON] Enable arrow_cast for all pandas UDF eval types

CORE

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51635

#51635 In apache/spark;

· benrobby opened on Jul 23, 2025

[SPARK-51920][SS][PYTHON] Fix composite/nested type in value state for python

PYTHON

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51621

#51621 In apache/spark;

· zeruibao opened on Jul 22, 2025

[WIP][SPARK-52764][PYTHON][ML][CONNECT][TESTS] Retry flaky tests in <code>test_parity_classification</code>

CONNECT

INFRA

ML

PYTHON

Status: Draft (not ready).

apache/sparknumber 51535

#51535 In apache/spark;

· zhengruifeng opened on Jul 17, 2025

[SPARK-52813][CONNECT] Allow DAGs in Spark Connect

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51516

#51516 In apache/spark;

· hvanhovell opened on Jul 16, 2025

[SPARK-52794][PYTHON] Performance improvement of arrow-optimized python UDTF with LocalDataToArrowConversion check

CORE

PYTHON

Status: Draft (not ready).

apache/sparknumber 51479

#51479 In apache/spark;

· asl3 opened on Jul 14, 2025

[SPARK-52449][CONNECT][PYTHON][ML] Make datatypes for Expression.Literal.Map/Array optional

CONNECT

ML

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51473

#51473 In apache/spark;

· heyihong opened on Jul 14, 2025

[SPARK-52669][PySpark]Improvement PySpark choose pythonExec in cluster yarn client mode

PYTHON

Status: Open (in progress).

apache/sparknumber 51357

#51357 In apache/spark;

· gwdgithubnom opened on Jul 3, 2025