Maniphest T370713

Upgrade to Pyspark ≥ 3.5
Open, MediumPublic
Actions

Assigned To

None

Authored By

	nshahquinn-wmf
	Jul 22 2024, 7:56 PM

Tags

Referenced Files

None

Subscribers

Description

This would allow us to do T370705: Upgrade to Pandas ≥ 2 in Conda-Analytics.

See also

T338057: Upgrade Spark to a version with long term Iceberg support, and with fixes to support Dumps 2.0

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T333013 [Iceberg Migration] Apache Iceberg Migration
		Open		None	T366752 Dumps 2.0 Phase III: Production level dumps
		Open		BTullis	T338057 Upgrade Spark to a version with long term Iceberg support, and with fixes to support Dumps 2.0
		Open		None	T370705 Upgrade to Pandas ≥ 2 in Conda-Analytics
		Open		None	T370713 Upgrade to Pyspark ≥ 3.5

Event Timeline

nshahquinn-wmf created this task.Jul 22 2024, 7:56 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 22 2024, 7:56 PM

nshahquinn-wmf added a parent task: T370705: Upgrade to Pandas ≥ 2 in Conda-Analytics.Jul 22 2024, 7:56 PM

nshahquinn-wmf mentioned this in T356230: Conda-Analytics packages incompatible with latest versions of Pandas and Numpy.

BTullis triaged this task as Medium priority.Aug 8 2024, 2:25 PM

BTullis moved this task from Incoming to Software Upgrades on the Data-Platform-SRE board.

nshahquinn-wmf updated the task description. (Show Details)Oct 15 2024, 7:37 PM

nshahquinn-wmf mentioned this in T338057: Upgrade Spark to a version with long term Iceberg support, and with fixes to support Dumps 2.0.Oct 15 2024, 7:42 PM

Ottomata added a parent task: T338057: Upgrade Spark to a version with long term Iceberg support, and with fixes to support Dumps 2.0.Mon, Nov 4, 5:44 PM