Make TPC-DS workflow flexible with dynamic Spark version #1281
Description
Is your feature request related to a problem? Please describe.
Currently, the TPC-DS GitHub workflow uses hardcoded Spark versions, such as:
This leads to issue that the Spark version used in TPC-DS workflow may be inconsistent with the Spark version defined in pom.xml.
Describe the solution you'd like
It would be better to support passing Spark version dynamically.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.