Pysparkling 2.1 fails on parsing PySpark version

Description

Repro:
1. use mr-0xd1
2. use spark-2.1.0-hadoop2.6
3. use latest Sparkling Water 2.1: https://s3.amazonaws.com/h2o-release/sparkling-water/spark-2.1/3.26.5-2.1/sparkling-water-3.26.5-2.1.zip
4. Run python:

 

The problem

The problem is in VersionComponents code where the regex to parse PySpark version does not expect + sign in the version: match = re.search(r"^((\d+).(\d+)).(\d+)(.([0-9A-Za-z]+))?$", version) will not match 2.1.0+hadoop2.6`

 

Status

Assignee

Jakub Hava

Reporter

Michal Malohlava

Labels

CustomerVisible

No

testcase 1

None

testcase 2

None

testcase 3

None

h2ostream link

None

Affected Spark version

None

AffectedContact

None

AffectedCustomers

None

AffectedPilots

None

AffectedOpenSource

None

Support Assessment

None

Customer Request Type

None

Support ticket URL

End date

None

Baseline start date

None

Baseline end date

None

Task progress

None

Task mode

None

Fix versions

Priority

Major
Configure