Sparkling Shell scripts for Windows do not work

Description

See: http://stackoverflow.com/questions/42385855/spark-shell-the-filename-directory-name-or-volume-label-syntax-is-incorrect
and also
http://stackoverflow.com/questions/42385017/input-line-is-too-long-spark
and also
http://stackoverflow.com/questions/42669040/h2o-package-not-found-scala-sparkling-water


Update:

  • finally got it to work on my windows 7 machine

  • spark-shell —jars is buggy

  • used spark.driver.extraClassPath and spark.executor.extraClassPath properties in conf file

  • spark.driver.extraClassPath C:\\\Users\\wen\\sparkling-water-2.1.0\\assembly\\build\\libs
    sparkling-water-assembly_2.11-2.1.0-all.jar

  • spark.executor.extraClassPath C:\\\Users\\wen\\sparkling-water-2.1.0\\assembly\\build\\libs
    sparkling-water-assembly_2.11-2.1.0-all.jar

  • Spark bug report: https://issues.apache.org/jira/browse/SPARK-18648

Status

Assignee

Michal Malohlava

Reporter

Michal Malohlava

Labels

None

CustomerVisible

No

testcase 1

None

testcase 2

None

testcase 3

None

h2ostream link

None

Affected Spark version

None

AffectedContact

None

AffectedCustomers

None

AffectedPilots

None

AffectedOpenSource

None

Support Assessment

None

Customer Request Type

None

Support ticket URL

None

End date

None

Baseline start date

None

Baseline end date

None

Task progress

None

Task mode

None

Fix versions

Priority

Major
Configure