Uploaded image for project: 'SW'
  1. SW-349

Sparkling Shell scripts for Windows do not work

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.9, 2.0.6, 2.1.1
    • Component/s: None
    • Labels:
      None
    • CustomerVisible:
      No
    • Sprint:

      Description

      See: http://stackoverflow.com/questions/42385855/spark-shell-the-filename-directory-name-or-volume-label-syntax-is-incorrect
      and also
      http://stackoverflow.com/questions/42385017/input-line-is-too-long-spark
      and also
      http://stackoverflow.com/questions/42669040/h2o-package-not-found-scala-sparkling-water


      Update:

      • finally got it to work on my windows 7 machine
      • spark-shell —jars is buggy
      • used spark.driver.extraClassPath and spark.executor.extraClassPath properties in conf file
      • spark.driver.extraClassPath C:\\\Users\\wen\\sparkling-water-2.1.0\\assembly\\build\\libs
        sparkling-water-assembly_2.11-2.1.0-all.jar
      • spark.executor.extraClassPath C:\\\Users\\wen\\sparkling-water-2.1.0\\assembly\\build\\libs
        sparkling-water-assembly_2.11-2.1.0-all.jar
      • Spark bug report: https://issues.apache.org/jira/browse/SPARK-18648

        Attachments

          Issue links

            Activity

              People

              • Assignee:
                michal Michal Malohlava
                Reporter:
                michal Michal Malohlava
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: