Uploaded image for project: 'SW'
  1. SW-353

Kerberos for SW not loading JAAS module

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.3, 2.0.7, 1.6.9
    • Component/s: None
    • Labels:
      None
    • CustomerVisible:
      No
    • Sprint:
    • Affected Spark version:
      All

      Description

      Starting SW with:

      $SPARK_HOME/bin/spark-submit --class water.SparklingWaterDriver --conf spark.ext.h2o.kerberos.login=true --conf spark.ext.h2o.user.name=markc --conf spark.ext.h2o.login.conf=/home/markc/kerb.conf assembly/build/libs/sparkling-water-assembly-1.6.8-all.jar

      Does not load the JAAS module which is required for Kerberos security through Jetty.
      {{03-10 10:21:21.442 127.0.0.1:54325 5314 #r thread INFO: ----- H2O started -----
      03-10 10:21:21.469 127.0.0.1:54325 5314 #r thread INFO: Build git branch: rel-turing
      03-10 10:21:21.469 127.0.0.1:54325 5314 #r thread INFO: Build git hash: 912599584db78b24b13c8f5f4669dd72aed1b684
      03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Build git describe: jenkins-rel-turing-7
      03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Build project version: 3.10.0.7 (latest version: 3.10.4.1)
      03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Build age: 5 months and 18 days
      03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Built by: 'jenkins'
      03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Built on: '2016-09-19 23:29:27'
      03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO:
      03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: *** Your H2O version is too old! Please download the latest version 3.10.4.1 from http://h2o.ai/download/ ***
      03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO:
      03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Processed H2O arguments: [-name, sparkling-water-markc_-1010099465, -ga_opt_out, -log_level, INFO, -baseport, 54321, -ip, localhost, -log_dir, /home/markc/H2O/sparkling-water-1.6.8/h2ologs]
      03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Java availableProcessors: 12
      03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Java heap totalMemory: 981.5 MB
      03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Java heap maxMemory: 981.5 MB
      03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Java version: Java 1.8.0_121 (from Oracle Corporation)
      03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: JVM launch parameters: -Xms1g, -Xmx1g
      03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: OS version: Linux 4.4.0-64-generic (amd64)
      03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Machine physical memory: 62.11 GB
      03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: X-h2o-cluster-id: 1489170080520
      03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: User name: 'markc'
      03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Opted out of sending usage metrics.
      03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: IPv6 stack selected: false
      03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: tun0 (tun0), 172.17.0.241
      03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: eno1 (eno1), fe80:0:0:0:8acf:cdce:bb5:3d0d%eno1
      03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: eno1 (eno1), 192.168.1.117
      03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: lo (lo), 0:0:0:0:0:0:0:1%lo
      03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: lo (lo), 127.0.0.1
      03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Selected H2O.CLOUD_MULTICAST_IF: name:lo (lo) doesn't support multicast
      03-10 10:21:21.484 127.0.0.1:54325 5314 #r thread INFO: Internal communication uses port: 54326
      03-10 10:21:21.484 127.0.0.1:54325 5314 #r thread INFO: Listening for HTTP and REST traffic on http://127.0.0.1:54325/
      03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: H2O cloud name: 'sparkling-water-markc_-1010099465' on localhost/127.0.0.1:54325, discovery address /229.138.64.85:58762
      03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: If you have trouble connecting, try SSH tunneling from your local machine (e.g., via port 55555):
      03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: 1. Open a terminal and run 'ssh -L 55555:localhost:54325 markc@127.0.0.1'
      03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: 2. Point your browser to http://localhost:55555
      03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: Log dir: '/home/markc/H2O/sparkling-water-1.6.8/h2ologs'
      03-10 10:21:21.502 127.0.0.1:54325 5314 #r thread INFO: Cur dir: '/home/markc/H2O/sparkling-water-1.6.8'
      03-10 10:21:21.509 127.0.0.1:54325 5314 #r thread INFO: Using HDFS configuration from /usr/local/hadoop/conf
      03-10 10:21:21.509 127.0.0.1:54325 5314 #r thread INFO: HDFS subsystem successfully initialized
      03-10 10:21:21.513 127.0.0.1:54325 5314 #r thread INFO: S3 subsystem successfully initialized
      03-10 10:21:21.513 127.0.0.1:54325 5314 #r thread INFO: Flow dir: '/home/markc/h2oflows'
      03-10 10:21:21.521 127.0.0.1:54325 5314 #r thread INFO: Cloud of size 1 formed localhost/127.0.0.1:54325
      03-10 10:21:21.534 127.0.0.1:54325 5314 #r thread INFO: Registered parsers: GUESS, ARFF, XLS, SVMLight, CSV
      03-10 10:21:21.535 127.0.0.1:54325 5314 #r thread INFO: Registered 0 extensions in: 460mS
      03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO: Registered: 129 REST APIs in: 301mS
      03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO:
      03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO: Open H2O Flow in your web browser: http://127.0.0.1:54325
      03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO: }}

      Should see a JAAS message if Kerberos is loaded properly
      After running:
      java -jar h2o.jar -kerberos_login -login_conf /home/markc/kerb.conf -user_name markc

      {{03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Multiple local IPs detected:
      03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: /172.17.0.241 /192.168.1.117
      03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Attempting to determine correct address...
      03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Using /192.168.1.117
      03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Configuring JAASLoginService (with Kerberos)
      03-10 10:19:51.849 192.168.1.117:54325 5094 main INFO: Internal communication uses port: 54326
      03-10 10:19:51.849 192.168.1.117:54325 5094 main INFO: Listening for HTTP and REST traffic on http://192.168.1.117:54325/}}

        Attachments

          Activity

            People

            • Assignee:
              Kuba Jakub Hava
              Reporter:
              markc Mark Chan
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: