Kerberos for SW not loading JAAS module

Description

Starting SW with:

$SPARK_HOME/bin/spark-submit --class water.SparklingWaterDriver --conf spark.ext.h2o.kerberos.login=true --conf spark.ext.h2o.user.name=markc --conf spark.ext.h2o.login.conf=/home/markc/kerb.conf assembly/build/libs/sparkling-water-assembly-1.6.8-all.jar

Does not load the JAAS module which is required for Kerberos security through Jetty.
{{03-10 10:21:21.442 127.0.0.1:54325 5314 #r thread INFO: ----- H2O started -----
03-10 10:21:21.469 127.0.0.1:54325 5314 #r thread INFO: Build git branch: rel-turing
03-10 10:21:21.469 127.0.0.1:54325 5314 #r thread INFO: Build git hash: 912599584db78b24b13c8f5f4669dd72aed1b684
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Build git describe: jenkins-rel-turing-7
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Build project version: 3.10.0.7 (latest version: 3.10.4.1)
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Build age: 5 months and 18 days
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Built by: 'jenkins'
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Built on: '2016-09-19 23:29:27'
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO:
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: *** Your H2O version is too old! Please download the latest version 3.10.4.1 from http://h2o.ai/download/ ***
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO:
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Processed H2O arguments: [-name, sparkling-water-markc_-1010099465, -ga_opt_out, -log_level, INFO, -baseport, 54321, -ip, localhost, -log_dir, /home/markc/H2O/sparkling-water-1.6.8/h2ologs]
03-10 10:21:21.470 127.0.0.1:54325 5314 #r thread INFO: Java availableProcessors: 12
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Java heap totalMemory: 981.5 MB
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Java heap maxMemory: 981.5 MB
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Java version: Java 1.8.0_121 (from Oracle Corporation)
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: JVM launch parameters: [-Xms1g, -Xmx1g]
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: OS version: Linux 4.4.0-64-generic (amd64)
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Machine physical memory: 62.11 GB
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: X-h2o-cluster-id: 1489170080520
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: User name: 'markc'
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: Opted out of sending usage metrics.
03-10 10:21:21.471 127.0.0.1:54325 5314 #r thread INFO: IPv6 stack selected: false
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: tun0 (tun0), 172.17.0.241
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: eno1 (eno1), fe80:0:0:0:8acf:cdce:bb5:3d0d%eno1
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: eno1 (eno1), 192.168.1.117
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: lo (lo), 0:0:0:0:0:0:0:1%lo
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Possible IP Address: lo (lo), 127.0.0.1
03-10 10:21:21.472 127.0.0.1:54325 5314 #r thread INFO: Selected H2O.CLOUD_MULTICAST_IF: name:lo (lo) doesn't support multicast
03-10 10:21:21.484 127.0.0.1:54325 5314 #r thread INFO: Internal communication uses port: 54326
03-10 10:21:21.484 127.0.0.1:54325 5314 #r thread INFO: Listening for HTTP and REST traffic on http://127.0.0.1:54325/
03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: H2O cloud name: 'sparkling-water-markc_-1010099465' on localhost/127.0.0.1:54325, discovery address /229.138.64.85:58762
03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: If you have trouble connecting, try SSH tunneling from your local machine (e.g., via port 55555):
03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: 1. Open a terminal and run 'ssh -L 55555:localhost:54325 markc@127.0.0.1'
03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: 2. Point your browser to http://localhost:55555
03-10 10:21:21.501 127.0.0.1:54325 5314 #r thread INFO: Log dir: '/home/markc/H2O/sparkling-water-1.6.8/h2ologs'
03-10 10:21:21.502 127.0.0.1:54325 5314 #r thread INFO: Cur dir: '/home/markc/H2O/sparkling-water-1.6.8'
03-10 10:21:21.509 127.0.0.1:54325 5314 #r thread INFO: Using HDFS configuration from /usr/local/hadoop/conf
03-10 10:21:21.509 127.0.0.1:54325 5314 #r thread INFO: HDFS subsystem successfully initialized
03-10 10:21:21.513 127.0.0.1:54325 5314 #r thread INFO: S3 subsystem successfully initialized
03-10 10:21:21.513 127.0.0.1:54325 5314 #r thread INFO: Flow dir: '/home/markc/h2oflows'
03-10 10:21:21.521 127.0.0.1:54325 5314 #r thread INFO: Cloud of size 1 formed [localhost/127.0.0.1:54325]
03-10 10:21:21.534 127.0.0.1:54325 5314 #r thread INFO: Registered parsers: [GUESS, ARFF, XLS, SVMLight, CSV]
03-10 10:21:21.535 127.0.0.1:54325 5314 #r thread INFO: Registered 0 extensions in: 460mS
03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO: Registered: 129 REST APIs in: 301mS
03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO:
03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO: Open H2O Flow in your web browser: http://127.0.0.1:54325
03-10 10:21:21.836 127.0.0.1:54325 5314 #r thread INFO: }}

Should see a JAAS message if Kerberos is loaded properly
After running:
java -jar h2o.jar -kerberos_login -login_conf /home/markc/kerb.conf -user_name markc

{{03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Multiple local IPs detected:
03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: /172.17.0.241 /192.168.1.117
03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Attempting to determine correct address...
03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Using /192.168.1.117
03-10 10:19:51.789 192.168.1.117:54325 5094 main INFO: Configuring JAASLoginService (with Kerberos)
03-10 10:19:51.849 192.168.1.117:54325 5094 main INFO: Internal communication uses port: 54326
03-10 10:19:51.849 192.168.1.117:54325 5094 main INFO: Listening for HTTP and REST traffic on http://192.168.1.117:54325/}}

Status

Assignee

Jakub Hava

Reporter

Mark Chan

Labels

None

CustomerVisible

No

testcase 1

None

testcase 2

None

testcase 3

None

h2ostream link

None

Affected Spark version

All

AffectedContact

None

AffectedCustomers

None

AffectedPilots

None

AffectedOpenSource

None

Support Assessment

None

Customer Request Type

None

Support ticket URL

None

End date

None

Baseline start date

None

Baseline end date

None

Task progress

None

Task mode

None

Fix versions

Priority

Major
Configure