Null Pointer/ Assertion on export weights

Description

Problem:
When setting export_weights_and_biases=True in python h2o a null pointer exception or assertion error occurs.

Temp Fix:
Disabling the exporting of weights and biases makes the error not occur

{{{quote}Checking whether there is an H2O instance running at http://localhost:54321..... not found.
Attempting to start a local H2O server...
Java Version: openjdk version "1.8.0_151"; OpenJDK Runtime Environment (build 1.8.0_151-8u151-b12-0ubuntu0.16.04.2-b12); OpenJDK 64-Bit Server VM (build 25.151-b12, mixed mode)
Starting server from /usr/local/lib/python2.7/dist-packages/h2o/backend/bin/h2o.jar
Ice root: /tmp/tmpSMnFK_
JVM stdout: /tmp/tmpSMnFK_/h2o_ubuntu_started_from_python.out
JVM stderr: /tmp/tmpSMnFK_/h2o_ubuntu_started_from_python.err
Server is running at http://127.0.0.1:54321
Connecting to H2O server at http://127.0.0.1:54321... successful.
-------------------------- ----------------------------------------
H2O cluster uptime: 02 secs
H2O cluster version: 3.16.0.3
H2O cluster version age: 8 days
H2O cluster name: H2O_from_python_ubuntu_btslvo
H2O cluster total nodes: 1
H2O cluster free memory: 26.67 Gb
H2O cluster total cores: 32
H2O cluster allowed cores: 32
H2O cluster status: accepting new members, healthy
H2O connection url: http://127.0.0.1:54321
H2O connection proxy:
H2O internal security: False
H2O API Extensions: XGBoost, Algos, AutoML, Core V3, Core V4
Python version: 2.7.12 final
-------------------------- ----------------------------------------
Parse progress: |█████████████████████████████████████████████████████████████████████████████| 100%
deeplearning Model Build progress: |████████████████████████████▊ (failed) | 49%
Traceback (most recent call last):
File "./project/python-scripts/scripts/runner.py", line 13, in <module>
dl_model.train_model(validate=False)
File "/home/ubuntu/project/python-scripts/models/h2o_deep_learning.py", line 64, in train_model
self.model.train(x=h2o_training.names[:-1], y=h2o_training.names[-1], training_frame=h2o_training)
File "/usr/local/lib/python2.7/dist-packages/h2o/estimators/estimator_base.py", line 208, in train
model.poll(verbose_model_scoring_history=verbose)
File "/usr/local/lib/python2.7/dist-packages/h2o/job.py", line 77, in poll
"\n{}".format(self.job_key, self.exception, self.job["stacktrace"]))
EnvironmentError: Job with key $03017f00000132d4ffffffff$_8b10a08c73ca59324ab104f391084dfc failed with an exception: java.lang.NullPointerException
stacktrace:
java.lang.NullPointerException
at water.Key.compareTo(Key.java:482)
at java.util.Arrays.binarySearch0(Arrays.java:2439)
at java.util.Arrays.binarySearch(Arrays.java:2379)
at water.Scope.exit(Scope.java:45)
at hex.deeplearning.DeepLearning$DeepLearningDriver.buildModel(DeepLearning.java:332)
at hex.deeplearning.DeepLearning$DeepLearningDriver.computeImpl(DeepLearning.java:216)
at hex.ModelBuilder$Driver.compute2(ModelBuilder.java:206)
at hex.deeplearning.DeepLearning$DeepLearningDriver.compute2(DeepLearning.java:209)
at water.H2O$H2OCountedCompleter.compute(H2O.java:1263)
at jsr166y.CountedCompleter.exec(CountedCompleter.java:468)
at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

H2O session _sid_90b6 closed.

Assignee

Pavel Pscheidl

Fix versions

Reporter

James Schneider

Support ticket URL

None

Labels

Affected Spark version

None

Customer Request Type

None

Task progress

None

CustomerVisible

No

Components

Affects versions

Priority

Blocker
Configure