Uploaded image for project: 'Public H2O 2 [OLD]'
  1. OLD-441

NPE in fvec parse on 164 on multiple gz files

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: ParseFVec
    • Labels:
    • CustomerVisible:
      No
    • Sprint:
      H2O Sprint 6

      Description

      doing a multi-file gz parse of the standard files on 164
      with pattern matching to get multiple files

      import_only: /home4/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_fvec.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*10-40-9.dat.gz
      Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*10-40-9.dat.gz
      If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*10-40-9.dat.gz

      parse parameters:

      {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'}

      http://192.168.1.164:8080/view/h2o_release_tests/job/h2o_release_tests_164/320/testReport/junit/test_c3_fvec/releaseTest/test_B_c3_fvec_long_2/

      Error Message

      check_sandbox_for_errors: Errors in sandbox stdout or stderr (or R stdout/stderr).
      Could have occurred at any prior time

      java.lang.NullPointerException
      04:00:35.349 FJ-16-9 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:74)
      04:00:35.349 FJ-16-9 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:713)
      04:00:35.349 FJ-16-9 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      04:00:35.348 # Session ERRR WATER:
      + java.util.concurrent.ExecutionException: java.lang.NullPointerException
      + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961)
      + at water.Futures.blockForPending(Futures.java:67)
      + at water.fvec.Frame.vecs(Frame.java:81)
      + at water.Value.isRawData(Value.java:245)
      + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90)
      + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65)
      + at water.api.RequestArguments$Argument.check(RequestArguments.java:551)
      + at water.api.RequestQueries.checkArguments(RequestQueries.java:69)
      + at water.api.Request.serveGrid(Request.java:125)
      + at water.api.Request.serve(Request.java:108)
      + at water.api.RequestServer.serve(RequestServer.java:315)
      + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421)
      + at java.lang.Thread.run(Thread.java:662)
      + Caused by: java.lang.NullPointerException
      + at water.fvec.Frame$1.compute2(Frame.java:74)
      + at water.H2O$H2OCountedCompleter.compute(H2O.java:713)
      + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:00:35.351 FJ-16-9 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

      Stacktrace

      Traceback (most recent call last):
      File "/usr/lib/python2.7/unittest/case.py", line 356, in run
      self.tearDown()
      File "../h2o_common.py", line 82, in tearDown
      h2o.check_sandbox_for_errors()
      File "../h2o.py", line 734, in check_sandbox_for_errors
      python_test_name=python_test_name)
      File "../h2o_sandbox.py", line 176, in check_sandbox_for_errors
      raise Exception(errorMessage)
      Exception: check_sandbox_for_errors: Errors in sandbox stdout or stderr (or R stdout/stderr).
      Could have occurred at any prior time

      java.lang.NullPointerException
      04:00:35.349 FJ-16-9 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:74)
      04:00:35.349 FJ-16-9 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:713)
      04:00:35.349 FJ-16-9 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      04:00:35.348 # Session ERRR WATER:
      + java.util.concurrent.ExecutionException: java.lang.NullPointerException
      + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961)
      + at water.Futures.blockForPending(Futures.java:67)
      + at water.fvec.Frame.vecs(Frame.java:81)
      + at water.Value.isRawData(Value.java:245)
      + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90)
      + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65)
      + at water.api.RequestArguments$Argument.check(RequestArguments.java:551)
      + at water.api.RequestQueries.checkArguments(RequestQueries.java:69)
      + at water.api.Request.serveGrid(Request.java:125)
      + at water.api.Request.serve(Request.java:108)
      + at water.api.RequestServer.serve(RequestServer.java:315)
      + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421)
      + at java.lang.Thread.run(Thread.java:662)
      + Caused by: java.lang.NullPointerException
      + at water.fvec.Frame$1.compute2(Frame.java:74)
      + at water.H2O$H2OCountedCompleter.compute(H2O.java:713)
      + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:00:35.351 FJ-16-9 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

      Standard Output

      Appending to benchmark_test_c3_fvec.py.log. Between tests, you may want to delete it if it gets too big
      Using .gz'ed files in manyfiles-nflx-gz
      Found h2o_nodes0.h2o_remote_buckets_root: /home/0xcustomer

      import_only: /home4/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_fvec.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*10-40-9.dat.gz
      Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*10-40-9.dat.gz
      If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*10-40-9.dat.gz

      Problem if this is not empty: importFailList: []

      Switch. Now appending to benchmark_file_50_A.dat.gz.log. Between tests, you may want to delete it if it gets too big
      Found h2o_nodes0.h2o_remote_buckets_root: /home/0xcustomer

      import_only: /home4/jenkins/jobs/h2o_release_tests_164/workspace/py/testdir_release/c3/test_c3_fvec.py uses local://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*10-40-9.dat.gz
      Path h2o will be told to use: /home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*10-40-9.dat.gz
      If local jvms, path resolves locally as: /home/0xdiag/home-0xdiag-datasets/manyfiles-nflx-gz/*10-40-9.dat.gz

      parse parameters:

      {'header': None, 'destination_key': 'file_50_A.dat.gz.hex', 'separator': None, 'preview': None, 'exclude': None, 'header_from_file': None, 'parser_type': None, 'blocking': None, 'single_quotes': None, 'source_key': u'nfs://home/0xcustomer/home-0xdiag-datasets/manyfiles-nflx-gz/*[1][0-4][0-9].dat.gz'}

      rjson: {
      "error": "RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException",
      "response":

      { "h2o": "jenkins-164", "node": "/192.168.1.164:54359", "status": "error", "time": 0 }

      }
      tearDown
      java.lang.NullPointerException
      04:00:35.349 FJ-16-9 INFO WATER: at water.fvec.Frame$1.compute2(Frame.java:74)
      04:00:35.349 FJ-16-9 INFO WATER: at water.H2O$H2OCountedCompleter.compute(H2O.java:713)
      04:00:35.349 FJ-16-9 INFO WATER: at jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      04:00:35.350 FJ-16-9 INFO WATER: at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      04:00:35.348 # Session ERRR WATER:
      + java.util.concurrent.ExecutionException: java.lang.NullPointerException
      + at jsr166y.ForkJoinTask.get(ForkJoinTask.java:961)
      + at water.Futures.blockForPending(Futures.java:67)
      + at water.fvec.Frame.vecs(Frame.java:81)
      + at water.Value.isRawData(Value.java:245)
      + at water.api.Parse$ExistingCSVKey.parse(Parse.java:90)
      + at water.api.Parse$ExistingCSVKey.parse(Parse.java:65)
      + at water.api.RequestArguments$Argument.check(RequestArguments.java:551)
      + at water.api.RequestQueries.checkArguments(RequestQueries.java:69)
      + at water.api.Request.serveGrid(Request.java:125)
      + at water.api.Request.serve(Request.java:108)
      + at water.api.RequestServer.serve(RequestServer.java:315)
      + at water.NanoHTTPD$HTTPSession.run(NanoHTTPD.java:421)
      + at java.lang.Thread.run(Thread.java:662)
      + Caused by: java.lang.NullPointerException
      + at water.fvec.Frame$1.compute2(Frame.java:74)
      + at water.H2O$H2OCountedCompleter.compute(H2O.java:713)
      + at jsr166y.CountedCompleter.exec(CountedCompleter.java:429)
      + at jsr166y.ForkJoinTask.doExec(ForkJoinTask.java:263)
      + at jsr166y.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:974)
      + at jsr166y.ForkJoinPool.runWorker(ForkJoinPool.java:1477)
      + at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)04:00:35.351 FJ-16-9 INFO WATER: at jsr166y.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:104)

        Attachments

          Activity

            People

            • Assignee:
              tomas Tomas Nykodym (Inactive)
              Reporter:
              kbn Kevin Normoyle (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: