Uploaded image for project: 'Public H2O 3'
  1. PUBDEV-6065

AutoML: Leaderboard throws ArrayIndexOutOfBoundsException if sort_metric is specified but no model was built

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.22.0.2
    • Component/s: AutoML
    • Labels:
      None
    • CustomerVisible:
      No
    • Sprint:

      Description

      aml = H2OAutoML(max_runtime_secs=60, sort_metric='logloss')
      aml.train(y=-1, training_frame=train) #train frame large enough to prevent automl to build any model
      lb = aml.leaderboard
      

      throws an exception on backend when fetching the leaderboard:

      INFO: GET /99/AutoML/automl_BINOMIAL_miniboone, parms: {}
      ERRR: java.lang.ArrayIndexOutOfBoundsException: 0
      ERRR: 	at ai.h2o.automl.Leaderboard.makeTwoDimTable(Leaderboard.java:645)
      ERRR: 	at ai.h2o.automl.Leaderboard.toTwoDimTable(Leaderboard.java:730)
      ERRR: 	at ai.h2o.automl.Leaderboard.toTwoDimTable(Leaderboard.java:710)
      ERRR: 	at water.automl.api.schemas3.AutoMLV99.fillFromImpl(AutoMLV99.java:78)
      ERRR: 	at water.automl.api.AutoMLHandler.fetch(AutoMLHandler.java:17)
      

        Attachments

          Activity

            People

            • Assignee:
              sebastien Sebastien Poirier
              Reporter:
              sebastien Sebastien Poirier
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: