Uploaded image for project: 'SW'
  1. SW-836

Add support for converting empty dataframe/RDD in Python and Scala to H2OFrame

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.29, 2.2.15, 2.3.4
    • Component/s: None
    • Labels:
      None

      Description

      
      ````Traceback (most recent call last):
        File "main.py", line 121, in <module>
          main()
        File "main.py", line 114, in main
          driver.score_batch(path_to_output_path, spark)
        File "/mnt/yarn/usercache/hadoop/appcache/application_1525476171308_0078/container_1525476171308_0078_01_000001/deps.zip/runner.py", line 980, in score_batch
        File "/mnt/yarn/usercache/hadoop/appcache/application_1525476171308_0078/container_1525476171308_0078_01_000001/deps.zip/runner.py", line 183, in load_and_prepare_data
        File "/usr/local/lib/python3.6/site-packages/pysparkling/context.py", line 225, in as_h2o_frame
          return fc._as_h2o_frame_from_dataframe(self, dataframe, framename, full_cols)
        File "/usr/local/lib/python3.6/site-packages/pysparkling/conversions.py", line 43, in _as_h2o_frame_from_dataframe
          raise ValueError('Cannot transform empty H2OFrame')
      ValueError: Cannot transform empty H2OFrame
      /usr/local/lib/python3.6/site-packages/pysparkling/context.py:161: UserWarning: Stopping H2OContext from PySparkling is not fully supported. Please restart your PySpark session and create a new H2OContext.
      

        Attachments

          Activity

            People

            • Assignee:
              Kuba Jakub Hava
              Reporter:
              nidhi Nidhi Mehta
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: