Uploaded image for project: 'SW'
  1. SW-678

Document how to change log location

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.23, 2.1.22, 2.2.8
    • Component/s: None
    • Labels:
      None

      Description

      can we please add this info to sw docs .

      ref - https://support.h2o.ai/helpdesk/tickets/91640
      from Michal Malohlava

      We offload logs into temporary space of hadoop job defined by `spark.yarn.app.container.log.dir`. 
      
      Furthermore, You can control log level via following Sparkling water properties:
       - `spark.ext.h2o.node.log.level` (executor log level)
       - `spark.ext.h2o.client.log.level` (client log level)
      So you can setup these properties to `ERROR` level to avoid printing too many messages into logs.
      
      Furthermore, You need to control log level of spark as well
      via `$SPARK_HOME/conf/log4j.properties`
      regaring log4j.properties, for example - 
      
      # Set everything to be logged to the console
      log4j.rootCategory=ERROR, console
      

        Attachments

          Activity

            People

            • Assignee:
              Kuba Jakub Hava
              Reporter:
              nidhi Nidhi Mehta
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: