Open issues

Integration Testing for different variation of Spark
SW-179
Add support for Spark Dynamic Allocation
SW-556
Test Sparkling Water on Standalone Cluster
SW-106
Sparkling shell: newly created classes are not visible by remote nodes
SW-36
Fix intermittent NPE in PySparkling with rollups on external backend
SW-1623
[Spark2.3]Upgrade to Spark 2.3.4
SW-1619
HamOrSparm tests return false for both predictions in scripts tests
SW-1618
GridSearch Should Reference Hyper Parameters with SW Names
SW-1608
Create gradle task to create rsparkling docker image for kubernetes
SW-1607
Create gradle task to create pysparkling docker image for kubernetes
SW-1606
Enable all TargetEncoder tests
SW-1602
Test setting non-default values on PySparkling Algos via setters and via construtor
SW-1590
Deprecate Sparkling Water SVM in favor of H2O one
SW-1589
Add DRF to grid search
SW-1588
Remove deprecated getter and setter SelectBestModelDecreasing on H2OGridSearch
SW-1587
Remove deprecated getLambda & getAlpha getters and related setters
SW-1586
H2OGBM in pyspark
SW-1579
Sparkling water fails to detect newer version of colorama
SW-1569
Have automatic kubernetes tests
SW-1566
Upload docker images to docker hub as part of release
SW-1563
Support for Kubernetes
SW-1562
Cloud up of SW fails on EMR
SW-1559
Weights not working in h2o cox model. caused by java.lang.IllegalArgumentException: weights must be positive values
SW-1556
Use argumentbuilder to build arguments for the external h2o backend
SW-1545
get-extended-h2o script does not work for nightlies
SW-1544
Remove client start from H2OExternalBackend
SW-1538
Algorithm wrappers should use Rest API to train models
SW-1537
To be able to serve proxy, ensure that at least one of the worker nodes has web enabled
SW-1536
Make configuration geters and setters up to date with the client separation task
SW-1535
Create proxy for H2O flow as we no longer run H2O on driver side
SW-1534
Turn H2O Frame into interface, implementation will vary on the backend
SW-1533
Ability to start H2OContext from Py/R without running H2O client
SW-1532
External H2O backend should not use H2O client
SW-1529
[PySparkling] Improve documentation on H2OXGBoost parameters
SW-1508
Check range of Double/Float parameters on Scala/Pysparkling Algo API
SW-1507
Remove deprecated parameters from terraform templates
SW-1505
Access H2O FLOW UI using Databricks on Azure
SW-1500
Expose getNTreeGroups() in SW MOJO
SW-1495
Fix pipeline tests
SW-1482
Create an estimator flattening dataframes in Spark pipeline
SW-1440
Re-enable and fix intermittent local-cluster failures
SW-1438
Add automated tests to test h2o native hive in sparkling water environment
SW-1416
Introduce back Jenkinsfile-internal-hadoop-smoke and Spark nightly tests
SW-1410
Distinguish between classification and regression mode for all H2O algorithms.
SW-1407
Switch to scala formatter
SW-1391
In release pipeline, allow to specify output directory for extended H2O jars
SW-1377
Add conda-forge to unblock release of 2.1 to conda
SW-1376
Be able to annotate jira with flag indicating the change should not be mentioned in release notes
SW-1366
Remove h2o wrapper around SVM from sparkling water
SW-1354
Expose option to pick a given certificate from a keystore to SW users
SW-1324
issue 1 of 161

Integration Testing for different variation of Spark

Description

We need to test for:

  • HDP (different version)

  • CDH5.7, CDH5.8

  • EMR

The tests have to

  • be automatic

  • be defined at a single space - see (Jenkins Pipelines)

Environment

None

Status

Assignee

Michal Malohlava

Reporter

Michal Malohlava

Labels

None

Release Priority

None

CustomerVisible

No

testcase 1

None

testcase 2

None

testcase 3

None

h2ostream link

None

Affected Spark version

None

AffectedContact

None

AffectedCustomers

None

AffectedPilots

None

AffectedOpenSource

None

Support Assessment

None

Customer Request Type

None

Support ticket URL

None

End date

None

Baseline start date

None

Baseline end date

None

Task progress

None

Task mode

None

Components

Priority

Blocker