Conformance Tests for Clusters with Cluster API enabled

[kubernetes-sigs]

Conformance Tests for Clusters with Cluster API enabled

[dpb587-pivotal]

Cross-referencing... this is now documented as a Validation Requirement in the Cluster API Scopes and Objectives:

Cluster API MUST have conformance tests to ensure that Cluster API and a given provider fulfill the expectations of users/automation.

[rsdcastro]

This item should cover how to test that a cluster that has cluster API enabled is conformant, which means that E2E scenarios via cluster API on the particular provider that is enabled in the cluster are working.

[rsdcastro]

cc @spew

Considering this for alpha as a way to validate the cluster API components are fully functional after cluster provisioning or upgrades.

[rsdcastro]

cc @AishSundar

[AishSundar]

@rdc is this item tracking setting up CI for ClusterAPI Conformance tests or is it looking for guidance on how to trigger an one-off e2e conformance test run against an UP'ed cluster? If its the former is there a milestone or timeline we are looking for this to be ready?

[vincepri]

/area testing

[timothysc]

TODO: outline a reasonable action plan so newcomers could work on this.

[timothysc]

Closing b/c we are creating new e2es this cycle and we'll visit real-real conformance once we approach beta.