Commit Graph

32 Commits

Author SHA1 Message Date
James Blair
86be784aa0 Replace deprecated k8s registry references.
Problem:
Previously all of Kubernetes' image hosting has been out of gcr.io. There were significant egress costs associated with this when images were pulled from entities outside gcp.  Refer to https://github.com/kubernetes/k8s.io/wiki/New-Registry-url-for-Kubernetes-(registry.k8s.io)

Solution:
As highlighted at KubeCon NA 2022 k8s infra SIG update, the replacement for k8s.gcr.io which is registry.k8s.io is now ready for mainstream use and the old k8s.gcr.io has been formally deprecated. This commit migrates all references for k3s to registry.k8s.io.

Signed-off-by: James Blair <mail@jamesblair.net>
2022-11-01 16:06:50 -07:00
Brad Davidson
f96d86f077 Bump test framework versions and add hooks to helpers
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2022-10-26 13:33:18 -07:00
Brad Davidson
00cbb7ed21 Fix helm job failure on multi-server tests
Replace ETCD-JOIN-STABLE-SECOND with ETCD-JOIN-LATEST-FIRST. We don't
support joining down-level servers to existing clusters, as the new
down-level server will try to deploy older versions of the packaged
manifests.

Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2022-10-06 16:20:21 -07:00
Brad Davidson
4f4cf18fb6 Add tests for down-level etcd join
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2022-06-30 11:57:41 -07:00
Brad Davidson
e391bf48e7 Bump sonobuoy version and fix deprecated arg
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2022-05-11 14:39:07 -07:00
Sakala Venkata Krishna Rohit
3e3549e45c
Add s390x arch support for k3s (#5018)
* Update docs to include s390x arch

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Add s390x drone pipeline

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Install trivy linux arch only for amd64

This is done so that trivy is not installed for s390x arch

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Add s390x arch if condition for Dockerfile.test

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Add s390x arch in install script

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Add s390x GOARCH in build script

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Add SUFFIX s390x in scripts

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Skip image scan for s390x arch

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Update klipper-lb to version v0.3.5

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Update traefik version to v2.6.2

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Update registry to v2.8.1 in tests which supports s390x

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>

* Skip compact tests for s390x arch

This is done because compact test require a previous k3s version which supports s390x and it is not available

Signed-off-by: Venkata Krishna Rohit Sakala <rohitsakala@gmail.com>
2022-04-15 09:41:40 -07:00
Derek Nola
444a7cb0ad
Fixes to Drone CI Stability (#4897)
* Do serial only first

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Add test-post-hook for extremely flaky tests, enable parallel

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Add flaky test post hook to etcd

* Add concurrent parallel, fix flaky tests checks

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-01-31 10:57:23 -08:00
Derek Nola
2ac8df3602
Integration tests utilities improvements (#4832)
* Remove sudo commands from integration tests

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Added cleanup fucntion

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Implement better int cleanup

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Rename test utils

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Enable K3sCmd to be a single string

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Removed parsePod function

Signed-off-by: Derek Nola <derek.nola@suse.com>

* codespell

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Revert startup timeout

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Reorder sonobuoy tests, drop concurrent tests to 3

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Disable etcd

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Skip parallel testing for etcd

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-01-06 08:05:56 -08:00
Brad Davidson
52e450f033 Add etcd sonobuoy tests
Closes a gap in test coverage. Also fixes an issue where args and hooks
from previous test runs were not being reset for subsequent runs.

Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2021-12-21 13:35:12 -08:00
Brad Davidson
9919f229b6 Add variable to enforce max test concurrency
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2021-12-21 13:35:12 -08:00
Chris Kim
d93c82f958
[master] Bump golang and containerd (#4538)
* Increase test timeout to 60m
* Bump golang to v1.16.10
* Bump sonobuoy to v0.55.0
* Bump containerd to v1.5.8-k3s1

Signed-off-by: Chris Kim <oats87g@gmail.com>
2021-11-18 18:29:21 -08:00
Brad Davidson
cd5002ea37 Skip tests that violate version skew policy
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2021-09-30 12:26:35 -07:00
Brad Davidson
94266658f6 Reduce node and service wait times
Some of the new node compat tests take a while before failing as
expected. We don't seem to need the additional time any longer to avoid
flakes, so turn it down a bit.

Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2021-04-14 14:51:42 -07:00
Brad Davidson
66b9e9c4c8 Suppress test failure due to incompatible server
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2021-03-01 14:23:59 -08:00
Brad Davidson
7734015db7 Add script to test server/agent version compatibility
We have had a couple issues with newer agents not working with old
servers or vice versa. Add a CI test to test variations on
uplevel/downlevel server/agent against latest, stable, and the previous
branch.

Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2021-03-01 14:23:59 -08:00
Brad Davidson
fd991cb964 Improve sonobuoy status output handling
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2021-01-22 16:13:36 -08:00
Brad Davidson
97a606bac1 Update sonobuoy version for v1.20.0
Also drop the rancher-mirrored sonobuoy image since CI has a
pull-through image cache now.

Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2021-01-22 16:13:36 -08:00
Brad Davidson
d672a4ae1a Wait longer for sonobuoy tests to start up
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2020-12-16 09:22:52 -08:00
Brad Davidson
13d585059f Add registry mirrors for CI test step
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2020-12-15 13:57:18 -08:00
Brad Davidson
ef9ad4f04d Clean up CI warnings/errors
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2020-12-15 10:54:59 -08:00
Erik Wilson
cccba681a9
Test script cleanup backport from RKE2 (#2650)
* Test script cleanup backport from RKE2

Signed-off-by: Erik Wilson <Erik.E.Wilson@gmail.com>

* Update scripts/test

Co-authored-by: Brian Downs <brian.downs@gmail.com>

Co-authored-by: Brian Downs <brian.downs@gmail.com>
2020-12-08 10:43:31 -07:00
Brad Davidson
fcb864a5e2
Update sonobuoy version and use rancher mirrored image (#2482)
* Update sonobuoy version
* Use upstream tag for Kubernetes version instead of replacement tag
    Allows building against upstream alpha/beta/rc releases
* Use env variable for sonobuoy version
* Bump version for QA e2e tests

Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2020-11-06 13:33:31 -08:00
Erik Wilson
9b8e829ec7 Check for changes in the airgap image list 2020-03-09 19:58:00 -07:00
Erik Wilson
6317da01e5 Enforce that tag versions are prefixed with k8s go.mod version 2020-01-24 10:55:35 -07:00
Erik Wilson
5221af4752 Fix exit code on test error 2020-01-24 07:37:54 -07:00
Erik Wilson
940be0e515 Fix e2e logs not published 2020-01-21 14:51:07 -07:00
Erik Wilson
5117ea0ca7 Always exit 0 on tag for tests 2020-01-21 11:07:12 -07:00
Erik Wilson
4ec28d2707 Set conformance version from k8s version 2020-01-21 10:32:08 -07:00
Erik Wilson
7d9bdaee23 Check versions for dot in metadata 2020-01-20 16:01:04 -07:00
Erik Wilson
4439a7df08 Test cleanup 2020-01-16 14:54:58 -07:00
Erik Wilson
0a843a11c6 Show single sonobuoy failure 2019-11-12 19:46:34 -07:00
Erik Wilson
c62c428204 Upload logs to gcloud 2019-11-11 20:19:19 -07:00