Commit Graph

52 Commits (b55aaeb08d4d54efce39eca0d475e4080b1e177c)

Author SHA1 Message Date
Brad Davidson e9cf3a7ab5 Tail journald logs into report on suite failure
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2024-12-06 11:45:34 -08:00
Brad Davidson 45195e2654 Fix integration test failure message
The error message should be printf style, not just concatenated. The
current message is garbled if the command or result contains things that
look like formatting directives:

`Internal error occurred: error sending request: Post "https://10.10.10.102:10250/exec/default/volume-test/volume-test?command=sh&command=-c&command=echo+local-path-test+%!!(MISSING)E(MISSING)+%!!(MISSING)F(MISSING)data%!!(MISSING)F(MISSING)test&error=1&output=1": proxy error from 127.0.0.1:6443 while dialing 10.10.10.102:10250, code 502: 502 Bad Gateway`

Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2024-12-06 11:45:34 -08:00
Brad Davidson 81dda9d626 Add command output to test failure message
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2024-12-06 11:45:34 -08:00
Robert Silén 40eda6a823
Add MariaDB to E2E (#10724)
* add mariadb to Validate and Upgrade E2E tests

Signed-off-by: robertsilen <robert.silen@iki.fi>
Signed-off-by: Robert Silén <robert.silen@iki.fi>
Co-authored-by: Derek Nola <derek.nola@suse.com>
2024-09-19 08:40:02 -07:00
Derek Nola ac247d29cf
Update to newer OS images for install testing (#10681)
* Update to newer OS images for install testing
* Update vagrant images used for E2E

Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-08-12 09:26:19 -07:00
Manuel Buil dba30ab21c Replace deprecated ruby function
Signed-off-by: Manuel Buil <mbuil@suse.com>
2024-05-13 09:41:28 +02:00
Derek Nola 0981f0069d
Add E2E Split Server to Drone, support parrallel testing in Drone (#9940)
* Fix SE old test name
* E2E: support multiple VMs at once in CI with time prefix
* Add local binary support to split server test, add to drone CI
* Cleanup old VMs in drone

Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-04-29 13:57:22 -07:00
Brad Davidson 60248c42de Add supervisor cert/key to rotate list
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2024-04-05 10:59:17 -07:00
Derek Nola c47c85e5da
Move to ubuntu 23.10 for E2E tests (#9755)
Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-03-27 09:55:13 -07:00
Derek Nola 1c8be1d011 Improve E2E Aftersuite cleanup
Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-03-06 14:04:05 -08:00
Derek Nola af4c51bfc3 Move to ubuntu 2204 for all E2E tests
Simplify node roles

Signed-off-by: Derek Nola <derek.nola@suse.com>
2024-03-06 14:04:05 -08:00
Brad Davidson 96ebb96317 Fix flakey dynamic-cert.json in cert rotation e2e test
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2023-11-17 19:46:11 -08:00
Derek Nola a87b183f9c
E2E: Support GOCOVER for more tests + fixes (#8080)
* Add support for local build and go coverage to all E2E tests
* Remove unused EXTERNAL_DB from etcd tests
* Fix private reg test
* Add coverage to tailscale
* Cleanup unnecessary "sudo" in commands

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Add additonal s3 coverage clause

Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-08-01 09:32:34 -07:00
Manuel Buil c6a6e8ef57 Fix spelling check
Signed-off-by: Manuel Buil <mbuil@suse.com>
2023-06-12 10:24:30 +02:00
Derek Nola efa86a63e8
Remove unnecessary daemonset addition/deletion (#7696)
Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-06-09 09:51:41 -07:00
Derek Nola 4a68fbd8e9 E2E: Use sudo for all RunCmdOnNode
Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-06-08 09:39:48 -07:00
Derek Nola b0188f5a13
Test Coverage Reports for E2E tests (#7526)
* Move coverage writer into agent and server
* Add coverage report to E2E PR tests
* Add codecov upload to drone

Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-06-05 14:15:17 -07:00
Brad Davidson 7b61aacb56 Fix test file list
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2023-05-30 18:15:11 -07:00
Esteban Esquivel Alvarado 9bcfac8b88
Add Rotation certification Check (#7097)
* Add Certification Test to Validate Cluster

Signed-off-by: est-suse <esteban.esquivel@suse.com>

* Fix to stop/start for k3s certificate rotation

Signed-off-by: Derek Nola <derek.nola@suse.com>

---------

Signed-off-by: est-suse <esteban.esquivel@suse.com>
Signed-off-by: Derek Nola <derek.nola@suse.com>
Co-authored-by: est-suse <esteban.esquivel@suse.com>
Co-authored-by: Derek Nola <derek.nola@suse.com>
2023-05-12 10:36:41 -07:00
Derek Nola d2e04b826a
Don't apply hardened args to agent (#7089)
Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-04-04 09:35:28 -07:00
Esteban Esquivel Alvarado 85b261096c
Add automation for Restart command for K3s (#7002)
Signed-off-by: est-suse <esteban.esquivel@suse.com>
2023-03-14 15:47:18 -07:00
Derek Nola 86e36225f5
Consolidate E2E tests and GH Actions (#6772)
* Consolidate cluster reset and snapshot E2E tests
* Add more context to secrets-encryption test
* Reuse build workflow
* Convert updatecli to job level permissions
* Remove dweomer microos from E2E and install testing

Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-01-27 09:01:13 -08:00
Derek Nola 75f77ab951
E2E Rancher and Hardened script improvements (#6778)
* Improve test-pad rancher script

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Improve hardened script and added kube-bench utility script

Signed-off-by: Derek Nola <derek.nola@suse.com>

* Apply same audits for 1.22 and older

Signed-off-by: Derek Nola <derek.nola@suse.com>

Signed-off-by: Derek Nola <derek.nola@suse.com>
2023-01-26 18:17:33 -08:00
ShylajaDevadiga fd8481a29d
Adjust e2e test run script and fixes (#6718)
Signed-off-by: ShylajaDevadiga <shylaja.devadiga@suse.com>
2023-01-11 16:09:45 -08:00
ShylajaDevadiga b276b58175
Convert test output to JSON format (#6410)
* add test output conversion to JSON and minor fixes

Signed-off-by: ShylajaDevadiga <shylaja@rancher.com>
2022-11-04 16:07:12 -07:00
Derek Nola 307d4310a3 Add journalctl logs to E2E tests
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-10-06 12:27:44 -07:00
Derek Nola 4624d3922c add registry cache capability to upgradecluster_test.go
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-09-20 12:20:28 -07:00
Derek Nola 5629c06967 Remove docker login secret, move to docker registry cache
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-09-19 15:31:02 -07:00
Derek Nola 1972fb7cd6 Enable E2E testing with local k3s binary
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-09-13 14:17:39 -07:00
Derek Nola f88cd3bfb6 Added optional docker hub login
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-09-13 14:17:39 -07:00
Derek Nola 78c35377ab Convert createCluster to parallel
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-09-13 14:17:39 -07:00
Derek Nola d51da881c8 Make all E2E tests ordered
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-09-13 14:17:39 -07:00
Derek Nola cd61f9a6cf
Expand startup integration test (#6030)
* add new data-dir subtest
* Added node flag subtest
* Fix to E2E tests
* Convert existing test to new server logging

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-08-31 15:40:17 -07:00
Derek Nola f81138402e
E2E: Add support for CentOS 7 and Rocky 8 (#6015)
* Add e2e support for centos7 and rocky8

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-08-26 09:36:13 -07:00
Derek Nola 75f8cfb6ea
E2E: Local cluster testing (#5977)
* Cleanup validatecluster printout
* remove deprecated kubectl exec format
* Implement CreateLocalCluster function
* Update testing documentation

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-08-15 15:00:22 -07:00
ShylajaDevadiga 6b7b9c5aa9
Add scripts to run e2e test using ansible (#5134)
Signed-off-by: Shylaja Devadiga <shylaja.devadiga@suse.com>
2022-08-05 09:16:10 -07:00
Brad Davidson db3c569b7f Add docker e2e test
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2022-08-05 02:39:25 -07:00
Derek Nola 12695cea15
E2E: Dualstack test (#5617)
* E2E dualstack test
* Improve testing documentation

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-06-14 08:40:29 -07:00
Derek Nola efab09bc1f
E2E Improvements and groundwork for test-pad tool (#5593)
* Add rancher install sript, taints to cp/etcd roles
* Revert back to generic/ubuntu2004, libvirt networking is unreliable on opensuse
* Added support for alpine
* Rancher deployment script
* Refactor installType into function
* Cleanup splitserver test
Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-06-13 13:36:26 -07:00
Brad Davidson bac8cf45cb Add apparmor-parser to OpenSUSE/SLE Micro test VMs
Signed-off-by: Brad Davidson <brad.davidson@rancher.com>
2022-05-11 14:39:07 -07:00
Derek Nola 3307d53f8f
E2E Validation Improvements (#5444)
* Add basic none option EXTERNAL_DB, uses internal sqlite

* Move to Leap as default

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-04-18 09:41:43 -07:00
Derek Nola 809f0cf05b
Added option to deploy hardened k3s (#5415)
Added option to deploy hardened k3s

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-04-14 15:00:48 -07:00
Derek Nola 4eed971289
E2E Split Server Test (#5286)
* Simplify role in existing tests
* Update other tests to output vagrant log on failure
* go test for split server

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-03-17 16:56:10 -07:00
Derek Nola 1f7abe5dbb
Testing directory and documentation rework. (#5256)
* Removed vagrant folder
* Fix comments around E2E ENVs
* Eliminate testutil folder
* Convert flock integration test to unit test
* Point to other READMEs

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-03-15 10:29:56 -07:00
Luther Monson 9a849b1bb7
[master] changing package to k3s-io (#4846)
* changing package to k3s-io

Signed-off-by: Luther Monson <luther.monson@gmail.com>

Co-authored-by: Derek Nola <derek.nola@suse.com>
2022-03-02 15:47:27 -08:00
Derek Nola 38ed1a6750
E2E Add external DB options to ValidateCluster test (#5157)
* Initial mysql, postgres external db
* Convert test options to env variables
* Add explicit ETCD option and bump memory for docker node

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-03-02 12:42:55 -08:00
Derek Nola 6e397aa42e
E2E secrets encryption test (#5144)
* Dump vagrant log on creation failure
* Update RunCmdOnNode to add quotes
* secrets encryption e2e test

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-03-01 11:28:39 -08:00
Derek Nola 830c330aad
E2E Test Improvements (#5102)
* Fix infinite while loop on failure, reduce upgradecluster

* DRY code

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-02-10 09:27:00 -08:00
Derek Nola e28be2912c
Migrate Ginkgo testing framework to V2, consolidate integration tests (#5097)
* Upgrade and convert ginkgo from v1 to v2
* Move all integration tests into integration folder
* Update TESTING.md

Signed-off-by: Derek Nola <derek.nola@suse.com>
2022-02-09 08:22:53 -08:00
ShylajaDevadiga 35582e6213
Fix cluster validation and add upgrade cluster test (#5020)
Signed-off-by: Shylaja Devadiga <shylaja@rancher.com>

Co-authored-by: Derek Nola <derek.nola@suse.com>
2022-02-08 09:34:57 -08:00