Commit Graph

1109 Commits (ecd10442000571e23855e81c1daf7ad61717f560)

Author SHA1 Message Date
Chao Xu d3c0d04285 add update-staging-client-go.sh and verify-staging-client-go.sh;
disable verify-staging-client-go.sh until 1.5 code freeze
2016-10-29 14:20:39 -07:00
Jeff Grafton c32da484ff Delete some old, dead release code 2016-10-20 13:57:15 -07:00
Jess Frazelle 3803fee972
Update to go1.7.1
Signed-off-by: Jess Frazelle <me@jessfraz.com>
2016-10-13 21:12:15 -07:00
David McMahon c5a61a6f99 Increase job cache limit to 300 and leave a TODO. 2016-10-13 12:09:06 -07:00
Jeff Grafton f8ea21328f Add support for adding a suffix to the GCS upload dir in jenkins/build 2016-10-07 13:59:43 -07:00
Joe Beda d955f54918 Remove unused bash variables 2016-10-03 19:42:22 -07:00
Doug Davis 9d5bac6330 Change minion to node
Contination of #1111

I tried to keep this PR down to just a simple search-n-replace to keep
things simple.  I may have gone too far in some spots but its easy to
roll those back if needed.

I avoided renaming `contrib/mesos/pkg/minion` because there's already
a `contrib/mesos/pkg/node` dir and fixing that will require a bit of work
due to a circular import chain that pops up. So I'm saving that for a
follow-on PR.

I rolled back some of this from a previous commit because it just got
to big/messy. Will follow up with additional PRs

Signed-off-by: Doug Davis <dug@us.ibm.com>
2016-09-28 10:53:30 -07:00
Ryan Hitchman 9b7f347e93 Make upload-to-gcs.sh use a different prefix for tests in other repos.
For kubernetes/test-infra#476.

Also, put the repo in the build metadata so Gubernator can link to the
right thing for postsubmit jobs.

For PR #$NUM in a given repo, the logs will go to these places:

	kubernetes/kubernetes => /pr-logs/pull/$NUM
	kubernetes/test-infra => /pr-logs/pull/test-infra/$NUM
	google/cadvisor => /pr-logs/pull/google_cadvisor/$NUM

Tested with a manual harness. Note that this leaves the latest/indirect
untouched as well as postsubmit jobs-- *job names* are still unique, the
main issue was that PR numbers might collide. Disturbing as little
structure as possible reduces how many things will break.
2016-09-26 12:42:49 -07:00
Ryan Hitchman 90f9c83d98 Make upload-to-gcs.sh include BUILD_METADATA_* env vars in started.json.
This is initially intended for storing GCI image versions.

Example output:

    $ TEST_STARTED_JSON=1 BUILD_METADATA_GCE_IMAGE=m53 \
    BUILD_METADATA_VARIANT=reliableforreal BUILD_NUMBER=123 \
    WORKSPACE="blaga" JOB_NAME="test-e2e" hack/jenkins/upload-to-gcs.sh
    {
      "version": "v1.5.0-alpha.0.806+fa943089125df4-dirty",
      "timestamp": 1473894301,
      "metadata": {
        "gce_image": "m53",
        "variant": "reliableforreal"
      },
      "jenkins-node": ""
    }
2016-09-14 16:41:03 -07:00
David McMahon 92ddc22fc0 Change push-ci-build.sh to push-build.sh and some cleanup. 2016-09-07 16:50:53 -07:00
Kubernetes Submit Queue f61a677a4e Merge pull request #32013 from david-mcmahon/push-from-release
Automatic merge from submit-queue

Call push-ci-build.sh from the kubernetes/release repo.
2016-09-07 14:49:23 -07:00
David McMahon 329b581c78 Call push-ci-build.sh from the kubernetes/release repo. 2016-09-07 13:06:47 -07:00
Jeff Grafton 177740217f Don't git clean in hack/jenkins/build.sh 2016-09-06 15:18:28 -07:00
Erick Fejta 5f2e9331cb Delete unused, deprecated scripts 2016-08-26 18:26:12 -07:00
David McMahon 55bfc885db Fix the creation of the jobResultsCache.json file. 2016-08-25 17:27:05 -07:00
Kubernetes Submit Queue a953eb42b1 Merge pull request #30551 from david-mcmahon/job-cache
Automatic merge from submit-queue

Construct a valid json file for the job cache.
2016-08-25 15:55:19 -07:00
Erick Fejta 1aea03e7a8 Moved runner to test-infra 2016-08-24 15:47:10 -07:00
Kubernetes Submit Queue b551bf1e5c Merge pull request #31330 from ixdy/kubekins-docker
Automatic merge from submit-queue

Explicitly set CLOUDSDK_CONFIG override early in e2e-runner

I'm guessing this is why a number of gci-on-gke builds started failing after https://github.com/kubernetes/test-infra/pull/432 was merged - we're overriding the gcloud configuration location from the default, so the activated service account no longer works. Previously we did this service activation late, but after we'd overridden the value.

I've changed it to explicitly set to a known-good value every time at the very start.

cc @vishh @maisem @spxtr @fejta
2016-08-24 11:38:05 -07:00
Kubernetes Submit Queue c69e3d32a2 Merge pull request #31302 from ixdy/jenkins-build-script
Automatic merge from submit-queue

Use `make release` on Jenkins to support crossbuilds

Partner PR to https://github.com/kubernetes/test-infra/pull/440 to fix https://github.com/kubernetes/test-infra/issues/393.

We probably should pull the build functionality out of e2e.go entirely, but I leave that to future work.

cc @luxas @david-mcmahon @fejta
2016-08-24 10:55:38 -07:00
Jeff Grafton 12ea9cb1db Set CLOUDSDK_CONFIG to an explicit consistent value in e2e-runner 2016-08-24 00:37:53 -07:00
Erick Fejta c28e37a192 Fix path to kubernetes_skew 2016-08-23 16:26:40 -07:00
Jeff Grafton d18fbe923d Use `make release` on Jenkins to support crossbuilds 2016-08-23 14:31:54 -07:00
Jeff Grafton 8e168f8d5a Use kubekins-test:v20160822 everywhere 2016-08-22 14:31:45 -07:00
Kubernetes Submit Queue e30c0b8dcd Merge pull request #30906 from wonderfly/version-map
Automatic merge from submit-queue

e2e-runner: Get GCI builtin k8s version from GCS

**What this PR does / why we need it**:
The GCI release qualification tests use builtin k8s version to run tests. They used to get the builtin version by parsing descriptions of the test images, but that's unreliable because the description format could change. This PR makes it to read a file checked in GCS that has the exact k8s version number.

@adityakali @spxtr Can you review?

cc/ @kubernetes/goog-image
2016-08-22 00:15:40 -07:00
Kubernetes Submit Queue 99295356ed Merge pull request #30937 from fejta/delete
Automatic merge from submit-queue

Delete deprecated dockerized-e2e-runner.sh

We moved this file to the test-infra repo in https://github.com/kubernetes/test-infra/pull/385
2016-08-19 17:22:48 -07:00
Kubernetes Submit Queue 237db0363a Merge pull request #31035 from ixdy/e2e-service-account
Automatic merge from submit-queue

When running inside docker, activate service account ASAP

Also switching to just use `GOOGLE_APPLICATION_CREDENTIALS`, rather than both.

x-ref https://github.com/kubernetes/test-infra/issues/318
2016-08-19 17:22:34 -07:00
Jeff Grafton 8278d1c2ef When running inside docker, activate service account ASAP
Additionally, remove activation code everywhere else, since we do that
already in Jenkins.
2016-08-19 15:41:33 -07:00
Erick Fejta 1e3bc1caa2 Delete deprecated dockerized-e2e-runner.sh 2016-08-19 15:38:52 -07:00
David McMahon 3c4f7491c9 Fix unbound variable issue (set -e). 2016-08-19 13:46:00 -07:00
Erick Fejta 3b5b70a62f Unset a couple GINKGO_TEST_ARGS in kubekins-e2e 2016-08-18 15:19:23 -07:00
Daniel Wang e4952581b9 e2e-runner: Get GCI builtin k8s version from GCS
Instead of parsing unstructured image description.
2016-08-18 14:26:12 -07:00
Wojciech Tyczynski 1b5333384f Revert part of #30424 2016-08-17 08:50:55 +02:00
Kubernetes Submit Queue d13add0769 Merge pull request #30424 from fejta/e2e2
Automatic merge from submit-queue

Create a kubekins-e2e image with runner and dependencies

Update dockerized-e2e-runner.sh to just run an image with the appropriate e2e environment variables set.

e2e-runner.sh, upload-to-gcs.sh and e2e.go now live inside the container.
2016-08-16 19:51:37 -07:00
David McMahon 399b114c04 Construct a valid json file for the job cache. 2016-08-16 15:56:46 -07:00
Erick Fejta 40078b9fb2 Create a kubekins-e2e image with runner and dependencies 2016-08-16 12:05:09 -07:00
Wojciech Tyczynski 992f023f3c Check resource leaks only when needed 2016-08-16 16:12:46 +02:00
Jeff Grafton 7e51ee1ccd Install bc in the kubekins-test image
It is needed by the shell2junit script.
2016-08-12 16:42:53 -07:00
Kubernetes Submit Queue 16c71aad4a Merge pull request #30385 from david-mcmahon/fix-cache
Automatic merge from submit-queue

Get version from started.json.



<!-- Reviewable:start -->
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30385)
<!-- Reviewable:end -->
2016-08-12 10:54:20 -07:00
Kubernetes Submit Queue d4691a76ec Merge pull request #27911 from jfrazelle/start-enable-golint
Automatic merge from submit-queue

Start verifying golint on a per-package basis as packages are fixed

<!--
Checklist for submitting a Pull Request

Please remove this comment block before submitting.

1. Please read our [contributor guidelines](https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md).
2. See our [developer guide](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md).
3. If you want this PR to automatically close an issue when it is merged,
   add `fixes #<issue number>` or `fixes #<issue number>, fixes #<issue number>`
   to close multiple issues (see: https://github.com/blog/1506-closing-issues-via-pull-requests).
4. Follow the instructions for [labeling and writing a release note for this PR](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes) in the block below.
-->

```release-note
Added `golint` for pkg/security/podsecuritypolicy/capabilities` along with validation.
```


[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

This is a POC to start enabling `golint` checks on a per-package basis, we did this on the docker project and it was a great way for new contributors to help and it benefits the project overall. All they have to do is add the package they fixed to the bash array in `hack/verify-golint.sh` and fix all the lint errors. 
Eventually when all the packages have been fixed we can change the function to `find_files`. Or something based off which files are changed in a patch set to verify `golint`.
Now I used this specific package as the POC because I wanted to show the downside of this changing the api of the package.
Most of the times this arose in docker/docker we decided that if someone wasn't importing their deps locally then it was their loss, but I'm not sure if you all will agree.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/27911)
<!-- Reviewable:end -->
2016-08-11 15:03:06 -07:00
Kubernetes Submit Queue f5861b9e49 Merge pull request #30176 from dims/check-for-root-access
Automatic merge from submit-queue

Check for CAP_SYS_ADMIN in Kubelet

Comment from nsenter_mount.go header:
The Kubelet process must have CAP_SYS_ADMIN (required by nsenter); at
the present, this effectively means that the kubelet is running in a
privileged container.

Related to #26093

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30176)
<!-- Reviewable:end -->
2016-08-11 08:46:19 -07:00
Jess Frazelle 818cdaf9d3
add golint to test dockerfile
Signed-off-by: Jess Frazelle <me@jessfraz.com>
2016-08-10 16:46:19 -07:00
Erick Fejta 8ca5759bb0 Do not require --test_args to be set 2016-08-10 13:25:59 -07:00
David McMahon c99a18e31c Get version from started.json. 2016-08-10 13:12:25 -07:00
gmarek b30fbc138f Correctly pipe USE_KUBEMARK in e2e-runner 2016-08-10 10:42:52 +02:00
Kubernetes Submit Queue 853bfdcb7c Merge pull request #30324 from david-mcmahon/fix-cache
Automatic merge from submit-queue

Figure out where kubernetes is in the various scopes this is called from.

cc @spxtr
2016-08-09 18:59:31 -07:00
David McMahon 2a06a8f416 Figure out where kubernetes is in the various scopes this is called from. 2016-08-09 17:22:34 -07:00
Kubernetes Submit Queue 012eb941d6 Merge pull request #28575 from fejta/check-resources
Automatic merge from submit-queue

Move kubemark, skew, upgrade, leak logic into hack/e2e.go

And move out of the `e2e_runner.sh`
Also make `start-kubemark.sh` automatically find `kubernetes-server-linux-amd64.tar.gz` instead of depending on a `RUN_FROM_DISTRO` env var

@gmarek can you review the kubemark-related changes?
@zmerlynn are you the right person to review upgrade changes?

@spxtr take a look at the overall `e2e.go` changes.

This is for https://github.com/kubernetes/kubernetes/issues/21843 and https://github.com/kubernetes/test-infra/pull/250

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/28575)
<!-- Reviewable:end -->
2016-08-09 15:54:50 -07:00
Kubernetes Submit Queue cdee52e5e7 Merge pull request #26790 from rmmh/bash-range
Automatic merge from submit-queue

Use bash ranges "{1..3}" instead of "$(seq 1 3)".




[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/26790)
<!-- Reviewable:end -->
2016-08-09 15:18:30 -07:00
Erick Fejta 7011d8826e Move kubemark, skew, upgrade, leak logic into hack/e2e.go 2016-08-09 14:04:19 -07:00
Davanum Srinivas 2616fc9cf5 Check for CAP_SYS_ADMIN in Kubelet
The Kubelet process must have CAP_SYS_ADMIN, which implies that
the kubelet process must be either running as root or in a privileged
container. Make this check early in the startup sequence and bail out
if necessary.

Related to #26093
2016-08-09 13:40:07 -04:00