Commit Graph

3772 Commits (e5fb8ac226849dc877bbe1271036165dd4d428f4)

Author SHA1 Message Date
Anirudh b751e0daa9 Fixing e2e tests which rely on network disruptions. 2016-10-27 14:31:09 -07:00
Anirudh Ramanathan 7870543471 Merge pull request #35702 from mikedanese/unrevert
unrevert genrule for bindata
2016-10-27 11:53:04 -07:00
Mike Danese bce3f0e247 unrevert genrule for bindata 2016-10-27 10:35:28 -07:00
David Ashpole eb19713486 kubelet calls GetDirFsInfo(root directory) instead of using GetFsInfo(root label). Reverted #33520, and changed e2e test context to use nodefs 2016-10-27 08:04:59 -07:00
Kubernetes Submit Queue 5423eaf431 Merge pull request #35431 from deads2k/client-16-remove-old
Automatic merge from submit-queue

remove the non-generated client

Removes the non-generated client from kube.  The package has a few methods left, but nothing that needs updating when adding new groups.

@ingvagabund
2016-10-27 05:12:33 -07:00
gmarek b8a83b983f Remove outdated parts of density test 2016-10-27 11:37:26 +02:00
Kubernetes Submit Queue e190fec59e Merge pull request #35128 from wongma7/wait-restartpolicy
Automatic merge from submit-queue

Set done to true & return error if RestartPolicy not Always in test framework

Found a small issue with https://github.com/kubernetes/kubernetes/pull/34632, it returns an error if the RestartPolicy is not Always, but the user will never see it because done isn't set to true & they will timeout instead.

@Random-Liu because you wrote that PR
2016-10-27 01:27:56 -07:00
Vishnu kannan e861a5761d Adding a root filesystem override for kubelet mounter
This is useful for supporting hostPath volumes via containerized
mounters in kubelet.

Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-10-26 21:42:59 -07:00
Kubernetes Submit Queue dcdbf27d4f Merge pull request #34648 from nikhiljindal/NSCasDel
Automatic merge from submit-queue

Adding cascading deletion support to federated namespaces

Ref https://github.com/kubernetes/kubernetes/issues/33612

With this change, whenever a federated namespace is deleted with `DeleteOptions.OrphanDependents = false`, then federation namespace controller first deletes the corresponding namespaces from all underlying clusters before deleting the federated namespace.

cc @kubernetes/sig-cluster-federation @caesarxuchao


```release-note
Adding support for DeleteOptions.OrphanDependents for federated namespaces. Setting it to false while deleting a federated namespace also deletes the corresponding namespace from all registered clusters.
```
2016-10-26 21:04:03 -07:00
Kubernetes Submit Queue ab0ee35462 Merge pull request #35651 from caesarxuchao/remove-label-selectors
Automatic merge from submit-queue

Sending #35255 again: Remove versioned LabelSelectors

ref #35255: "Remove versioned LabelSelectors"

FYI @smarterclayton
2016-10-26 18:21:22 -07:00
Kubernetes Submit Queue f300d7ed69 Merge pull request #35646 from vishh/klet-relative-mount
Automatic merge from submit-queue

rename kubelet flag mounter-path to experimental-mounter-path

```release-note
* Kubelet flag '--mounter-path' renamed to '--experimental-mounter-path'
```

The feature the flag controls is an experimental feature and this renaming ensures that users do not depend on this feature just yet.
2016-10-26 16:57:33 -07:00
nikhiljindal f955d556f8 Adding cascading deletion support to federated namespaces 2016-10-26 16:54:12 -07:00
Vishnu kannan adef4675a0 rename kubelet flag mounter-path to experimental-mounter-path
Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-10-26 14:50:33 -07:00
Chao Xu 0a896a9e57 remove versioned LabelSelector definitions 2016-10-26 13:50:13 -07:00
Kubernetes Submit Queue 95542190db Merge pull request #31732 from copejon/multi-pv-pvc-pair-testing
Automatic merge from submit-queue

Add multiple PV/PVC pair handling to persistent volume e2e test

Adds the framework for creating, validating, and deleting groups of PVs and PVCs.
2016-10-26 13:39:24 -07:00
deads2k 81ae13084d handle non-generated client removal 2016-10-26 16:10:41 -04:00
Kubernetes Submit Queue 667740d334 Merge pull request #35196 from gmarek/pod-create
Automatic merge from submit-queue

Generalize Pod creation across e2e and integration tests

Depends on previous PRs
2016-10-26 10:23:29 -07:00
Kubernetes Submit Queue d9033691e4 Merge pull request #35114 from wojtek-t/speedup_networking_tests
Automatic merge from submit-queue

Speed up some networking tests in large clusters

Since we are getting towards testing larger and larger clusters (hopefully 5000-node ones soon-ish), I'm trying to limit the amount of super long tests to minimum.

This should significantly reduce amount of time used by those from test/e2e/networking.go.

@gmarek
2016-10-26 10:23:20 -07:00
gmarek 24975aad30 Revert "remove versioned LabelSelector definitions"
This reverts commit 1ace8fa9ce.
2016-10-26 16:52:02 +02:00
gmarek be57ca5015 Generalize Pod creation across e2e and integration tests 2016-10-26 11:52:14 +02:00
Wojciech Tyczynski 6714526587 Speed up some networking tests in large clusters 2016-10-26 11:17:14 +02:00
Kubernetes Submit Queue 5c6fdc7b50 Merge pull request #35255 from caesarxuchao/remove-label-selectors
Automatic merge from submit-queue

Remove versioned LabelSelectors

We have LabelSelectors defined in `unversioned`, `batch/v1`, `batch/v2alpha1`, and `extensions/v1beta1`.  Their definitions are all the same. I kept the definition in `unversioned` and removed the others. It only makes sense to define a versioned LabelSelectors if the definition is different.
2016-10-25 23:54:56 -07:00
Kubernetes Submit Queue 7d0b12f916 Merge pull request #35551 from Crassirostris/out-of-disk-disable
Automatic merge from submit-queue

Marked NodeOutOfDisk test with feature label

Marked NodeOutOfDisk test with feature label to temporarily remove it from flaky suite.

@madhusudancs @piosz
2016-10-25 23:12:29 -07:00
Chao Xu 1ace8fa9ce remove versioned LabelSelector definitions 2016-10-25 22:09:02 -07:00
Kubernetes Submit Queue 3b19fb9581 Merge pull request #32183 from mfanjie/clean-gce-in-service-e2e
Automatic merge from submit-queue

always clean gce resources in service e2e

@bprashanth the previous PR was closed when I squashed my commits.
Here is the new change set, please help to review again.
1). only the following two It() create, I created a string array to persist the LB name so that they can be cleaned in AfterEach(), and the string array was reset after clean up.
```
"should be able to change the type and ports of a service [Slow]"
"should be able to create services of type LoadBalancer and externalTraffic=localOnly"
```
2). Directly call gce api to delete the resource and ignore any error returned.
2016-10-25 22:07:35 -07:00
Jing Xu 837fde7cd9 Add a retry when reading a file content from a container
To avoid temporal failure in reading the file content, add a retry
process in function verifyPDContentsViaContainer
2016-10-25 15:58:44 -07:00
Kubernetes Submit Queue 67d947996c Merge pull request #33988 from Random-Liu/add-remote-docker-shim
Automatic merge from submit-queue

CRI: Add dockershim grpc server.

This PR adds a in-process grpc server for dockershim.

Flags change:
1. `container-runtime` will not be automatically set to remote when `container-runtime-endpoint` is set. @feiskyer 
2. set kubelet flag `--experimental-runtime-integration-type=remote --container-runtime-endpoint=UNIX_SOCKET_FILE_PATH` to enable the in-process dockershim grpc server.
3. set node e2e test flag `--runtime-integration-type=remote -container-runtime-endpoint=UNIX_SOCKET_FILE_PATH` to run node e2e test against in-process dockershim grpc server.

I've run node e2e test against the remote cri integration, tests which don't rely on stream and log functions can pass.

This unblocks the following work:
1) CRI conformance test.
2) Performance comparison between in-process integration and in-process grpc integration.

@yujuhong @feiskyer 
/cc @kubernetes/sig-node
2016-10-25 15:36:29 -07:00
Mik Vyatskov d6e8369cd7 Marked NodeOutOfDisk test with feature label to remove it from flaky suite 2016-10-25 22:48:43 +02:00
Kubernetes Submit Queue 74244283c6 Merge pull request #35480 from rmmh/update_owners_local
Automatic merge from submit-queue

Make hack/update_owners.py get list from local repo, add --check option.

This should become a verify step soon. The munger understands the * syntax already.
2016-10-25 13:24:25 -07:00
Kubernetes Submit Queue 6e68b477df Merge pull request #35428 from piosz/rescheduler-e2e
Automatic merge from submit-queue

Use UI instead of DNS in Rescheduler e2e

fix #33289
2016-10-25 13:23:50 -07:00
Kubernetes Submit Queue 5f78a70483 Merge pull request #35404 from brendandburns/autoscale
Automatic merge from submit-queue

Don't count failed pods as "not-ready"

Closes #35108 (I hope)

@wojtek-t @kubernetes/autoscaling
2016-10-25 13:23:17 -07:00
Ryan Hitchman 78eeb76386 Make hack/update_owners.py get list from local repo, add --check option. 2016-10-25 12:26:21 -07:00
Kubernetes Submit Queue 85207190f5 Merge pull request #35373 from mikedanese/bindata
Automatic merge from submit-queue

add genrule for hack/update-bindata.sh
2016-10-25 11:54:30 -07:00
Kubernetes Submit Queue ef7850e3bc Merge pull request #35395 from jayunit100/density-log-verify
Automatic merge from submit-queue

dont fail if metrics arent working in density

fixes #35369
2016-10-25 11:01:54 -07:00
Random-Liu 3d549b9e25 Add dockershim grpc server. 2016-10-25 10:31:16 -07:00
Marcin Wielgus 69364d2727 Revert "Add a retry when reading a file content from a container" 2016-10-25 13:23:05 +02:00
Kubernetes Submit Queue cfbb0eb2ff Merge pull request #34570 from jingxu97/Oct/pd-tests
Automatic merge from submit-queue

Add a retry when reading a file content from a container

To avoid temporal failure in reading the file content, add a retry
process in function verifyPDContentsViaContainer
2016-10-24 21:42:52 -07:00
mfanjie 66381c6694 delete forwardingRules instead of globalForwardingRules 2016-10-25 11:27:38 +08:00
mfanjie 127e1b6115 always clean gce resources in service e2e 2016-10-25 11:27:38 +08:00
Jon Cope f76996410c Add multiple PV/PVC pair handling to persistent volume e2e test
Refactored pv map and pvc slice into 2 maps of pv(c).Name string : isBound bool

refactored to support greater or fewer pvs compared to claims
2016-10-24 20:18:42 -05:00
Mike Danese 61bd6aa6a2 remove docs/user-guide from bindata search path 2016-10-24 18:00:08 -07:00
Mike Danese 56200d16a3 add genrule for test bindata 2016-10-24 18:00:08 -07:00
Mike Danese 763c4987f2 autogenerated 2016-10-24 14:47:27 -07:00
Kubernetes Submit Queue 4fbbc746a0 Merge pull request #35161 from mtaufen/mike-klet-cmount-node-e2e
Automatic merge from submit-queue

e2e node plumbing and bundling for GCI mounter

**Note:** The code in this PR only bundles the mounter and modifies `--mounter-path` if it can find `cluster/gce/gci/mounter` in the K8s source dir when building the test bundle.

This bundles the mounter script for GCI with the node e2e tests and allows the `--mounter-path` to be passed to the Kubelet via the node test framework. The node test runner will detect when we are running on a remote GCI node and add the appropriate `--mounter-path` to the `testArgs`. 

It also includes a simple node test that mounts a tmpfs volume. This will exercise the Kubelet's mounter code path. 

**ITEM OF NOTE:** To get the k8s root dir (in order to copy the mount script into the tarball), I changed `getK8sRootDir` -> `GetK8sRootDir` in `test/e2e_node/build/build.go`. Based on the comment above that function (and the fact that it was private to begin with), I'm not sure this is the best way to do things:
```
// TODO: Dedup / merge this with comparable utilities in e2e/util.go
```
On the other hand, the `e2e/util.go` file mentioned in that comment doesn't exist anymore. This should be resolved before this PR is merged.
2016-10-24 14:22:57 -07:00
Jing Xu 16a4951587 Add a retry when reading a file content from a container
To avoid temporal failure in reading the file content, add a retry
process in function verifyPDContentsViaContainer
2016-10-24 13:38:23 -07:00
Kubernetes Submit Queue 3b9593e281 Merge pull request #35241 from nikhiljindal/secretFede2e
Automatic merge from submit-queue

Fixing a typo in federated secrets test

Realized that our secret e2e test was not running due to a typo in my last PR :)

cc @kubernetes/sig-cluster-federation
2016-10-24 13:38:18 -07:00
deads2k fde2fedfa6 fix kubectl e2e test to avoid alpha versions unless needed 2016-10-24 14:39:55 -04:00
Piotr Szczesniak 3bc3a5fc07 Use UI instead of DNS in Rescheduler e2e 2016-10-24 16:15:37 +02:00
Michael Taufen 6fdb20480f Bundle GCI mounter w/ node tests and plumb --mounter-path through test args to the Kubelet for node tests 2016-10-24 05:50:24 -07:00
Kubernetes Submit Queue 33ebe1f18b Merge pull request #34905 from ingvagabund/client-to-clientset
Automatic merge from submit-queue

Replace client with clientset

Replace client with clientset in some places

Fixes: #34637
2016-10-24 05:38:43 -07:00
jayunit100 0940b6297d dont fail if metrics arent working in density 2016-10-24 08:36:56 -04:00
gmarek aeba0f1dc4 Change a type of collection of strategies for NodePreparer 2016-10-24 11:47:36 +02:00
gmarek 4b21b71612 Use TestNodePreparer in Density test 2016-10-24 10:19:27 +02:00
Brendan Burns 4316ce278f Don't count failed pods as "not-ready" 2016-10-23 22:21:35 -07:00
Jan Chaloupka 4fde09d308 Replace client with clientset in code 2016-10-23 22:00:35 +02:00
Kubernetes Submit Queue 931f0df641 Merge pull request #35263 from mfanjie/fix-fed-e2e
Automatic merge from submit-queue

add required fields to test service

fix #35247
2016-10-23 05:24:36 -07:00
Kubernetes Submit Queue 8b85b9ea47 Merge pull request #35375 from mikedanese/uncompiling
Automatic merge from submit-queue

e2e: delete cleanup main that isn't compiling
2016-10-22 16:26:57 -07:00
Mike Danese 76a754db84 e2e:delete cleanup util that isn't compiling 2016-10-22 10:21:37 -07:00
Kubernetes Submit Queue fdce738113 Merge pull request #35352 from MrHohn/e2e-service-todo
Automatic merge from submit-queue

service e2e: remove TODO and subtle changes in logging

Removes the stale `TODO` for external source IP preservation as the e2e test of ESIPP was added.

Changes logging in create service functions: namespace/namespace -> namespace/serviceName.

@bprashanth
2016-10-21 23:46:18 -07:00
Kubernetes Submit Queue 292004ace0 Merge pull request #35346 from bprashanth/glcoud_regex
Automatic merge from submit-queue

substitute gcloud regex with regexp

fixes https://github.com/kubernetes/kubernetes/issues/33840
2016-10-21 20:33:28 -07:00
Kubernetes Submit Queue cf376e8b8f Merge pull request #35331 from bprashanth/ingress_gcloud
Automatic merge from submit-queue

Allocate static-ip through cloudprovider library instead of gcloud

Fixes https://github.com/kubernetes/kubernetes/issues/33840
https://github.com/kubernetes/kubernetes/issues/33840#issuecomment-255277349 for details
2016-10-21 18:58:29 -07:00
Zihong Zheng e54e198b8a service e2e: remove TODO and subtle changes in logging 2016-10-21 18:44:15 -07:00
bprashanth 6e31263115 substitute gcloud regex with regexp 2016-10-21 18:20:38 -07:00
Mike Danese 3b6a067afc autogenerated 2016-10-21 17:32:32 -07:00
bprashanth 692e440d6e Allocate static-ip through cloudprovider library instead of gcloud 2016-10-21 14:29:25 -07:00
fmeng 01102e1ae2 add required fields to test service 2016-10-21 13:30:46 +08:00
bprashanth c639b8542e Fix poll to not fail on first error. 2016-10-20 17:09:48 -07:00
nikhiljindal 14a41e7b39 Fixing a typo in federated secrets test 2016-10-20 15:49:37 -07:00
Kubernetes Submit Queue 7a03564bb6 Merge pull request #35129 from gmarek/generalize
Automatic merge from submit-queue

Generalize Node preparation for e2e and integration tests

@wojtek-t
2016-10-20 14:34:03 -07:00
Kubernetes Submit Queue 35943d6ad6 Merge pull request #34969 from Crassirostris/es-kibana-usage-update
Automatic merge from submit-queue

Update elasticsearch and kibana usage

```release-note
Updated default Elasticsearch and Kibana used for elasticsearch logging destination to versions 2.4.1 and 4.6.1 respectively.
```

Updated controllers for elasticsearch and kibana to use newer versions of images. Fixed e2e test because of elasticsearch backward incompatible API changes.

Fixed out of sync elasticsearch controller for coreos.

@piosz
2016-10-20 12:26:02 -07:00
Kubernetes Submit Queue e6b5b076b8 Merge pull request #33957 from bprashanth/esipp-beta
Automatic merge from submit-queue

Loadbalanced client src ip preservation enters beta

Sounds like we're going to try out the proposal (https://github.com/kubernetes/kubernetes/issues/30819#issuecomment-249877334) for annotations -> fields on just one feature in 1.5 (scheduler). Or do we want to just convert to fields right now?
2016-10-20 06:53:07 -07:00
Kubernetes Submit Queue 74bb64a8b1 Merge pull request #35164 from janetkuo/petset-status-fix
Automatic merge from submit-queue

Verify petset status.replicas in e2e test

<!--  Thanks for sending a pull request!  Here are some tips for you:
1. If this is your first time, read our contributor guidelines https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md and developer guide https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md
2. If you want *faster* PR reviews, read how: https://github.com/kubernetes/kubernetes/blob/master/docs/devel/faster_reviews.md
3. Follow the instructions for writing a release note: https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes
-->

**What this PR does / why we need it**: follow up #33983. PetSet status.replicas bug is fixed, so adding tests for it (especially for the `should handle healthy pet restarts during scale` case)

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #

**Special notes for your reviewer**:  cc @erictune @foxish @kubernetes/sig-apps

**Release note**:
<!--  Steps to write your release note:
1. Use the release-note-* labels to set the release note state (if you have access) 
2. Enter your extended release note in the below block; leaving it blank means using the PR title as the release note. If no release note is required, just write `NONE`. 
-->
```release-note
NONE
```
2016-10-20 05:29:41 -07:00
gmarek fbb3d6bf88 Generalize Node preparation for e2e and integration tests 2016-10-20 11:51:41 +02:00
Kubernetes Submit Queue d7e6458eab Merge pull request #35131 from wongma7/e2e-pv-restartpolicy
Automatic merge from submit-queue

Set non-always RestartPolicy for write-pod in pv e2e

Due to https://github.com/kubernetes/kubernetes/pull/34632 the RestartPolicy can't be Always (& it shouldn't be anyway)
2016-10-20 02:46:48 -07:00
Kubernetes Submit Queue b559cc3200 Merge pull request #35158 from foxish/petset-redis-fix
Automatic merge from submit-queue

Fixing flakes caused by petset tests.

**What this PR does / why we need it**: We should wait till the key/value has been replicated to database slaves before trying to read from them.

**Which issue this PR fixes** Fixes https://github.com/kubernetes/kubernetes/issues/33904, https://github.com/kubernetes/kubernetes/issues/33895

cc @kubernetes/sig-apps
2016-10-19 22:41:59 -07:00
Kubernetes Submit Queue 3e22b38f70 Merge pull request #34653 from rata/simplify-e2e-secret
Automatic merge from submit-queue

Add secret e2e test for keys mapping

**What this PR does / why we need it**: Adds a basic e2e test missing in secrets

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, #<issue_number>, ...)` format, will close that issue when PR gets merged)*:

**Special notes for your reviewer**:

**Release note**:
```NONE
```
This patch adds a secret e2e test. While configmap e2e tests are far
more complete, this patch makes secret e2e tests one step closer.

Also, now is more easy to add more tests without code duplication (as I
did in earlier patches :-/), because of the functions created, and is
more easy to make it similar to confimap e2e in the future, that is
really complete.
2016-10-19 21:58:31 -07:00
Anirudh bbc282c5b8 fixing lint. 2016-10-19 20:21:01 -07:00
Anirudh eeeffbb183 Fixed based on comments 2016-10-19 18:50:34 -07:00
Anirudh 38a6f38c6d Fixing flake caused by lack of polling during read. 2016-10-19 17:32:05 -07:00
Janet Kuo b9ec5e38da Verify petset status.replicas in e2e test 2016-10-19 16:20:19 -07:00
bprashanth 5029bb06e9 Validation 2016-10-19 14:51:57 -07:00
Kubernetes Submit Queue a2460ad308 Merge pull request #35082 from mml/disruption-wait
Automatic merge from submit-queue

Wait for all pods to be running before checking PDB status.
2016-10-19 14:01:09 -07:00
bprashanth eb235a8218 E2e tests 2016-10-19 13:49:49 -07:00
Kubernetes Submit Queue 91b7e1f9c3 Merge pull request #34638 from screeley44/k8-get-sc
Automatic merge from submit-queue

Adding default StorageClass annotation printout for resource_printer and describer and some refactoring

adding ISDEFAULT for _kubectl get storageclass_ output

```
[root@screeley-sc1 gce]# kubectl get storageclass
NAME            TYPE                   ISDEFAULT
another-class   kubernetes.io/gce-pd   NO        
generic1-slow   kubernetes.io/gce-pd   YES       
generic2-fast   kubernetes.io/gce-pd   YES       
```

```release-note
Add ISDEFAULT to kubectl get storageClass output
```

@kubernetes/sig-storage
2016-10-19 11:36:08 -07:00
Matthew Wong 15d02afea5 Set non-always RestartPolicy for write-pod in pv e2e 2016-10-19 11:56:27 -04:00
Matthew Wong 28f1d48bb4 Set done to true & return error if RestartPolicy not Always 2016-10-19 11:34:05 -04:00
Scott Creeley 86f1a94be5 Adding default StorageClass annotation printout for resource_printer 2016-10-19 10:59:07 -04:00
gmarek f08f751831 Use clientset in GetReadySchedulableNodesOrDie 2016-10-19 15:55:39 +02:00
Kubernetes Submit Queue cd44cec587 Merge pull request #34765 from ivan4th/fix-more-typos
Automatic merge from submit-queue

Fix typos
2016-10-19 00:21:11 -07:00
Rodrigo Campos 64479aa9a5 Remove deferred deletion call missed by 53ec6e6
Commit 53ec6e6 missed to remove this deferred call (probably due to a
rebase).

I noticied it while working with the code. I'm not sure why the original
commits removes them, but it seems the right thing to do.
2016-10-19 00:53:25 -03:00
Rodrigo Campos ad03a43dbe Add secret e2e test for keys mapping
This patch adds a secret e2e test. While configmap e2e tests are far
more complete, this patch makes secret e2e tests one step closer.

Also, now is more easy to add more tests without code duplication (as I
did in earlier patches :-/), because of the functions created, and is
more easy to make it similar to confimap e2e in the future, that is
really complete.
2016-10-19 00:51:13 -03:00
Matt Liggett c04ab43df5 Wait for all pods to be running before checking PDB status.
Hoping to avoid timeout errors as in #34032.
2016-10-18 18:01:27 -07:00
Michail Kargakis 12455bf5e1 hack: add test for overlapping selectors in deployments 2016-10-18 17:46:34 +02:00
Kubernetes Submit Queue 5b0edbd56d Merge pull request #34991 from yujuhong/disable_misc
Automatic merge from submit-queue

e2e: stop tracking resource usage for the "misc" container

There is e2e test checking the resource usage of "misc", and it is not
supported on GCI.
2016-10-18 02:48:44 -07:00
Kubernetes Submit Queue 6a1e8c98e0 Merge pull request #34989 from caesarxuchao/new-client-go-structure
Automatic merge from submit-queue

New client-go structure

This PR is part of restructuring client-go (https://github.com/kubernetes/client-go/issues/9#issue-181545998). In short, the top-level folder for client-go versions are removed.

This PR also runs copy.sh to pick up changes in the main repository. The number of files in client-go has increase from 1361 files to 1405.

@mbohlool @mml @timoreimann
2016-10-18 01:13:50 -07:00
Kubernetes Submit Queue 2a21384862 Merge pull request #33781 from rmmh/test-list
Automatic merge from submit-queue

Add test_list command, to enumerate unit and e2e tests.

This uses go/parser and go/ast to analyze all test files in ~1 second.
It only recognizes a few simple structures that the tests all have, and
modifies a few tests to fit expected structure better.

This is part of an effort to ensure all tests have owners, by having a
verify check to catch new tests being added without an owner.
2016-10-17 17:12:28 -07:00
Kubernetes Submit Queue 1da120ca8a Merge pull request #34961 from kubernetes/revert-32485-e2e-provisioning-class
Automatic merge from submit-queue

Revert "Add e2e tests for storageclass"

Reverts kubernetes/kubernetes#32485

This PR broke the multizone tests on GCE/GKE, and broke the AWS tests, e.g.:
* https://k8s-testgrid.appspot.com/google-aws
* https://k8s-testgrid.appspot.com/google-gke#gke-multizone
* https://k8s-testgrid.appspot.com/google-gke#gci-gke-multizone
Suggest revert. 

Fixes #34794

cc @k8s-oncall
2016-10-17 17:12:20 -07:00
Ryan Hitchman 7a573d4d3c Add test_list command, to enumerate unit and e2e tests.
This uses go/parser and go/ast to analyze all test files in ~1 second.
It only recognizes a few simple structures that the tests all have, and
modifies a few tests to fit expected structure better.

This is part of an effort to ensure all tests have owners, by having a
verify check to catch new tests being added without an owner.
2016-10-17 15:56:33 -07:00
Yu-Ju Hong 1c57df2dc2 e2e: stop tracking resource usage for the "misc" container
There is e2e test checking the resource usage of "misc", and it is not
supported on GCI.
2016-10-17 15:55:22 -07:00
Chao Xu 923757f3e0 rewrite client-go import path in the main repository
convert e2e tests of client-go to use version options
2016-10-17 15:35:19 -07:00
Kubernetes Submit Queue cefd680d72 Merge pull request #33811 from pmorie/e2e-ns-cleanup
Automatic merge from submit-queue

Make E2E tests easier to debug

This PR removes deferred deletion calls in E2E tests in order to make test easier to debug.  Some of these tests predate namespace finalization; we should just rely on that mechanism to ensure that framework test artifacts are deleted.
2016-10-17 13:29:41 -07:00
Mik Vyatskov 9832ae1259 Update elasticsearch and kibana usage 2016-10-17 21:04:25 +02:00
Zach Loafman 22352d2844 Revert "Add e2e tests for storageclass" 2016-10-17 10:32:27 -07:00
Kubernetes Submit Queue 772b27da01 Merge pull request #34942 from kargakis/e2e-fix
Automatic merge from submit-queue

test: wait for complete rollouts in WaitForDeploymentStatusValid

@kubernetes/deployment should fix https://github.com/kubernetes/kubernetes/issues/34816 once and forever
2016-10-17 10:21:00 -07:00
Paul Morie fd76e6a05e Make Framework.MatchContainerOutput able to use GenerateName 2016-10-17 12:38:15 -04:00
Kubernetes Submit Queue b008c683ec Merge pull request #34548 from kargakis/estimate-available-from-rs
Automatic merge from submit-queue

controller: set minReadySeconds in deployment's replica sets

* Estimate available pods for a deployment by using minReadySeconds on
the replica set.
* Stop requeueing deployments on pod events, superseded by following the
replica set status.
* Cleanup redundant deployment utilities

Fixes https://github.com/kubernetes/kubernetes/issues/26079

@kubernetes/deployment ptal
2016-10-17 08:44:51 -07:00
Paul Morie 53ec6e60fe Remove deferred deletion calls from E2E tests 2016-10-17 10:36:22 -04:00
Michail Kargakis 71df8f6544 test: wait for complete rollouts in WaitForDeploymentStatusValid 2016-10-17 13:19:28 +02:00
Kubernetes Submit Queue 9d137ba499 Merge pull request #34756 from jayunit100/vipercleanup
Automatic merge from submit-queue

Cleanup the commented code for overriding flags with viper.  For now,…

Minor cleanup for the viper configuration logic, removes commented  code into a function of its own.  We can decide wether or not to overwrite flag values at a later time...
2016-10-15 00:51:41 -07:00
Kubernetes Submit Queue b1b8e9e403 Merge pull request #34544 from gmarek/split
Automatic merge from submit-queue

Move RunRC-like functions to test/utils

Ref. #34336

cc @timothysc - the "move" part of the small refactoring. @jayunit100
2016-10-14 07:22:38 -07:00
Kubernetes Submit Queue 3e209aee7b Merge pull request #34814 from Crassirostris/gcl-test-flakiness
Automatic merge from submit-queue

Introduce additional debug logging to cluster logging tests

@piosz
2016-10-14 06:41:44 -07:00
Kubernetes Submit Queue bab34824a6 Merge pull request #34642 from yujuhong/dns_policy
Automatic merge from submit-queue

Set the dns policy for pods in node e2e tests
2016-10-14 05:45:34 -07:00
Mik Vyatskov 8eaec85855 Introduce additional debug logging to cluster logging tests 2016-10-14 14:07:41 +02:00
Kubernetes Submit Queue 92cb90fc5d Merge pull request #34724 from kargakis/another-test-fix
Automatic merge from submit-queue

e2e: don't require minimum availability once scaling takes place

This test shouldn't care about availability at all in the first place.

@mfojtik @kubernetes/deployment  ptal

Fixes https://github.com/kubernetes/kubernetes/issues/34717
2016-10-14 05:03:32 -07:00
Kubernetes Submit Queue 64f52a2725 Merge pull request #32485 from jsafrane/e2e-provisioning-class
Automatic merge from submit-queue

Add e2e tests for storageclass

- test pd-ssd and pd-standard on GCE,
- test all four volume types and encryption on AWS
- test just the default volume type on OpenStack (right now, there is no API
  to get list of them)

These tests are quite slow, e.g. there are two tests on AWS that has to run mkfs.ext4 on 500 GB magnetic drive with low IOPS, which takes ~3-4 minutes each.
2016-10-13 21:51:27 -07:00
Kubernetes Submit Queue 01189549f3 Merge pull request #34565 from timstclair/flake
Automatic merge from submit-queue

Fix race condition in test with git server startup

Fixes https://github.com/kubernetes/kubernetes/issues/32467 (hopefully)

Previously, the test didn't ensure the git server was running before attempting to connect to it.
2016-10-13 17:53:11 -07:00
Ivan Shvedunov 2b427f7d59 Fix typos 2016-10-14 00:29:50 +03:00
Mik Vyatskov 1c03b5ed13 Marked GCL logging test as Flaky 2016-10-13 23:03:16 +02:00
jayunit100 430921eec4 Cleanup the commented code for overriding flags with viper. For now, leave that functinoality unused with a TODO if we want to override flag values w/ viper visitor pattern 2016-10-13 16:14:05 -04:00
Michail Kargakis cc2550c4e1 e2e: don't require minimum availability once scaling takes place 2016-10-13 18:14:45 +02:00
Jan Safranek c9c1147270 Add e2e tests for storageclass
- test pd-ssd and pd-standard on GCE,
- test all four volume types on AWS
- test just the default volume type on OpenStack (right now, there is no API
  to get list of them)
2016-10-13 15:37:08 +02:00
Wojciech Tyczynski 00a437bb5c Fix ginkgo panic in density test 2016-10-13 14:12:41 +02:00
Michail Kargakis 212a26dc95 controller: set minReadySeconds in deployment's replica sets
* Estimate available pods for a deployment by using minReadySeconds on
the replica set.
* Stop requeueing deployments on pod events, superseded by following the
replica set status.
* Cleanup redundant deployment utilities
2016-10-13 12:27:47 +02:00
Mik Vyatskov 2d3f294e2d Fix ES cluster logging test 2016-10-13 11:53:46 +02:00
Kubernetes Submit Queue 523fce990a Merge pull request #32781 from lukaszo/ready_ds
Automatic merge from submit-queue

Add ReadyScheduled to DaemonSet status

Fixes #25605

cc @bgrant0607 @mikedanese
2016-10-13 00:25:56 -07:00
Kubernetes Submit Queue 726c2e7c2a Merge pull request #34652 from quinton-hoole/2016-10-12-fix-fed-e2e-resource-leak
Automatic merge from submit-queue

Fix leaking ingress resources in federated ingress e2e test.

Originally the federated ingresses were being deleted, but due to the lack of cascading deletion, the cluster ingresses were never being deleted, leading to leaked GCE loadbalancer resources.  This fixes that.
2016-10-12 22:30:12 -07:00
Yu-Ju Hong dae055dcd6 Set the dns policy for pods in node e2e tests
This change stops kubelet from sending MissingClusterDNS events for every pod.
2016-10-12 17:20:31 -07:00
Kubernetes Submit Queue 83b2651eaa Merge pull request #34632 from Random-Liu/fix-wait-for-success
Automatic merge from submit-queue

Fix the wait for pod success in test framework.

Fixes https://github.com/kubernetes/kubernetes/issues/34623.
Addresses https://github.com/kubernetes/kubernetes/issues/33189#issuecomment-253282725.
Related to #34630.

This PR:
1) Changes `WaitForPodSuccessInNamespace` to use pod phase instead of container status because of https://github.com/kubernetes/kubernetes/issues/33189#issuecomment-253287397. The code was introduced because of https://github.com/kubernetes/kubernetes/issues/2632, which is never true now.
2) Fixes the cluster logging test to set the pod as `RestartOnFailure`.

@yujuhong @Crassirostris
2016-10-12 16:38:27 -07:00
Quinton Hoole 455e79bd52 Fix leaking ingress resources in federated ingress e2e test. 2016-10-12 15:12:54 -07:00
Random-Liu bab971d002 Fix the wait for pod success in test framework. 2016-10-12 11:33:40 -07:00
Kubernetes Submit Queue 71249bb82b Merge pull request #34462 from yujuhong/ignore_pods
Automatic merge from submit-queue

Ignore mirror pods with RestartPolicy == Never in restart tests

Kubelet does not sync the mirror pods once they have terminated. If, for some
reason, that such mirror pods get deleted once they have terminated (either by
the node controller or by users), kubelet will not attempt to recreate them.
However, when kubelet restarts, it will examine the static pods, sync once,
and create a mirror pod. This has led to unexpected pod counts in disruptive
tests where kubelet gets restarted on purpose (see #34003).

This change disregard such mirror pods when totaling the pods to fix the test
flake until we have time to implement a long-term solution.

This PR addresses #34003
2016-10-12 10:54:23 -07:00
Kubernetes Submit Queue 12b133577e Merge pull request #33278 from Crassirostris/gcl-e2e-test
Automatic merge from submit-queue

Add gcl cluster logging test

This PR changes default logging destination for tests to gcp and adds test for cluster logging using google cloud logging

Fix #20760
2016-10-12 06:54:25 -07:00
Łukasz Oleś 5d2e215652 Add NumberReady to DaemonSet status
Fixes #25605
2016-10-12 15:15:10 +02:00
gmarek 7681a1bdff Move RunRC-like functions to test/utils 2016-10-12 15:06:56 +02:00
gmarek 66c82a223c Inject logFunc into RunPods 2016-10-12 13:44:43 +02:00
Kubernetes Submit Queue 4747e1cc1d Merge pull request #34597 from gmarek/prompush
Automatic merge from submit-queue

Remove prompush from test/e2e

Ref. #34336

cc @timothysc
2016-10-12 03:14:16 -07:00
Kubernetes Submit Queue 24bb97907c Merge pull request #34316 from kargakis/set-failure-traps-in-deployment-test
Automatic merge from submit-queue

test: move deployment deletion in its own test

@kubernetes/deployment this PR moves the deletion of deployment in its own test (no need to delete deployments in every test since the namespace controller does that for us once the namespace gets deleted after the test finishes)

Fixes https://github.com/kubernetes/kubernetes/issues/33256
2016-10-12 03:14:03 -07:00
Kubernetes Submit Queue 7cf00d8cce Merge pull request #34545 from gmarek/inject
Automatic merge from submit-queue

Make logging function injectable in RCConfig

Ref. #34336

cc @timothysc - the "move" part of the small refactoring. @jayunit100
2016-10-12 02:11:44 -07:00
gmarek b607c5cbee Remove prompush from test/e2e 2016-10-12 10:31:45 +02:00
Kubernetes Submit Queue ff43515ff7 Merge pull request #34140 from timothysc/e2e-variant
Automatic merge from submit-queue

remove [Conformance] flag on some e2es 

Downstream distributions that absorb the upstream tests would like to give their customers a standard mechanism to validate their clusters, post setup. As of today [Conformance] works for most things, but there are a known set of tests that vary due to opinionated differences around networking, security, etc... and providing a complete skip list can be cumbersome.  To address this, we've simply modified the flag on some tests to [Conformance:Variant].  All existing behavior should be maintained. 

Fixes: #34105
2016-10-11 16:01:42 -07:00
Tim St. Clair 3dddd34d3a
Fix race condition in test with git server startup 2016-10-11 12:35:09 -07:00
Yu-Ju Hong 11cdcca35d Ignore mirror pods with RestartPolicy == Never in restart tests
Kubelet does not sync the mirror pods once they have terminated. If, for some
reason, that such mirror pods get deleted once they have terminated (either by
the node controller or by users), kubelet will not attempt to recreate them.
However, when kubelet restarts, it will examine the static pods, sync once,
and create a mirror pod. This has led to unexpected pod counts in disruptive
tests where kubelet gets restarted on purpose (see #34003).

This change disregard such mirror pods when totaling the pods to fix the test
flake until we have time to implement a long-term solution.
2016-10-11 12:15:33 -07:00
gmarek 1aff115f44 Make logging function injectable in RCConfig 2016-10-11 16:46:33 +02:00
Michail Kargakis 712ad06ed7 test: move deployment deletion in its own test
Defer deployment deletion to the namespace controller for all other tests
2016-10-11 15:22:32 +02:00
Mik Vyatskov b9c72ee1cb Add gcl cluster logging test 2016-10-11 09:36:11 +02:00
Kubernetes Submit Queue 9e2f868be0 Merge pull request #34360 from bprashanth/np_fix
Automatic merge from submit-queue

Remove onlyLocal NodePort e2e till pr #33957

We were basically testing this bug: https://github.com/kubernetes/kubernetes/issues/30809
We fixed the bug: https://github.com/kubernetes/kubernetes/pull/33587, but forgot to remove the "test". 
This pr adds a test for the new feature: https://github.com/kubernetes/kubernetes/pull/33957 (ensure that nodePort with onlyLocal works only on nodes with endpoints and fails otherwise)

fixes https://github.com/kubernetes/kubernetes/issues/34124
2016-10-10 14:49:01 -07:00
Timothy St. Clair eb29c6133b Remove [Conformance] flag on e2es which we know are
subject to change downstream.
2016-10-10 15:48:26 -05:00
gmarek 8d3973c2f4 Small refactoring of scheduler predicates 2016-10-10 13:13:15 +02:00
Kubernetes Submit Queue ef1ba5f2be Merge pull request #33160 from m1093782566/m109-petset-internal-int32
Automatic merge from submit-queue

[Pet Set] petset internal replicas type should be int32

<!--  Thanks for sending a pull request!  Here are some tips for you:
1. If this is your first time, read our contributor guidelines https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md and developer guide https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md
2. If you want *faster* PR reviews, read how: https://github.com/kubernetes/kubernetes/blob/master/docs/devel/faster_reviews.md
3. Follow the instructions for writing a release note: https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes
-->

**What this PR does / why we need it**:

Fixes #32993 

Sometimes an int is 4 bytes and sometimes it's 8(depend on CPU architecture), but an int32 is always 32bits. So set petset internal replicas type to int32, avoid type casting in API version converting.
2016-10-09 16:08:11 -07:00
Kubernetes Submit Queue 853ee4c9f7 Merge pull request #34399 from brendandburns/e2efix
Automatic merge from submit-queue

Fix a formatting string.

Related to #33793
2016-10-08 19:04:06 -07:00