Commit Graph

3412 Commits (e1fb51436fe3afd2daf2b5cbc9eecdf6a40e8ffc)

Author SHA1 Message Date
k8s-merge-robot b79a1bb689 Merge pull request #25410 from gmarek/pipe
Automatic merge from submit-queue

Pipe variables from kubemark config to master binaries
2016-05-11 03:45:31 -07:00
gmarek 4a5ec11ce6 Pipe variables from kubemark config to master binaries 2016-05-11 11:22:03 +02:00
Fabio Yeon 0809b2be4d Merge pull request #25119 from XiaoningDing/api-shared-annotations
move shared annotations to new api/annotations package
2016-05-10 19:34:17 -07:00
derekwaynecarr fc3e71894d Improve quota integration test to not use events, reduce number of pods provisioned 2016-05-10 19:50:36 -04:00
Chao Xu c7d111280f let dynamic client take runtime.Object instead of v1.ListOptions 2016-05-10 16:05:31 -07:00
Fabio Yeon c4a2724eb2 Merge pull request #25080 from derekwaynecarr/quota_controller_close_channels
Quota integration test was not closing launched controllers
2016-05-10 15:49:59 -07:00
CJ Cullen eb3b0e78b4 Add a webhook token authenticator plugin. 2016-05-10 14:54:35 -07:00
Prashanth Balasubramanian 74ccd24574 Endpoints controller respects unready service annotation 2016-05-10 14:20:10 -07:00
Jay Vyas 801c968fff Standard input for kubectl tests
rebased to include gobindata as well.
2016-05-10 14:16:50 -04:00
Fabio Yeon 6f288b31cf Merge pull request #25364 from krousey/proxy_exec_flake
Adding extra logging in case of error.
2016-05-10 10:37:30 -07:00
derekwaynecarr e842f12c8c Quota integration test needs to stop controllers 2016-05-10 12:31:35 -04:00
k8s-merge-robot c4214f743f Merge pull request #24918 from Random-Liu/add-docker-operation-timeout
Automatic merge from submit-queue

Kubelet: Add docker operation timeout

For #23563.
Based on #24748, only the last 2 commits are new.

This PR:
1) Add timeout for all docker operations.
2) Add docker operation timeout metrics
3) Cleanup kubelet stats and add runtime operation error and timeout rate monitoring.
4) Monitor runtime operation error and timeout rate in kubelet perf.

@yujuhong 
/cc @gmarek Because of the metrics change.
/cc @kubernetes/sig-node
2016-05-09 21:51:52 -07:00
Kris d63a215b23 Adding extra logging in case of error. 2016-05-09 11:40:05 -07:00
jianhuiz 441e206671 move server client shared annotations to new api/annotations package 2016-05-09 11:10:44 -07:00
k8s-merge-robot 4642621baf Merge pull request #25348 from gmarek/cidr
Automatic merge from submit-queue

Make Kubemark assign cluster CIDRs
2016-05-09 07:32:36 -07:00
gmarek 7981f479de Make Kubemark assign cluster CIDRs 2016-05-09 15:09:37 +02:00
k8s-merge-robot 1a1229e206 Merge pull request #24795 from deads2k/use-all-attributes
Automatic merge from submit-queue

enable resource name and service account cases for impersonation

Adds the resource name check since that attribute was added for authorization.  Also adds a check against a separate resource for service accounts.  Allowing impersonation of service accounts to use a different resource check places control of impersonation with the same users to have the power to get the SA tokens directly.

@kubernetes/kube-iam 
@sgallagher FYI
2016-05-09 04:58:19 -07:00
k8s-merge-robot 84db106ecb Merge pull request #24701 from euank/addon-ssh-user
Automatic merge from submit-queue

test/e2e/addon_update: Respect KUBE_SSH_USER

This change makes the e2e tests more consistent as the other ones all already respected this variable.

I didn't do the larger change of re-factoring it to use `framework.SSH` because getting the `scp` portion working there has some significant complexity. If I find time, I'd like to go back and do it since this test needs a little ❤️

cc @yifan-gu, @kubernetes/sig-testing
2016-05-09 03:31:48 -07:00
k8s-merge-robot 761fc00234 Merge pull request #25337 from wojtek-t/content_type_in_tests
Automatic merge from submit-queue

Enable using protobufs in e2e tests

ref #25132
2016-05-09 02:50:03 -07:00
k8s-merge-robot 87cf3a31bb Merge pull request #24544 from gmarek/heapster
Automatic merge from submit-queue

Add heapster to kubemark

cc @mwielgus
2016-05-09 02:49:59 -07:00
Wojciech Tyczynski cb875e0f8c Enable using protobufs in e2e tests 2016-05-09 10:57:35 +02:00
Piotr Szczesniak 212b459817 Move internal types of hpa from pkg/apis/extensions to pkg/apis/autoscaling 2016-05-09 09:18:13 +02:00
Tim Hockin cbf886c7f4 Convert everything to use vendor/ 2016-05-08 20:30:37 -07:00
k8s-merge-robot d4b1b6776a Merge pull request #24557 from swagiaal/attacher-interface
Automatic merge from submit-queue

 Abstract node side functionality of attachable plugins

- Create PhysicalAttacher interface to abstract MountDevice and
  WaitForAttach.
- Create PhysicalDetacher interface to abstract WaitForDetach and
  UnmountDevice.
- Expand unit tests to check that Attach, Detach, WaitForAttach,
  WaitForDetach, MountDevice, and UnmountDevice get call where
  appropriet.

Physical{Attacher,Detacher} are working titles suggestions welcome. Some other thoughts:
- NodeSideAttacher or NodeAttacher.
- AttachWatcher
- Call this Attacher and call the Current Attacher CloudAttacher.
- DeviceMounter (although there are way too many things called Mounter right now :/)

This is to address: https://github.com/kubernetes/kubernetes/pull/21709#issuecomment-192035382

@saad-ali
2016-05-08 14:04:44 -07:00
k8s-merge-robot f40fe7173b Merge pull request #24304 from cjcullen/cacheauth
Automatic merge from submit-queue

Support persisting config from kubecfg AuthProvider plugins

Plumbs through an interface to the plugin that can persist a `map[string]string` config for just that plugin. Also adds `config` to the AuthProvider serialization type, and `Login()` to the AuthProvider plugin interface.
Modified the gcp AuthProvider to cache short-term access tokens in the kubecfg file.

Builds on #23066 
@bobbyrullo @deads2k @jlowdermilk @erictune
2016-05-08 13:27:57 -07:00
k8s-merge-robot 53b3ef2122 Merge pull request #23988 from php-coder/kubectl_describe_multiline_labels
Automatic merge from submit-queue

kubectl describe: show multiple labels/annotations on multiple lines

Small UX improvement: when there is more than one label/annotation, it's more readable to see them on the different lines.

Before:
```console
$ kubectl describe svc
Name:			s2i-test
Namespace:		test2
Labels:			app=s2i-test,foo=bar
...
```
After:
```console
$ kubectl describe svc
Name:			s2i-test
Namespace:		test2
Labels:			app=s2i-test
				foo=bar
...
```
This change affects output of the labels/annotations in many of the sub-commands of the `kubectl describe`.

PTAL @smarterclayton @kargakis
2016-05-08 12:51:45 -07:00
k8s-merge-robot f46f35a9df Merge pull request #23600 from mikedanese/addon-manager
Automatic merge from submit-queue

run kube-addon-manager in a static pod

Depends on https://github.com/kubernetes/kubernetes/pull/23605 and https://github.com/kubernetes/kubernetes/pull/24108

Ref #23233
2016-05-08 11:30:44 -07:00
k8s-merge-robot 601e09852c Merge pull request #23590 from kargakis/timeout-logs-attach
Automatic merge from submit-queue

kubectl: more sophisticated pod selection for logs and attach

Trying to get the logs or attach to an object other than a pod
will poll forever if that object has no replicas. This commit adds
a 20s timeout for polling.

@kubernetes/kubectl @deads2k @fabianofranz
2016-05-08 10:51:00 -07:00
k8s-merge-robot 8a04506546 Merge pull request #23009 from uluyol/c-pause
Automatic merge from submit-queue

Reimplement 'pause' in C - smaller footprint all around

Statically links against musl. Size of amd64 binary is 3560 bytes.

I couldn't test the arm binary since I have no hardware to test it on, though I assume we want it to work on a raspberry pi.

This PR also adds the gcc5/musl cross compiling image used to build the binaries.

@thockin
2016-05-08 09:29:32 -07:00
k8s-merge-robot f2f3b49f58 Merge pull request #22575 from MikaelCluseau/wip-issue-20466
Automatic merge from submit-queue

Add subPath to mount a child dir or file of a volumeMount

Allow users to specify a subPath in Container.volumeMounts so they can use a single volume for many mounts instead of creating many volumes. For instance, a user can now use a single PersistentVolume to store the Mysql database and the document root of an Apache server of a LAMP stack pod by mapping them to different subPaths in this single volume.

Also solves https://github.com/kubernetes/kubernetes/issues/20466.
2016-05-08 08:45:15 -07:00
CJ Cullen 13a7d92d0f Add a ConfigPersister for AuthProvider plugins in kubectl/clients. 2016-05-07 18:15:18 -07:00
David Oppenheimer b0bd3ff167 Move inter-pod affinity predicate and priority functions from default to
non-default due to negative performance effects even when not using
the feature.
2016-05-07 16:57:07 -07:00
Robert Bailey dcd6df15cf Merge pull request #25295 from spxtr/disable-test
PersistentVolumes NFS test to the flaky suite.
2016-05-06 20:35:45 -07:00
k8s-merge-robot 2b46c4b7e2 Merge pull request #24391 from bprashanth/ing_templated_controller
Automatic merge from submit-queue

Template the ingress controller 

We still need https://github.com/kubernetes/contrib/pull/791 to run the controller as a static pod
ref https://github.com/kubernetes/kubernetes/issues/23663
2016-05-06 20:04:51 -07:00
Joe Finney fa74d2c9de PersistentVolumes NFS test to the flaky suite. 2016-05-06 18:26:19 -07:00
Huamin Chen 079474b69e add GCE PD volume e2e tests
Signed-off-by: Huamin Chen <hchen@redhat.com>
2016-05-06 22:13:04 +00:00
Robert Bailey 18a829e7a4 Merge pull request #24512 from freehan/goproxyflake
reuse goproxy pod and avoid race between kubectl exec and goproxy readiness
2016-05-06 14:46:30 -07:00
Robert Bailey 8bebc448cb Merge pull request #25004 from yifan-gu/mask_locksmithd
e2e_node: Disable auto restart on CoreOS.
2016-05-06 14:15:43 -07:00
Robert Bailey 6c3ed90b66 Merge pull request #24804 from ncdc/fix-node-e2e-failure-output
Fix node e2e startServer failure output
2016-05-06 13:26:41 -07:00
Mike Danese 3e1c0b5951 run kube-addon-manager in a pod 2016-05-06 11:01:06 -07:00
Random-Liu 148588e6a1 1) Add docker operation timeout metrics.
2) Cleanup kubelet stats and add runtime operation error and timeout
rate monitoring.
3) Monitor runtime operation error and timeout rate in
kubelet perf.
2016-05-06 10:53:13 -07:00
Jay Vyas 326b213231 Consolidate node selecting tests to only use Schedulable + Running
nodes.
2016-05-06 10:32:12 -04:00
k8s-merge-robot 9f2d75adf3 Merge pull request #25128 from jsafrane/devel/enable-volume-test
Automatic merge from submit-queue

e2e: Enable persistent volume test

The test is already there and all packages should be already available on all test machines.
    
It tests:

- binding
- using bound claim in a pod
- recycling NFS volume

(we should see shortly if all nfs packages are really installed as Jenkins tests it...)
2016-05-06 05:34:12 -07:00
Kevin 82ba4f077e implement inter pod topological affinity and anti-affinity 2016-05-06 06:46:23 +00:00
k8s-merge-robot 2ebd771915 Merge pull request #25121 from liangchenye/flakepodnotfound
Automatic merge from submit-queue

fix #24937:  flake pod not found

https://github.com/kubernetes/kubernetes/issues/24937
Split from #24191
Signed-off-by: liang chenye <liangchenye@huawei.com>
2016-05-05 22:40:58 -07:00
Mikaël Cluseau 06900a934d Introduce subPath in VolumeMount 2016-05-06 15:08:41 +11:00
k8s-merge-robot ab36e0e35e Merge pull request #24710 from smarterclayton/store_proto_in_etcd
Automatic merge from submit-queue

Allow etcd to store protobuf objects

Split storage serialization from client negotiation, and allow API server to take flag controlling serialization.

TODO:

* [x] API server still doesn't start - range allocation object doesn't seem to round trip correctly to etcd
* [ ] Verify that third party resources are ignoring protobuf (add a test)
* [ ] Add integration tests that verify storage is correctly protobuf
* [ ] Add a global default for which storage format to prefer?
2016-05-05 19:00:20 -07:00
Clayton Coleman ea4a7e24ad
Remove the cluster DNS verification check from the test
Alternate DNS implementations may be conformant without implementing DNS
as a pod.
2016-05-05 14:04:48 -04:00
k8s-merge-robot 1f6711ca07 Merge pull request #25192 from ingvagabund/e2e-framework-util-start-pods-dont-wait-for-zero-pods
Automatic merge from submit-queue

e2e/framework/util.StartPods: don't wait for pods that are not created

When running ``[k8s.io] SchedulerPredicates [Serial] validates resource limits of pods that are allowed to run [Conformance]`` pods can be created in a way in which additional pods have to be create to fully saturate node's capacity CPU in a cluster. Additional pods are created by calling ``framework.StartPods``. The function creates pods with a given label and waits for them (if ``waitForRunning`` is ``true``). This is fine as long as the number of pods to created is non-zero. If there are zero pods to be created and ``waitForRunning`` is ``true``, the function waits forever as there is not going to be any pods with requested label. Thus, resulting in ``Error waiting for 0 pods to be running - probably a timeout``. Causing the e2e test to fail even if it should not.

Adding condition to return from the function immediately if there is not pod to create.
2016-05-05 09:49:43 -07:00
Prashanth Balasubramanian 2d7e2eb09f Modify e2e to wait for RC to stabilize before test 2016-05-05 09:27:19 -07:00
Clayton Coleman e0ebcf4216
Split the storage and negotiation parts of Codecs
The codec factory should support two distinct interfaces - negotiating
for a serializer with a client, vs reading or writing data to a storage
form (etcd, disk, etc). Make the EncodeForVersion and DecodeToVersion
methods only take Encoder and Decoder, and slight refactoring elsewhere.

In the storage factory, use a content type to control what serializer to
pick, and use the universal deserializer. This ensures that storage can
read JSON (which might be from older objects) while only writing
protobuf. Add exceptions for those resources that may not be able to
write to protobuf (specifically third party resources, but potentially
others in the future).
2016-05-05 12:08:23 -04:00
k8s-merge-robot f5e1e9a227 Merge pull request #24912 from bprashanth/petset_controller
Automatic merge from submit-queue

Petset controller

Took longer than I expected. Main parts of this pr are:
1. Identity generation based on petset spec (volumes are mapped per discussion in #18016)
2. Ensure that we create/delete pets in sequence
3. Ensuring that we create, wait for healthy, create; or delete, wait for terminationGrace, delete
4. Controller that watches apiserver and drives actual -> desired

PVCs are not deleted, yet.
2016-05-05 08:58:23 -07:00
gmarek 78331db78d Fix units in kubemark resource gatherer 2016-05-05 14:10:21 +02:00
Jan Chaloupka 59fc509fb7 e2e/framework/util.StartPods: don't wait for pods that are not created 2016-05-05 12:28:03 +02:00
liang chenye 3c9306e521 fix #24937: flake pod not found
Signed-off-by: liang chenye <liangchenye@huawei.com>
2016-05-05 15:29:28 +08:00
k8s-merge-robot 9b5795dd55 Merge pull request #24979 from humblec/patch-1
Automatic merge from submit-queue

Update Dockerfile

## Pull Request Guidelines

1. Please read our [contributor guidelines](https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md).
1. See our [developer guide](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md).
1. Follow the instructions for [labeling and writing a release note for this PR](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes) in the block below.

```release-note
* Use the release-note-* labels to set the release note state 
* Clear this block to use the PR title as the release note 
-OR-
* Enter your extended release note here
```


[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

Exposing 24008 is not required as glusterd listens on 24007 port.
2016-05-04 21:26:34 -07:00
Muhammed Uluyol f3690e2d5e
build/pause: write in C
Builds statically against glibc. References to the old pause
image have been updated.
2016-05-04 21:45:52 -04:00
Prashanth Balasubramanian 6bc3052551 PetSet alpha controller 2016-05-04 18:39:17 -07:00
Alex Robinson c65a6a431e Merge pull request #25148 from a-robinson/nodetag
GCE: Prefer preconfigured node tags for firewalls, if available
2016-05-04 18:16:37 -07:00
Alex Robinson b75fa08aec GCE: Prefer preconfigured node tags for firewalls, if available 2016-05-04 22:49:06 +00:00
Joe Finney 81bb39c3c0 Mark two kubectl tests flaky. 2016-05-04 10:19:05 -07:00
k8s-merge-robot 1642083e60 Merge pull request #24645 from jlowdermilk/rolling-update
Automatic merge from submit-queue

kubectl rolling-update support for same image

Fixes #23497.

Enables `kubectl rolling-update --image` to the same image, adding a `--image-pull-policy` flag to remove ambiguity. This allows rolling-update to behave as an "update and/or restart" (https://github.com/kubernetes/kubernetes/issues/23497#issuecomment-212349730), or as a forced update when the same tag can mean multiple versions (e.g. `:latest`). cc @janetkuo @nikhiljindal
2016-05-04 07:24:22 -07:00
Sami Wagiaalla 71e7dba845 Abstract node side functionality of attachable plugins
- Expand Attacher/Detacher interfaces to break up work more
  explicitly.
- Add arguments to all functions to avoid having implementers store
  the data needed for operations.
- Expand unit tests to check that Attach, Detach, WaitForAttach,
  WaitForDetach, MountDevice, and UnmountDevice get call where
  appropriet.
2016-05-04 10:18:39 -04:00
k8s-merge-robot 3b63b06b1b Merge pull request #24849 from fejta/flake
Automatic merge from submit-queue

Use tagged redis image for kubectl test, move json test file out of deprecated examples

Closes #24642

Changes the redis image to use the :e2e tagged version on gcr.io.

Since the examples/ subdir is deprecated in favor of the new kubernetes/kubernetes.github.io I just copied this file to test-manifests/kubectl like some other files.
2016-05-04 05:53:17 -07:00
Jan Safranek 71796b7098 e2e: Enable persistent volume test
The test is already there and all packages should be already available on all
test machines (namely: mount.nfs).

It tests:
- binding
- using bound claim in a pod
- recycling NFS volume
2016-05-04 13:53:39 +02:00
Isaac Hollander McCreery b1e284fd55 Fix svcPort to cast to int 2016-05-03 09:53:29 -07:00
Isaac Hollander McCreery 8dda27f9d4 Fix calling range variable from goroutine 2016-05-03 09:22:58 -07:00
Isaac Hollander McCreery 9ecbb0ae05 s/testDuringUpgrade/testDuringDisruption 2016-05-03 09:22:58 -07:00
Isaac Hollander McCreery c4479c5b74 gofmt and add comment about waitForReadyOrDone 2016-05-03 09:22:58 -07:00
Isaac Hollander McCreery 27fb17e785 Poll much more frequently, remove wait for pods to be ready, and do one final check 2016-05-03 09:22:58 -07:00
Isaac Hollander McCreery 4e5e1b8ac5 Create chaosmonkey package, use ServiceTestJig for upgrade tests 2016-05-03 09:22:58 -07:00
k8s-merge-robot 926ee5b90f Merge pull request #24641 from caesarxuchao/pods-test
Automatic merge from submit-queue

move pods.go to pods_test.go

fix #24635
2016-05-02 13:16:20 -07:00
Andy Goldstein e630070078 Fix node e2e startServer failure output
Correct the display of the output when e.g. starting the kubelet fails in the node e2e tests. This
change makes it display a string instead of an array of decimal values.
2016-05-02 14:30:59 -04:00
Michail Kargakis a25088fe15 kubectl: more sophisticated pod selection for logs and attach 2016-05-02 15:56:36 +02:00
k8s-merge-robot 66730c53c5 Merge pull request #24445 from vishh/framework-node-e2e
Automatic merge from submit-queue

Framework support for node e2e.

This should let us port existing e2e tests to the node e2e suite, if the tests are node specific.
2016-05-02 02:17:48 -07:00
Yifan Gu d705cc5cf8 e2e_node: Disable auto restart on CoreOS. 2016-05-01 23:48:16 -07:00
Yifan Gu 05951caa44 Revert "Disable coreos nodes from node e2e due to issues with ssh on coreos."
This reverts commit 33a46e0ed6.
2016-04-29 18:24:55 -07:00
Vishnu kannan fa476b8044 Framework support for node e2e.
Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-04-29 15:37:35 -07:00
Clayton Coleman fdb110c859
Fix the rest of the code 2016-04-29 17:12:10 -04:00
Vishnu kannan 33a46e0ed6 Disable coreos nodes from node e2e due to issues with ssh on coreos.
Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-04-29 10:52:41 -07:00
k8s-merge-robot e6295f165a Merge pull request #22869 from jayunit100/iperf-e2e
Automatic merge from submit-queue

[Networking] [E2E]  n-to-1 iperf client->server throughput benchmarking
2016-04-29 10:03:29 -07:00
k8s-merge-robot 2b7021add0 Merge pull request #17030 from csrwng/pf_cmd_streams
Automatic merge from submit-queue

Port-forward: use out and error streams instead of glog

Switches use of glog with command out and error streams
2016-04-29 09:27:47 -07:00
k8s-merge-robot 11298d02e0 Merge pull request #24455 from hongchaodeng/fl
Automatic merge from submit-queue

Provide flags to use etcd3 backed storage

ref: #24405

What's in this PR?
- Add a new flag "storage-backend" to choose "etcd2" or "etcd3". By default (i.e. empty), it's "etcd2".
- Take out etcd config code into a standalone package and let it create etcd2 or etcd3 storage backend given user input.
2016-04-29 08:49:04 -07:00
Humble Devassy Chirammal fbc22b39b9 Update Dockerfile
Exposing 24008 is not required as glusterd listens on 24007 port.
2016-04-29 19:46:30 +05:30
k8s-merge-robot ad67363c12 Merge pull request #24362 from ArtfulCoder/hostname-field
Automatic merge from submit-queue

Promote Pod Hostname & Subdomain to fields (were annotations)

Deprecating the podHostName, subdomain and PodHostnames annotations and created corresponding new fields for them on PodSpec and Endpoints types.

Annotation doc: #22564
Annotation code: #20688
2016-04-29 01:06:45 -07:00
Chao Xu 6ceebe72b9 move pods.go to pods_test.go 2016-04-28 15:39:28 -07:00
Abhishek Shah 8a3ed48808 Added Hostname and Subdomain field to Pod.Spec 2016-04-28 10:56:56 -07:00
Slava Semushin 72b4b54f28 kubectl describe: show multiple labels/annotations on multiple lines.
When there is more than one label/annotation, it's more readable to see
them on the different lines.
2016-04-28 18:37:41 +02:00
k8s-merge-robot a4e16319fd Merge pull request #24329 from liangchenye/refact
Automatic merge from submit-queue

refactor conformance test

@Random-Liu  Rebase the testing code.
 
Signed-off-by: liang chenye <liangchenye@huawei.com>
2016-04-28 03:53:59 -07:00
k8s-merge-robot d0b887e4e0 Merge pull request #24595 from zhouhaibing089/httpserverclose
Automatic merge from submit-queue

Uncomment the code that caused by #19254

Fix https://github.com/kubernetes/kubernetes/issues/24546.

@lavalamp
2016-04-28 01:41:16 -07:00
liang chenye aa3bf1faac refactor e2e_node conformance test
Signed-off-by: liang chenye <liangchenye@huawei.com>
2016-04-28 16:20:14 +08:00
k8s-merge-robot 19408e5575 Merge pull request #24893 from andyzheng0831/gci
Automatic merge from submit-queue

Add support for running clusters on GCI

Google Container-VM Image (GCI) is the next revision of Container-VM. See documentation at https://cloud.google.com/compute/docs/containers/vm-image/. This change adds support for starting a Kubernetes cluster using GCI.

With this change, users can start a kubernetes cluster using the latest kubelet and kubectl release binary built in the GCI image by running:

	$ KUBE_OS_DISTRIBUTION="gci" cluster/kube-up.sh

Or run a testing cluster on GCI by running:

	$ KUBE_OS_DISTRIBUTION="gci" go run hack/e2e.go -v --up

The commands above will choose the latest GCI image by default.
2016-04-27 23:46:26 -07:00
Hongchao Deng c0071a1595 add flags to enable etcd3 2016-04-28 09:48:16 +08:00
k8s-merge-robot e7708cbde2 Merge pull request #24827 from spxtr/fix-region
Automatic merge from submit-queue

Use zone from the test context for static IPs.
2016-04-27 17:24:21 -07:00
Andy Zheng 93929c3853 Add support for running clusters on GCI 2016-04-27 15:24:21 -07:00
Cesar Wong 55114efcb7 Port-forward: use out and error streams instead of glog 2016-04-27 13:26:54 -04:00
k8s-merge-robot 759f11bd4c Merge pull request #24541 from marun/net-e2e-remove-flaky
Automatic merge from submit-queue

Remove flaky tag from e2e net granular

The tests are running reliably on every origin merge and can be verified
similarly reliable on kube.

As per @jayunit100 on slack/sig-testing:

    ./cluster/kubectl.sh 2>&1 | grep Passed | grep Failed ; done
    SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 275 Skipped PASS
    SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 275 Skipped PASS
    SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 275 Skipped PASS
    SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 275 Skipped PASS
    SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 275 Skipped PASS
    SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 275 Skipped PASS
    SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 275 Skipped PASS
    SUCCESS! -- 2 Passed | 0 Failed | 0 Pending | 275 Skipped PASS
2016-04-27 09:11:36 -07:00
gmarek b14809832b Add heapster to kubemark 2016-04-27 16:04:07 +02:00
k8s-merge-robot 32121e344b Merge pull request #24514 from derekwaynecarr/pod_quota_fix
Automatic merge from submit-queue

Quota ignores pod compute resources on updates

Scenario:

1. define a quota Q that tracks memory and cpu
2. create pod P that uses memory=100Mi, cpu=100m
3. update pod P to use memory=50Mi,cpu=10m

Expected Results:
Step 3 should fail with validation error.
Quota Q should not have changed.

Actual Results:
Step 3 fails validation, but quota Q is decremented to have memory usage down 50Mi and cpu usage down 40m.  This is because the quota was getting updated even though the pod was going to fail validation.

Fix:
Quota should only support modifying pod compute resources when pods themselves support modifying their compute resources.

This also fixes https://github.com/kubernetes/kubernetes/issues/24352

/cc @smarterclayton - this is what we discussed.

fyi: @kubernetes/rh-cluster-infra
2016-04-27 06:27:51 -07:00
Erick Fejta 08c5af6e45 Use tagged redis image for kubectl test, move json test file out of deprecated examples 2016-04-26 21:43:19 -07:00
k8s-merge-robot af71fa72e7 Merge pull request #23574 from deads2k/add-extra
Automatic merge from submit-queue

add user.Info.GetExtra

I found myself wanting this field (or something like it), when trying to plumb the information about which scopes a particular token has.

Only the token authenticators have that information and I don't want tokens to leak past the authenticator.  I thought about extending the `authenticator.Token` interface to include scopes (`[]string`), but that felt a little specific for what I wanted to do.  I came up with this as an alternative.

It allows the token authenticator to fill in the information and authorizers already get handed the `user.Info`.  It means that implementors can choose to tie the layers together if they wish, using whatever data they think is best.  

@kubernetes/kube-iam
2016-04-26 21:14:53 -07:00
Joe Finney 7059717c78 Use zone from the test context for static IPs. 2016-04-26 17:39:48 -07:00
Minhan Xia 1993bf901a reuse goproxy pod and avoid race between kubectl exec and goproxy readiness 2016-04-26 16:45:10 -07:00
Yu-Ju Hong bdadaefe3b e2e: add a dummy environment variable in the service tests
This works around the docker bug:
https://github.com/docker/docker/issues/14203
2016-04-26 16:25:26 -07:00
Jay Vyas 95e315e427 E2E Network performance run which uses iperf.
generic pod-per-node functionality for testing - 2 node test only
- update framework to decompose pod vs svc creation for composition.
- remove hard coded 2 and pointer to --scale
2016-04-26 18:42:19 -04:00
deads2k e8ce9852e1 deflake quota master init order 2016-04-26 16:37:56 -04:00
deads2k b4ebfd47c5 add user.Info.GetExtra 2016-04-26 15:08:34 -04:00
deads2k 622932422d enable resource name and service account cases for impersonation 2016-04-26 09:31:43 -04:00
k8s-merge-robot cf38d68734 Merge pull request #23595 from vishh/image-accounting
Automatic merge from submit-queue

Collect and expose runtime's image storage usage via Kubelet's /stats/summary endpoint

This information is useful to users since docker images are typically not stored on the root filesystem.

Kubelet will also consume this feature in the future to decide is evicting images will help with disk usage on the nodes.

cc @kubernetes/sig-node
2016-04-25 21:34:30 -07:00
k8s-merge-robot 293b0d0815 Merge pull request #23493 from soltysh/move_job_internals
Automatic merge from submit-queue

Move internal types of job from pkg/apis/extensions to pkg/apis/batch

This addressed the job part of #23216, this is still WIP. Will notify once finished. I'd like to have it in before starting working on ScheduledJob. 

@lavalamp @erictune fyi
2016-04-25 20:58:49 -07:00
Vishnu kannan e566948a75 Track image storage usage for docker containers
add image fs info to summary stats API.
Adding node e2e test for image stats.

Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-04-25 16:00:34 -07:00
Jeff Lowdermilk 9b91750284 add e2e test for same-image rolling-update 2016-04-25 13:38:45 -07:00
Euan Kemp d76d2442e7 test/e2e/addon_update: Respect KUBE_SSH_USER 2016-04-25 12:28:33 -07:00
zhouhaibing089 bf1a3f99c0 Uncomment the code that cause by #19254 2016-04-25 23:21:31 +08:00
deads2k d3c6363093 use single writer to improve quota performance 2016-04-25 10:42:26 -04:00
Piotr Szczesniak daf6be1a66 Merge pull request #24706 from jayunit100/redis-wait
Slow down redis polling to ensure no flakiness in kubectl
2016-04-25 12:13:01 +02:00
Wojciech Tyczynski c0020aff59 Merge pull request #24539 from smarterclayton/unify_stream_and_serial
Unify Streaming and normal Serializers
2016-04-25 11:25:16 +02:00
Maciej Szulik a3b4447305 Move internal types of job from pkg/apis/extensions to pkg/apis/batch 2016-04-25 11:03:54 +02:00
k8s-merge-robot 39f62240db Merge pull request #24499 from gmarek/load
Automatic merge from submit-queue

Add Services to Load test
2016-04-23 23:03:53 -07:00
k8s-merge-robot 5e16602b6c Merge pull request #24443 from Random-Liu/mirror-pod-node-e2e-test
Automatic merge from submit-queue

Add node e2e test for mirror pod.

This is a node e2e test for mirror pod.

After this get merged, I'll revisit the mirror pod manager PR. #18638

/cc @yujuhong
2016-04-23 15:54:46 -07:00
k8s-merge-robot 0057931f4e Merge pull request #24434 from gmarek/services
Automatic merge from submit-queue

Create multiple RCs in NC - prerequisite for adding services

WIP because I need to make the logs readable again.
2016-04-23 15:19:36 -07:00
k8s-merge-robot de9c1a2a51 Merge pull request #24247 from sdminonne/service_loadbalancer_quotas
Automatic merge from submit-queue

Adding loadBalancer services to quota system

@derekwaynecarr follow up to #22154.
2016-04-23 10:22:45 -07:00
k8s-merge-robot e61e396de7 Merge pull request #24291 from gmarek/gatherer
Automatic merge from submit-queue

Make resource gatherer work for Kubemark
2016-04-23 02:53:58 -07:00
k8s-merge-robot 71f0d058b6 Merge pull request #24542 from Random-Liu/versioned-perf-data
Automatic merge from submit-queue

Use mCPU as CPU usage unit, add version in PerfData, and fix memory usage bug.

Partially addressed #24436.

This PR:
1) Change the CPU usage unit to "mCPU"
2) Add version in PerfData, and perfdash will only support the newest version now.
3) Fix stupid mistake when calculating the memory usage average.

/cc @vishh
2016-04-23 01:17:59 -07:00
Jay Vyas fcf254591f Slow down redis pod polling, ensure no flakiness in kubectl service
test.
2016-04-23 00:53:24 -04:00
k8s-merge-robot aa4da07157 Merge pull request #24631 from goltermann/spell
Automatic merge from submit-queue

Fix a few typos in comments
2016-04-22 09:45:46 -07:00
Clayton Coleman 3111985564 Handle streaming serializers more consistently
Add tests to watch behavior in both protocols (http and websocket)
against all 3 media types. Adopt the
`application/vnd.kubernetes.protobuf;stream=watch` media type for the
content that comes back from a watch call so that it can be
distinguished from a Status result.
2016-04-22 11:07:24 -04:00
k8s-merge-robot 9a871ed554 Merge pull request #24284 from marun/e2e-conn-check-timeout
Automatic merge from submit-queue

Add timeout to e2e network connectivity checks

Some e2e tests use wget to check connectivity, and the default e2e
timeout is 900s.  This change allows the timeout to be specified on a
check-by-check basis.  This will also make the check useful for negative
checks (like those used by openshift to validate isolation) since a
short timeout is suggested where connectivity is not expected.
2016-04-21 23:41:44 -07:00
Random-Liu c74f199223 Add node e2e test for mirror pod. 2016-04-21 22:11:06 -07:00
Yu-Ju Hong a29432163e node_e2e: disable serialized image pulls and increase test timeout 2016-04-21 15:34:28 -07:00
goltermann dddc6cb6c8 Fix a few spellings. 2016-04-21 15:16:42 -07:00
gmarek 3627bb7be9 Add Services to Load test 2016-04-21 22:00:26 +02:00
k8s-merge-robot 85de6acadc Merge pull request #23208 from deads2k/fix-version-override
Automatic merge from submit-queue

make storage enablement, serialization, and location orthogonal

This allows a caller (command-line, config, code) to specify multiple separate pieces of config information regarding storage and have them properly composed at runtime.  The information provided is exposed through interfaces to allow alternate implementations, which allows us to change the expression of the config moving forward.  I also fixed up the types to be correct as I moved through.

The same options still exist, but they're composed slightly differently
 1. specify target etcd servers per Group or per GroupResource
 1. specify storage GroupVersions per Groups or per GroupResource
 1. specify etcd prefixes per GroupVersion or per GroupResource
 1. specify that multiple GroupResources share the same location in etcd
 1. enable GroupResources by GroupVersion or by GroupResource whitelist or GroupResource blacklist

The `storage.Interface` is built per GroupResource by:
 1. find the set of possible storage GroupResource based on the priority list of cohabitators
 1. choose a GroupResource from the set by looking at which Groups have the resource enabled
 1. find the target etcd server, etcd prefix, and storage encoding based on the GroupResource

The API server can have its resources separately enabled, but for now I've kept them linked.

@liggitt I think we need this (or something like it) to be able to go from config to these interfaces.  Given another round of refactoring, we may be able to reshape these to be more forward driving.

@smarterclayton this is important for rebasing and for a seamless 1.2 to 1.3 migration for us.
2016-04-21 08:24:29 -07:00
gmarek d344c2e32b Create multiple RCs in NC - prerequisite for adding services 2016-04-21 17:20:05 +02:00
k8s-merge-robot 35ea9b87b8 Merge pull request #24185 from jsafrane/devel/stabilize-provisioning-e2e
Automatic merge from submit-queue

Increase provisioning test timeouts.

We've encountered flakes in our e2e infrastructure when kubelet took more than one minute to detach a volume used by a deleted pod.

Let's increase the wait period from 1 to 3 minutes. This slows down the test by 2 minutes, but it makes the test more stable.

In addition, when kubelet cannot detach a volume for 3 minutes, let the test wait for additional recycle controller retry interval (10 minutes) and hope the volume is deleted by then. This should not increase usual test time, it makes the test stable when kubelet is _extremely_ slow when releasing the volume.

Fixes: #24161
2016-04-21 06:03:37 -07:00
deads2k 6670b73b18 make storage enablement, serialization, and location orthogonal 2016-04-21 08:18:55 -04:00
deads2k 3be4b690ea create a negotiating serializer that wraps a single serializer 2016-04-21 07:51:59 -04:00
Prashanth Balasubramanian 0ac10c6cc2 PetSet type, apps apigroup 2016-04-20 18:49:31 -07:00
Random-Liu 7af6642e65 Use mCPU as CPU usage unit, add version in PerfData, fix memory usage bug. 2016-04-20 16:42:14 -07:00
Prashanth Balasubramanian 1f4e48ba59 E2E changes to support templated addon 2016-04-20 16:15:26 -07:00
k8s-merge-robot 8a76a1bd36 Merge pull request #24234 from goltermann/vetclean
Automatic merge from submit-queue

Enable go vet.
2016-04-20 14:50:37 -07:00
Maru Newby 3a28868eb9 Remove flaky tag from e2e net granular
The tests are running reliably on every origin merge and can be verified
similarly reliable on kube.
2016-04-20 17:53:05 +00:00
goltermann 3fa6c6f6d9 Enable vet 2016-04-20 09:48:24 -07:00
k8s-merge-robot 3753e2bded Merge pull request #24180 from AdoHe/reuse_node_port
Automatic merge from submit-queue

Fix unintended change of Service.spec.ports[].nodePort during kubectl apply

Please refer #23551 for more detail. @bgrant0607 I think this simple fix should be ok to reuse nodePort. @thockin ptal.

Release note: Fix unintended change of `Service.spec.ports[].nodePort` during `kubectl apply`.
2016-04-20 08:51:40 -07:00
k8s-merge-robot f3f6ffaa28 Merge pull request #24524 from wojtek-t/fix_scheduler_2
Automatic merge from submit-queue

Add RC and container pors to scheduler benchmark

Fix #23263

Ref  #24408
However - scheduler throughput is still ~140 initially, whereas in reality we have 35-40. There are still significant difference we should understand.

@hongchaodeng @xiang90
2016-04-20 07:18:20 -07:00
Wojciech Tyczynski a4b3f47347 Add RC and container pors to scheduler benchmark 2016-04-20 15:10:57 +02:00
k8s-merge-robot 15ed9dbd02 Merge pull request #23771 from jayunit100/ClusterVerificationFramework
Automatic merge from submit-queue

Cluster Verification Framework

I've spent the last few days looking at the general patterns of verification we have that we tend to reuse in the e2es.  Basically, we need 
 
- label filters
- forEach and WaitFor (where forEach doesn't necessarily waitFor anything).
- timeouts
- multiple phases (reusable definition of state)
- an extensible way to define cluster state that can evolve over time in a data object rather than as a set of parameters that have magic semantics

This PR 
- implements the abstract above functionality declaratively, and w/o hidden semantics.
- addresses the sprawling duplicate methods in #23540, so that we can phase out the wrapper methods and replace them with well defined, extensible semantics for cluster state.
- fixes the recently discovered #23730 issue (where kubectl.go is relying on examples.go, which is obviously wacky) by using the new framework to implement forEachPod in just a couple of lines and migrating the wrapper function into framework.go.

There is some cleanup to do here, but this is seemingly working for a couple of use cases that are important (spark,cassandra,...,kubectl) tests. - i played with a few different ideas and this wound up seeming to be the most natural implementation from a usability standpoint... 

in any case, just thought id push this up as a first iteration, open to feedback.

@kubernetes/sig-testing @timothysc
2016-04-20 04:23:21 -07:00
k8s-merge-robot 1c80864913 Merge pull request #24257 from zmerlynn/1000nodes
Automatic merge from submit-queue

Fix DNS test for larger clusters

On GKE, we scale the number of DNS pods based on the cluster size. For
testing on larger clusters, relax the DNS pod check.
2016-04-20 03:49:40 -07:00
AdoHe 16960d3ad2 fix reuse nodePort issue 2016-04-20 02:30:03 -04:00
k8s-merge-robot 86544c2288 Merge pull request #24426 from pwittrock/flaky
Automatic merge from submit-queue

Incremental improvements to kubelet e2e tests

- Add keep-alive to ssh connection
- Don't try to stop services on image-based runs
- Increase jenkins ci timeout to 90 minutes to accomadate unpredictable go build times
- Remove spammy log statement
2016-04-19 22:36:40 -07:00
derekwaynecarr b92b7255f4 Quota ignores pod compute resources on updates 2016-04-19 23:05:59 -04:00
k8s-merge-robot 4638f2f355 Merge pull request #24466 from wojtek-t/fix_scheduler_benchmark
Automatic merge from submit-queue

Improve script for running scheduler benchmarks

Without this change, this script didn't work in my environment - it's making more consistent with other scripts.

@hongchaodeng @xiang90
2016-04-19 08:43:50 -07:00
Wojciech Tyczynski 762bfa3d97 Improve script for running scheduler benchmarks 2016-04-19 16:23:23 +02:00
k8s-merge-robot db28f73c3b Merge pull request #24282 from goltermann/spelling
Automatic merge from submit-queue

Fix misspellings in comments
2016-04-19 03:47:07 -07:00
k8s-merge-robot 56d7579bfd Merge pull request #24359 from janetkuo/rollover-e2e-no-events
Automatic merge from submit-queue

Avoid relying on events in deployment rollover e2e test

Fixes #22028

@kubernetes/sig-config
2016-04-18 16:51:22 -07:00
Phillip Wittrock 90d2f9ad5e Incremental improvements to kubelet e2e tests
- Add keep-alive to ssh connection
- Don't try to stop services on image-based runs
- Increase jenkins ci timeout to 90 minutes to accomadate unpredictable go build times
- Remove spammy log statement
2016-04-18 13:56:07 -07:00
k8s-merge-robot 5ad27f2720 Merge pull request #23575 from deads2k/shared-cache
Automatic merge from submit-queue

shared controller informers

Related to https://github.com/kubernetes/kubernetes/issues/14978

This demonstrates how controllers which use an `Informer`, would be able to share the same watch and store.  A similar "setup and run" approach could be done for an `IndexInformer` to share that cache.  I found adding listeners here to be easier than intercepting at the watch interface (problems with resourceVersion) or the reflector (same plumbing, but you have to fan out to multiple stores).

We could also use the cache we build here to back several of the admission plugins that currently run their own lookup caches today.

If there's interest, I can finish out the `SharedInformer` and switch the low hanging fruit over.  

@kubernetes/rh-cluster-infra @smarterclayton @liggitt @wojtek-t
2016-04-18 07:48:29 -07:00
k8s-merge-robot d37e6ad332 Merge pull request #24126 from Random-Liu/fix-pull-image
Automatic merge from submit-queue

Fix PullImage and add corresponding node e2e test

Fixes #24101. This is a bug introduced by #23506, since ref #23563.

The root cause of #24101 is described [here](https://github.com/kubernetes/kubernetes/issues/24101#issuecomment-208547623).

This PR
1) Fixes #24101 by decoding the messages returned during pulling image, and return error if any of the messages contains error.
2) Add the node e2e test to detect this kind of failure.
3) Get present check out of `ConformanceImage.Remove()` and `ConformanceImage.Pull()`. Because sometimes we may expect error to occur in `PullImage()` and `RemoveImage()`, but even that doesn't happen, the `Present()` check will still return error and let the test pass.

@yujuhong @freehan @liangchenye 

Also /cc @resouer, because he is doing the image related functions refactoring.
2016-04-18 07:05:44 -07:00
Jay Vyas 632a0a81d4 Cluster verification framework supporting declarative definition and iteration against pod spectrum
- rebase: ForEach only on Running pods
- add waitFor step in guestbook describe and wrapper
- simplify logs in polling, make panic immediate, give rolluped stats in
the logs.

Improve logging for failure on ForEach
2016-04-18 10:01:10 -04:00
deads2k f0c33d65b6 start sharing the pod cache and list/watch 2016-04-18 08:51:55 -04:00
Jan Safranek 3137b4cd02 Increase provisioning test timeouts.
We've encountered flakes in our e2e infrastructure when kubelet took more than
one minute to detach a volume used by a deleted pod.

Let's increase the wait period from 1 to 3 minutes. This slows down the test
by 2 minutes, but it makes the test more stable.

In addition, when kubelet cannot detach a volume for 3 minutes, let the test
wait for additional recycle controller retry interval (10 minutes) and hope the
volume is deleted by then. This should not increase usual test time, it makes
the test stable when kubelet is _extremely_ slow when releasing the volume.
2016-04-18 13:06:09 +02:00
k8s-merge-robot b73164792f Merge pull request #24098 from rootfs/e2e-test
Automatic merge from submit-queue

some enhancement to run volume e2e tests
2016-04-17 23:19:10 -07:00
k8s-merge-robot 934d7ebb33 Merge pull request #23968 from yujuhong/privileged_containers
Automatic merge from submit-queue

e2e_node: port privileged pod tests from test/e2e/priviliged.go

The ported test is functionally the same as the original test.
The main difference between the two tests is that the original test relies on
`kubectl` to exec into the container, while the latter directly uses the REST
client of the apiserver. This avoids the need to copy kubectl to the node under
test.
2016-04-17 12:37:12 -07:00
k8s-merge-robot 2b9637da6a Merge pull request #23945 from smarterclayton/move_reset_metrics
Automatic merge from submit-queue

Move /resetMetrics to DELETE /metrics

Reduces the surface area of the API server slightly and allows
downstream components to have deleteable metrics. After this change
genericapiserver will *not* have metrics unless the caller defines it
(allows different apiserver implementations to make that choice on their
own).

@wojtek-t
2016-04-17 05:58:26 -07:00
k8s-merge-robot a275a045d1 Merge pull request #23914 from sky-uk/make-etcd-cache-size-configurable
Automatic merge from submit-queue

Make etcd cache size configurable

Instead of the prior 50K limit, allow users to specify a more sensible size for their cluster.

I'm not sure what a sensible default is here. I'm still experimenting on my own clusters. 50 gives me a 270MB max footprint. 50K caused my apiserver to run out of memory as it exceeded >2GB. I believe that number is far too large for most people's use cases.

There are some other fundamental issues that I'm not addressing here:
- Old etcd items are cached and potentially never removed (it stores using modifiedIndex, and doesn't remove the old object when it gets updated)
- Cache isn't LRU, so there's no guarantee the cache remains hot. This makes its performance difficult to predict. More of an issue with a smaller cache size.
- 1.2 etcd entries seem to have a larger memory footprint (I never had an issue in 1.1, even though this cache existed there). I suspect that's due to image lists on the node status.

This is provided as a fix for #23323
2016-04-17 00:06:31 -07:00
k8s-merge-robot 822618afb5 Merge pull request #23912 from smarterclayton/watch_until
Automatic merge from submit-queue

Add watch.Until, a conditional watch mechanism

A more powerful tool than wait.Poll, allows a watch interface to drive conditionals to react to changes on a resource or resources. Provide a set of standard conditions that are in common use in the code, and updates e2e to use a few of these.

Extracted from #23567
2016-04-16 21:05:40 -07:00
k8s-merge-robot 85550921de Merge pull request #24354 from yifan-gu/fix_addon_update_test
Automatic merge from submit-queue

e2e: Fix 'Addon update' to support coreos distro.

cc @kubernetes/sig-testing @kubernetes/sig-node
2016-04-16 07:31:15 -07:00
k8s-merge-robot c528080248 Merge pull request #24339 from pwittrock/flaky
Automatic merge from submit-queue

Don't clean up files on image-based tests since the instance will be …

…deleted anyway and this is flaky on CoreOS.
2016-04-15 20:50:41 -07:00
Clayton Coleman 845e496572 Convert poll in e2e with watch.Until 2016-04-15 22:21:42 -04:00
k8s-merge-robot 03f48e730e Merge pull request #22810 from amygdala/cassandra2
Automatic merge from submit-queue

phase 2 of cassandra example overhaul

Here's the next iteration in overhauling this example, towards https://github.com/kubernetes/kubernetes/issues/20961.  This removes the pod adoption part, but doesn't (yet) otherwise change any of the resources used.

It also includes some README cleanup, and removes some explicit specification of labels in the rc yaml.

This PR doesn't yet add any commentary on how we're using the seed provider (re: https://github.com/kubernetes/kubernetes/issues/20961#issuecomment-190405959 etc.).  Maybe we should add that.

Also: LMK if this PR should include any changes to the links out to the docs.

cc @bgrant0607 @johndmulhausen
2016-04-15 15:41:01 -07:00
Janet Kuo eb96b28004 Avoid relying on events in deployment rollover e2e test 2016-04-15 15:20:41 -07:00
Phillip Wittrock d37222d1d9 kubelet e2e test - format command output as string, not byte string. 2016-04-15 15:17:59 -07:00
Huamin Chen ee9ed4dd7f enhancements to run volume e2e test:
in e2e/volumes.go: give time to allow pod cleanup and volume unmount happen before volume server exit;
skip cinder volume test if not running with openstack provider

comment on why pause before containerized server is stopped in volume e2e tests, fix #24100

updates NFS server image to 0.6, per #22529

fix persistent_volume e2e test: test cleanup doesn't expect client pod; delete PV after test

Signed-off-by: Huamin Chen <hchen@redhat.com>
2016-04-15 22:14:23 +00:00
Yifan Gu 656d05c5b4 e2e: Fix 'Addon update' to support coreos distro. 2016-04-15 14:29:08 -07:00
gmarek 0071a8627c Make resource gatherer work for Kubemark 2016-04-15 20:12:26 +02:00
Isaac Hollander McCreery a96bb71bc9 Version-guard Kubectl client Guestbook application test against deployments 2016-04-15 10:51:10 -07:00
Phillip Wittrock 5155df0287 Don't clean up files on image-based tests since the instance will be deleted anyway and this is flaky on CoreOS. Fixed #24297 2016-04-15 10:32:26 -07:00
Clayton Coleman 0f95b91f96 Move /resetMetrics to DELETE /metrics
Reduces the surface area of the API server slightly and allows
downstream components to have deleteable metrics. After this change
genericapiserver will *not* have metrics unless the caller defines it
(allows different apiserver implementations to make that choice on their
own).
2016-04-15 11:44:17 -04:00
k8s-merge-robot 2382fec956 Merge pull request #23894 from vishh/oom-score-adj-error
Automatic merge from submit-queue

Do not throw creation errors for containers that fail immediately after being started

Fixes (hopefully) #23607 

cc @dchen1107
2016-04-14 22:29:14 -07:00
Amy Unruh 8846b313dc phase 2 of cassandra example overhaul 2016-04-14 21:55:23 -07:00
k8s-merge-robot 14d9764b77 Merge pull request #24271 from pwittrock/flaky
Automatic merge from submit-queue

Only output log files if tests fail
2016-04-14 21:42:58 -07:00
Daniel Smith 1d96b4c55b Merge pull request #23549 from deads2k/acting-as
add act-as powers
2016-04-14 15:12:45 -07:00
Maru Newby 75c49a98d4 Add timeout to e2e network connectivity checks
Some e2e tests use wget to check connectivity, and the default e2e
timeout is 900s.  This change allows the timeout to be specified on a
check-by-check basis.  This will also make the check useful for negative
checks (like those used by openshift to validate isolation) since a
short timeout is suggested where connectivity is not expected.
2016-04-14 21:27:10 +00:00
goltermann c226c9435b Fix misspellings in comments.
https://goreportcard.com/report/k8s.io/kubernetes#misspell
2016-04-14 13:57:45 -07:00
k8s-merge-robot d3102a3d8a Merge pull request #24216 from fejta/iperf
Automatic merge from submit-queue

Add Makefile for iperf

@jayunit100 will you please take a look at this? (closes #24204)
2016-04-14 12:37:20 -07:00
Phillip Wittrock e88fdb85c0 Only output log files if tests fail 2016-04-14 12:04:36 -07:00
deads2k ac4c545b91 add act-as powers 2016-04-14 12:49:10 -04:00
Zach Loafman 9b0a4bfdb0 Fix DNS test for larger clusters
On GKE, we scale the number of DNS pods based on the cluster size. For
testing on larger clusters, relax the DNS pod check.
2016-04-14 09:23:30 -07:00
Salvatore Dario Minonne f4ed4998ff Adding loadbalancer services to quota 2016-04-14 14:06:42 +02:00
k8s-merge-robot 98c255eb79 Merge pull request #22912 from Random-Liu/kubelet-perf
Automatic merge from submit-queue

Add generalized performance data type in e2e test

For kubernetes/contrib/issues/564 and #15554.

This PR added two files in e2e test:
1) `perftype/perftype.go`: This file contains generalized performance data type. The type can be pretty printed in Json format and analyzed by other performance analyzing tools, such as [Perfdash](https://github.com/kubernetes/contrib/tree/master/perfdash).
2) `perf_util.go`: This file contains functions which convert e2e performance test result into new performance data type.

The new performance data type is now used in *Density test, Load test and Kubelet resource tracking*. It's easy to support other e2e performance test by adding new convert function in `perf_util.go`.

@gmarek @yujuhong 
/cc @kubernetes/sig-testing
2016-04-14 03:47:24 -07:00
k8s-merge-robot b02f1bf667 Merge pull request #24189 from wojtek-t/dont_remove_binaries
Automatic merge from submit-queue

Don't remove kubemark binaries

If you want to experiment a bit with kubemark (e.g. relaunch the component with different flags), it's roughly impossible now. If we have binaries, this is much easier.
2016-04-13 23:15:26 -07:00
k8s-merge-robot 1ccb4cf497 Merge pull request #23542 from caesarxuchao/clientset-release-1-3
Automatic merge from submit-queue

Clientset release 1.3

This PR creates the release 1.3 client set. We'll keep updating this client set until we cut release 1.3. In the meantime, the release 1.2 client set will be locked.

@lavalamp
2016-04-13 18:27:59 -07:00
Chao Xu 64e414fe39 e2e test for 1.3 2016-04-13 16:49:24 -07:00
k8s-merge-robot 20eccc24cd Merge pull request #24143 from goltermann/vetclean
Automatic merge from submit-queue

Final vet fixes; enabling vet checks in verify scripts.

Fixes #22523, #22524
2016-04-13 16:46:46 -07:00
Tim St. Clair 59077722f2 Fix density tests 2016-04-13 14:33:29 -07:00
Random-Liu 5b2ddc9f2c Add perfdash support in kubelet_perf and metrics_util 2016-04-13 14:32:11 -07:00
Erick Fejta 4e4edb4edc Add Makefile for iperf 2016-04-13 14:28:33 -07:00
Daniel Smith 4c539bf082 Merge pull request #23490 from wojtek-t/remove_set_from_storage_interface
Remove Set() from storage.Interface.
2016-04-13 14:22:05 -07:00
goltermann a3104ba96c Final vet fixes; enabling vet checks in verify scripts. 2016-04-13 13:51:51 -07:00
Tim St. Clair b0d3f32e88 Update test/e2e for test/e2e/framework refactoring 2016-04-13 10:50:17 -07:00
Tim St. Clair a55b4f2e77 Move test/e2e framework & utility code to test/e2e/framework 2016-04-13 10:50:17 -07:00
Yu-Ju Hong c6a26112bd e2e: fix error checking in kubelet stats 2016-04-13 09:22:59 -07:00
k8s-merge-robot 8eb19c7889 Merge pull request #22154 from sdminonne/service_nodeports_quotas
Automatic merge from submit-queue

Adding nodeports services to quota

To fix #21677
@derekwaynecarr
2016-04-13 05:50:27 -07:00
Wojciech Tyczynski 0f60b33efc Don't remove kubemark binaries 2016-04-13 12:07:34 +02:00
k8s-merge-robot 8905e61522 Merge pull request #23872 from jayunit100/iperf-container
Automatic merge from submit-queue

IPerf container to support network perfomance testing

Simple iperf container.

Issue:
We want to run iperf from the e2e tests for a network baseline, but there are no gcr images for this.

Solution:
Curate our own iperf container from source in kubernetes and copy it as a top level microservice.  So long as these are injected into GCR, we can then run this container from the e2e tests.

 cc @sig-testing this can be used along side #22869
2016-04-13 02:18:40 -07:00
k8s-merge-robot 21f4d1f1d6 Merge pull request #22649 from rootfs/nfs-fix
Automatic merge from submit-queue

disable nfsv4 and use nfsv3

fix #22529
2016-04-12 13:28:38 -07:00
k8s-merge-robot e9c1d59174 Merge pull request #24003 from yujuhong/metrics_test
Automatic merge from submit-queue

e2e: adapt kubelet_perf.go to use the new summary metrics API

This commit switch most functions in kubelet_stats.go to use the new API.
However, the functions that perform one-time resource usage retrieval remain
unchanged to be compatible with reource_usage_gatherer.go. They should be
handled separately.

Also, the new summary API does not provide the RSS memory yet, so all memory
checking tests will *always* pass. We plan to add this metrics in the API and
restore the functionality of the test.
2016-04-12 11:01:48 -07:00
Random-Liu 2b9f6bea18 Fix PullImage and corresponding node e2e test. 2016-04-12 10:42:25 -07:00
k8s-merge-robot 828ea5a728 Merge pull request #24110 from vishh/node-conformance
Automatic merge from submit-queue

Convert the node conformance tests to use dedicated images.

This PR will de-flake the node e2e.
2016-04-12 09:38:48 -07:00
Yu-Ju Hong a8c685921f e2e: adapt kubelet_perf.go to use the new summary metrics API
This commit switch most functions in kubelet_stats.go to use the new API.
However, the functions that perform one-time resource usage retrieval remain
unchanged to be compatible with reource_usage_gatherer.go. They should be
handled separately.

Also, the new summary API does not provide the RSS memory yet, so all memory
checking tests will *always* pass. We plan to add this metrics in the API and
restore the functionality of the test.
2016-04-12 09:27:46 -07:00
Huamin Chen 3a914c2583 fix #22529: disable nfsv4 and use nfsv3 2016-04-12 16:23:28 +00:00
k8s-merge-robot acf9492cb1 Merge pull request #23660 from goltermann/vetclean
Automatic merge from submit-queue

Additional go vet fixes

Mostly:
- pass lock by value
- bad syntax for struct tag value
- example functions not formatted properly
2016-04-12 06:22:16 -07:00
James Ravn 5bb0595260 Make deserialization cache size configurable
Instead of the default 50K entries, allow users to specify more sensible
sizes for their cluster.
2016-04-12 13:42:27 +01:00
Salvatore Dario Minonne 15b7577454 Adding nodeports services to quota 2016-04-12 11:09:16 +02:00
Vishnu kannan d100e3147f Convert the node conformance tests to use dedicated images.
Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-04-11 14:38:43 -07:00
Vishnu kannan d4db40e87f Adding an e2e test for oom score adjust handling.
Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-04-11 12:51:42 -07:00
Jeff Lowdermilk cd85b06465 Merge pull request #24001 from freehan/kubenet
include error in the fail msg
2016-04-08 20:55:35 -07:00
jay vyas 0e35d9194c IPerf container to support network perfomance testing 2016-04-08 22:53:57 -04:00
Jeff Lowdermilk 27bca83304 Merge pull request #23963 from spxtr/services-slow
Mark services test slow.
2016-04-08 12:47:45 -07:00
Chao Xu 1cc84c5525 Merge pull request #23960 from caesarxuchao/fix-23952
fix e2e flake #23952
2016-04-07 16:59:59 -07:00
Minhan Xia 0174455111 include error in the fail msg 2016-04-07 15:42:21 -07:00
Mike Danese 476103a822 bump single call timeout in e2e tests 2016-04-07 14:12:38 -07:00
Yu-Ju Hong 6567c54e45 e2e_node: port privileged pod tests from test/e2e/priviliged.go
The ported test is functionally the same as the original test.
The main difference between the two tests is that the original test relies on
`kubectl` to exec into the container, while the latter directly uses the REST
client of the apiserver. This avoids the need to copy kubectl to the node under
test.
2016-04-06 19:09:07 -07:00
Joe Finney 39de4be40d
Mark services test slow. 2016-04-06 17:26:16 -07:00
Chao Xu bcebfa072d fix 23952 2016-04-06 16:52:30 -07:00
Saad Ali d7b069fbcc Merge pull request #23793 from pmorie/configmap-nonroot
Make ConfigMap volume readable as non-root
2016-04-06 15:11:25 -07:00
goltermann 696423e044 Vet fixes, mostly pass lock by value errors. 2016-04-06 11:27:40 -07:00
Isaac Hollander McCreery 9a7860855c Merge pull request #22962 from ihmccreery/split-upgrade-jobs
Add configuration for splitting upgrade jobs instead of using Jenkins steps
2016-04-05 13:05:25 -07:00
Saad Ali 48fa998f58 Merge pull request #23717 from mml/until
Comment out racey part of the multi-scheduler test.
2016-04-05 11:34:32 -07:00
Paul Morie e838ff2893 Make ConfigMap volume readable as non-root 2016-04-05 12:20:52 -04:00
k8s-merge-robot 02e0b29b6d Merge pull request #23769 from saad-ali/fixVolumeCloudProvider
Automatic merge from submit-queue

Ensure object returned by volume getCloudProvider incorporates cloud config

This PR addresses https://github.com/kubernetes/kubernetes/issues/23517.

**Problem**
The existing GCE PD and AWS EBS volume plugin code were fetching cloud provider without specifying a cloud config: `cloudprovider.GetCloudProvider("gce", nil)`
This caused the cloud provider to use default auth mechanism, which is not acceptable for the provisioning controller running on GKE master.

**Fix**
This PR does the following:
* Modifies the GCE PD and AWS EBS volume plugin code to use the cloud provider object pre-constructed by the binary with a cloud config.
* Enable provisioning E2E test for GKE (to catch future issues).

Thanks to @cjcullen for debugging and finding the root cause!  👍 

This should be cherry-picked into the v1.2 branch for the next release.
2016-04-04 20:52:13 -07:00
gmarek 7a848eb03a Print 100th percentile of resource usage when gatherer is turned on. 2016-04-04 17:42:32 -07:00
Isaac Hollander McCreery 873b499d90 Add ClusterUpgrade tests 2016-04-04 14:21:21 -07:00
Isaac Hollander McCreery 53c3a5626d Add configuration for splitting upgrade jobs instead of using Jenkins steps 2016-04-04 14:21:21 -07:00
saadali e7b14e721a Ensure volume GetCloudProvider code uses cloud config 2016-04-04 10:59:13 -07:00
Wojciech Tyczynski 53f433f019 Remove Set() from storage.Interface. 2016-04-04 17:54:18 +02:00
k8s-merge-robot 3197f31cc6 Merge pull request #23554 from nikhiljindal/swaggerInRun
Automatic merge from submit-queue

genericapiserver: Moving InstallSwaggerAPI to Run

Ref https://github.com/kubernetes/kubernetes/pull/21190#discussion_r57494673

Moving InstallSwaggerAPI() from InstallAPIGroups() to Run(). This allows the use of InstallAPIGroups() multiple times or using InstallAPIGroup() directly.

cc @jianhuiz @kubernetes/sig-api-machinery
2016-04-02 08:19:25 -07:00
k8s-merge-robot d0155982aa Merge pull request #23736 from pwittrock/flaky
Automatic merge from submit-queue

node e2e retry gcr.io failures
2016-04-01 14:13:05 -07:00
k8s-merge-robot 9e14d6075c Merge pull request #23700 from gmarek/density
Automatic merge from submit-queue

Make total pod throughput in density test more readable
2016-04-01 11:32:51 -07:00
Phillip Wittrock 015b9a6489 Retry failed image pulls. Closes #23669. 2016-04-01 09:48:19 -07:00
Phillip Wittrock 8002e10fbb node e2e Output failed health checks as string not bytes 2016-04-01 09:20:30 -07:00
gmarek be3a5d83bb Make total pod throughput in density test more readable 2016-04-01 17:48:55 +02:00
k8s-merge-robot 9105a6abcc Merge pull request #23445 from ncdc/go16-portforward-e2e
Automatic merge from submit-queue

Update port forward e2e for go 1.6

Only close the stdout/stderr pipes from kubectl port-forward when we're truly done with the command,
instead of as soon as runPortForward exits.

Also try to gracefully stop kubectl port-forward via SIGINT, instead of always sending SIGKILL, as
this will help avoid spdy goroutine leaks in the Kubelet.

Ref #22149 

cc @smarterclayton @kubernetes/rh-cluster-infra
2016-04-01 06:05:15 -07:00
Matt Liggett 6ace15eb73 Comment out racey part of the multi-scheduler test.
Should fix #22848.
2016-03-31 16:56:10 -07:00
gmarek 9120a60724 Kubemark uses kubectl from the repo 2016-03-31 09:13:42 -07:00
Andy Goldstein 66899a47a5 Update port forward e2e for go 1.6
Only close the stdout/stderr pipes from kubectl port-forward when we're truly done with the command,
instead of as soon as runPortForward exits.

Also try to gracefully stop kubectl port-forward via SIGINT, instead of always sending SIGKILL, as
this will help avoid spdy goroutine leaks in the Kubelet.
2016-03-30 17:07:21 -04:00
k8s-merge-robot eb665e038c Merge pull request #23285 from pwittrock/flaky
Automatic merge from submit-queue

node e2e conformance keep polling if encounters errors
2016-03-29 22:56:03 -07:00
k8s-merge-robot d911fc20af Merge pull request #23067 from deads2k/fix-group-enablement
Auto commit by PR queue bot
2016-03-29 09:46:21 -07:00
nikhiljindal eeeaa6867a Moving InstallSwaggerAPI to Run 2016-03-28 23:04:14 -07:00
Dawn Chen c47f74a470 Merge pull request #23348 from pwittrock/docs
Update docs to reflect `kubectl run` creates deployments by default i…
2016-03-28 17:03:47 -07:00