Commit Graph

4690 Commits (c83a9246281d9eb6915e591673defc05d8590c00)

Author SHA1 Message Date
bprashanth 46dae270ef Fix glbc name to match image version 2016-09-09 16:00:20 -07:00
MrHohn 604ceac59c Added --log-facility flag to enhance dnsmasq logging 2016-09-09 15:49:09 -07:00
Kubernetes Submit Queue 1d0404466d Merge pull request #32396 from adityakali/cleanup
Automatic merge from submit-queue

Update Container-VM Image product name in docs
2016-09-09 11:11:15 -07:00
Kubernetes Submit Queue 3ddd39cd97 Merge pull request #32239 from zmerlynn/aws-bringup-fail
Automatic merge from submit-queue

AWS: Change default networking for kube-up to kubenet

**What this PR does / why we need it**: Fixes AWS bring-up. Again.

There's a kubelet bug that prevents NETWORK_PROVIDER=none from working right now, and we should migrate AWS to `kubenet` anyways.

Working on reproing the `none` issue on GCE, then I'll file a bug on the main issue. But this fixes AWS, so quick tactical fix.
2016-09-09 10:32:20 -07:00
Lucas Käldström c9e794e1cb Make it possible to compile both etcd2 and etcd3 in the Makefile and compile attachlease for multiple arches as well 2016-09-09 20:25:15 +03:00
Aditya Kali d5e4cfa2c0 Update Container-VM Image product name in docs 2016-09-09 10:08:56 -07:00
Kubernetes Submit Queue f535aea7fd Merge pull request #32359 from wojtek-t/rollback_etcd
Automatic merge from submit-queue

Use etcd 2.3.7

This will switch to etcd 2.3.7 for release 1.4, to resolve issues rolling back from 1.4 to 1.3 (while preventing those same issues rolling back to 1.4.0 from a release including etcd 3.0.x).

Fixes #32253.

See #32253 (comment) for etcd roadmap.
2016-09-09 09:53:02 -07:00
Kubernetes Submit Queue d139177529 Merge pull request #32317 from sdodson/master
Automatic merge from submit-queue

Fix 127.0.01 typo

**What this PR does / why we need it**:
Fixes a small typo, though typo seems inconsequential

**Release note**:
none
2016-09-09 04:06:52 -07:00
Bryan Boreham fd4596bd27 Use --cni-bin-dir flag when using CNI on GCI 2016-09-09 11:43:17 +01:00
Piotr Szczesniak 2d87deb043 Bumped Heapster to v1.2.0-beta.3 2016-09-09 11:41:48 +02:00
gmarek c304fa1f06 Remove explicit limits from manifest files 2016-09-09 11:19:54 +02:00
Daniel Smith 279219ca89 Use etcd 2.3.7 (container already pushed) 2016-09-09 09:45:53 +02:00
Euan Kemp 6b226cbfd9 e2e/log-dump: Collect kernel log with journald
Related to #31928

The kern.log file does not exist on journald distros typically.
2016-09-08 16:04:02 -07:00
Scott Dodson 36d3dfcf9b Fix 127.0.01 typo 2016-09-08 16:45:50 -04:00
Hongchao Deng 61e238cac3 etcd: data rollback tool of v3 -> v2 2016-09-08 12:29:19 -07:00
Kubernetes Submit Queue 9cf0ec3ce2 Merge pull request #27783 from jianhuiz/openstack-heat-network
Automatic merge from submit-queue

Openstack heat network

add lbaas subnet and floating network configuration
support lbaas v2
add environment variable for fixed network
~~fix lb creation failed because of no 'name' for pool members according to lbaas v2 api~~ #27810

#25987 
@dagnello @lavalamp @mikedanese

[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()
2016-09-07 16:25:02 -07:00
Zach Loafman 11c8830dec AWS: Docker is flapping because of cbr0 bringup, flip to kubenet
This is a mitigation. There's a kubelet bug that prevents
NETWORK_PROVIDER=none from working right now.
2016-09-07 15:41:38 -07:00
Kubernetes Submit Queue d1569489a3 Merge pull request #31545 from vishh/inodes-eviction
Automatic merge from submit-queue

Enable kubelet eviction whenever inodes free is < 5% on GCE

This is a pre-req for enabling inodes based evictions in GKE.
2016-09-07 12:49:46 -07:00
Kubernetes Submit Queue 23147d30e9 Merge pull request #32197 from gmarek/gci
Automatic merge from submit-queue

Make image-puller work on GCI nodes.

Currently image-puller works only on debian nodes. This will make our test more flaky after we switch to the GCI by default. This PR ports the image-puller to the GCI-based Nodes.

cc @vishh @wonderfly @dchen1107
2016-09-07 10:54:15 -07:00
Jerzy Szczepkowski 8541ea6c29 Updated port for HA master etcd.
Updated port for HA master etcd to 2379 (needed after #30514).
2016-09-07 16:10:55 +02:00
gmarek 3e2c3a5db2 Make image-puller work on GCI nodes. 2016-09-07 15:23:39 +02:00
Piotr Szczesniak e77fe15a20 Bumped Rescheduler version 2016-09-07 14:11:48 +02:00
Kubernetes Submit Queue 243959ce5a Merge pull request #32020 from euank/version-twiddling
Automatic merge from submit-queue

rkt: Update kube-up rkt version to v1.14.0

cc @kubernetes/sig-rktnetes 

This should have been included in #31286 (whoops).

This is a bugfix that I propose for v1.4 inclusion.
2016-09-07 01:18:57 -07:00
Angus Salkeld f52fc54176 Teach create-kubeconfig() to deal with multi path KUBECONFIG
When KUBECONFIG is in the form "A:B:C" make sure each file is
created.
2016-09-07 14:26:14 +10:00
Kubernetes Submit Queue 4348190b8a Merge pull request #31794 from chuckbutler/messaging-uniformity
Automatic merge from submit-queue

move '(master)' to end of message for uniformity

**What this PR does / why we need it**: This is a small polish operation on the kubernetes charm wrt juju status output.


**Release note**:
<!--  Steps to write your release note:
1. Use the release-note-* labels to set the release note state (if you have access) 
2. Enter your extended release note in the below block; leaving it blank means using the PR title as the release note. If no release note is required, just write `NONE`. 
-->
```release-note
NONE
```

This changes the status output from:

```
kubernetes/0  active    idle   3        172.27.24.54    8088/tcp
Kubernetes running.
kubernetes/1  active    idle   4        172.27.24.55    6443/tcp
(master) Kubernetes services started
```
 to this:
 ```
 kubernetes/0  active    idle   3        172.27.24.54    8088/tcp
 Kubernetes running.
 kubernetes/1  active    idle   4        172.27.24.55    6443/tcp
 Kubernetes services started (master)
 ```
2016-09-06 15:04:56 -07:00
Euan Kemp e023ec90f3 cluster/gce: Update master root disk size
As part of #29213, the hyperkube image will be deployed alongside
existing dependencies.

This ends up just running over the root disk size of 10 during
extraction.
2016-09-06 13:54:39 -07:00
Euan Kemp a2a324bf8b cluster/rkt: Update default rkt version 2016-09-06 12:09:11 -07:00
Minhan Xia 1e88c99e3e bump cni 2016-09-06 10:48:36 -07:00
Kubernetes Submit Queue 34f3633b0b Merge pull request #32066 from dshulyak/vagrant_eviction
Automatic merge from submit-queue

Set eviction-hard for vagrant cluster

In order to test eviction related functionality it will be convenient to have reasonable eviction defaults.
At this moment exactly same flags are used by GCE environment

kubelet will have a following flag:

--eviction-hard=memory.available<100Mi,nodefs.available<10%
2016-09-06 08:23:37 -07:00
Dmitry Shulyak 9d26d3701e Set eviction-hard for vagrant cluster
In order to test eviction related functionality it will be convenient
to have reasonable eviction defaults.
At this moment exactly same flags are used by GCE environment

kubelet will have a following flag:

  --eviction-hard=memory.available<100Mi,nodefs.available<10%

Change-Id: I56ca03bc3c5467c8450150e292f7a346fa7772a9
2016-09-06 17:24:57 +03:00
Kubernetes Submit Queue af8124c7bf Merge pull request #31609 from rhcarvalho/fix-bash
Automatic merge from submit-queue

Fix Bash script

<!--  Thanks for sending a pull request!  Here are some tips for you:
1. If this is your first time, read our contributor guidelines https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md and developer guide https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md
2. If you want *faster* PR reviews, read how: https://github.com/kubernetes/kubernetes/blob/master/docs/devel/faster_reviews.md
3. Follow the instructions for writing a release note: https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes
-->

**What this PR does / why we need it**: `cluster/mesos/docker/socat/build.sh` had two lines mixed together.

Old command output:

```
$ ./cluster/mesos/docker/socat/build.sh 
./cluster/mesos/docker/socat/build.sh: line 21: set: pipefailscript_dir=/home/rodolfo/src/k8s.io/kubernetes/cluster/mesos/docker/socat: invalid option name
```

**Special notes for your reviewer**: probably nobody is using that script? @sttts PTAL.

**Release note**:
<!--  Steps to write your release note:
1. Use the release-note-* labels to set the release note state (if you have access) 
2. Enter your extended release note in the below block; leaving it blank means using the PR title as the release note. If no release note is required, just write `NONE`. 
-->
```release-note
NONE
```
2016-09-05 18:10:24 -07:00
Kubernetes Submit Queue 09e5fa62b5 Merge pull request #31294 from mml/federated-oops
Automatic merge from submit-queue

Fix e2e logic when FEDERATION=false.

Also add debugging output to GCE detect-master.

Fixes #31285.
2016-09-05 13:01:12 -07:00
Martin Westergaard Lassen c73a47f599 Added INSTANCE_PREFIX to S3 project hash to avoid url clashes between clusters in same EC2 region 2016-09-05 14:22:00 +01:00
Kubernetes Submit Queue 2cc5923ed6 Merge pull request #31974 from piosz/enable-rescheduler
Automatic merge from submit-queue

Enable Rescheduler by default

Rescheduler is stable - e2e test is passing constantly for >1week.

ref #29023

```release-note
Rescheduler which ensures that critical pods are always scheduled enabled by default in GCE.
```
2016-09-05 00:27:43 -07:00
Kubernetes Submit Queue 2ead4ba589 Merge pull request #32011 from chuckbutler/upstream-master-messaging-fix
Automatic merge from submit-queue

Fixes the master messaging

<!--  Thanks for sending a pull request!  Here are some tips for you:
1. If this is your first time, read our contributor guidelines https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md and developer guide https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md
2. If you want *faster* PR reviews, read how: https://github.com/kubernetes/kubernetes/blob/master/docs/devel/faster_reviews.md
3. Follow the instructions for writing a release note: https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes
-->

**What this PR does / why we need it**: Corrects the master unit messaging state to correctly reflect that kubernetes is active

**Which issue this PR fixes** *(optional, in `fixes #<issue number>(, #<issue_number>, ...)` format, will close that issue when PR gets merged)*: fixes #32010

**Special notes for your reviewer**:

**Release note**:
<!--  Steps to write your release note:
1. Use the release-note-* labels to set the release note state (if you have access) 
2. Enter your extended release note in the below block; leaving it blank means using the PR title as the release note. If no release note is required, just write `NONE`. 
-->
```release-note
None
```

Proof: ![](https://www.evernote.com/l/AX74r1GLG3dNG504sJrDOPkb5_nYpkO_DUQB/image.png)
2016-09-04 02:02:54 -07:00
Kubernetes Submit Queue 7bab34c3e9 Merge pull request #31998 from mwielgus/ca-0.3.0-b6
Automatic merge from submit-queue

Bump ClusterAutoscaler to 0.3.0-beta6

Contains https://github.com/kubernetes/contrib/pull/1685.
2016-09-03 22:47:03 -07:00
Kubernetes Submit Queue af9afbff87 Merge pull request #31970 from wojtek-t/configurable_qps_limits_in_tests
Automatic merge from submit-queue

Make it possible to set test args
2016-09-03 08:36:55 -07:00
MrHohn b5c17fa3cd Use deployment for kube-dns 2016-09-02 16:37:36 -07:00
Charles Butler ff2478042a Fixes the master messaging
Resolves #32010
2016-09-02 16:57:07 -05:00
Marcin Wielgus 5d3adbe552 Bump ClusterAutoscaler to 0.3.0-beta6 2016-09-02 22:15:35 +02:00
Kubernetes Submit Queue b921c675a0 Merge pull request #31518 from bryk/release-v1.4.0-beta1
Automatic merge from submit-queue

Increase Dashboard UI version to v1.4.0-beta2

This is our first beta for 1.4. We started synchronizing versions with
the core.

Release tag:
https://github.com/kubernetes/dashboard/releases/tag/v1.4.0-beta2
2016-09-02 09:50:09 -07:00
Miao Luo 7adeec3e9c Update salt usage to accelerate kube-up.
Use state.show_highstate to wait for init highstate functions to be done on each node.
Then start highstate in parallel on all the minions.
2016-09-02 09:39:43 -07:00
Piotr Szczesniak 9ce2ad3f4c Enable Rescheduler by default 2016-09-02 15:53:57 +02:00
bryk b2373b05f9
Increase Dashboard UI version to v1.4.0-beta2
This is our first beta for 1.4. We started synchronizing versions with
the core.

Release tag:
https://github.com/kubernetes/dashboard/releases/tag/v1.4.0-beta2
2016-09-02 15:46:47 +02:00
Kubernetes Submit Queue dfccabe22f Merge pull request #31961 from piosz/heapster-fix
Automatic merge from submit-queue

Fixed port in Heapster liveness probe

fix #31955
2016-09-02 06:41:18 -07:00
Avesh Agarwal 4ba39b4722 Update mounttest container image version to 0.7 everywhere. 2016-09-02 09:03:11 -04:00
Wojciech Tyczynski 58e7308dee Make it possible to set test args 2016-09-02 14:24:20 +02:00
Piotr Szczesniak 45b6b861ae Fixed port in Heapster liveness probe 2016-09-02 11:50:32 +02:00
Wojciech Tyczynski 794074b273 Bump pod nany version to fix a bug 2016-09-02 10:44:41 +02:00
Girish Kalele 5d7d02b5bd Propagate KUBE_FEATURE_GATES environment variable to e2e environment 2016-09-01 15:37:24 -07:00
Kubernetes Submit Queue ff3ca3d616 Merge pull request #31830 from Amey-D/gci-kubelet
Automatic merge from submit-queue

Pick a specific GCI version by default on GCE.

Prior to this change, a K8s branch (master as well as release) was
pinned to a GCI milestone.  It would pick up the latest GCI release on
that milestone at the time of cluster creation.  The rationale was the
K8s users would automatically get the bug fixes in newer versions of
GCI.  However in practice, it makes the runtime environment
non-deterministic, and lack of continuous e2e tests mean we would run
into breakages sooner or later.

With this change, each K8s release will pick a specific version
of GCI by default (similar to how the Debian-based container-vm gets used).
Users can override the default version through KUBE_GCE_MASTER_IMAGE and
KUBE_GCE_NODE_IMAGE environment variables.

We expect the default GCI version will be updated relatively frequently stay
updated with newer GCI releases.  We can also automate the process to
automatically bump the hard-coded GCI version in future.


@vishh @adityakali can you please review?

cc @kubernetes/goog-image FYI
2016-09-01 13:41:05 -07:00
Marcin Wielgus 89f901d79a Bump cluster autoscaler to 0.3.0-beta5 2016-09-01 18:33:30 +02:00
Kubernetes Submit Queue a910a597fa Merge pull request #31872 from wojtek-t/store_startupscript_from_gke
Automatic merge from submit-queue

Store startupscript from GKE clusters too

Ref https://github.com/kubernetes/kubernetes/issues/31215

@kubernetes/goog-gke  Is there any reason why we don't want to do it?

@kubernetes/test-infra-maintainers
2016-09-01 08:33:24 -07:00
mksalawa 92c7feaf53 Add liveness probe in controller configurations. 2016-09-01 14:37:07 +02:00
mksalawa 84ad23d5e6 Bump heapster version to 1.2.0-beta.2 2016-09-01 14:37:07 +02:00
Wojciech Tyczynski 4fc48cfce3 Store startupscript from GKE clusters too 2016-09-01 13:48:50 +02:00
Kubernetes Submit Queue ef2dde9c48 Merge pull request #31868 from wojtek-t/enable_more_inflight_requests
Automatic merge from submit-queue

Make it possible to set higher limit for in-flight requests in test

Ref #31589
2016-09-01 04:42:01 -07:00
Wojciech Tyczynski 9c687add6b Make it possible to set higher limit for in-flight requests in test 2016-09-01 12:58:49 +02:00
Wojciech Tyczynski 22b160e552 Allow for configuring max inflight requests in kubemark 2016-09-01 11:46:37 +02:00
Amey Deshpande 6a2201f410 Pick a specific GCI version by default on GCE.
Prior to this change, a K8s branch (master as well as release) was
pinned to a GCI milestone.  It would pick up the latest GCI release on
that milestone at the time of cluster creation.  The rationale was the
K8s users would automatically get the bug fixes in newer versions of
GCI.  However in practice, it makes the runtime environment
non-deterministic, and lack of continuous e2e tests mean we would run
into breakages sooner or later.

With this change, each K8s release will pick a specific version
of GCI by default (similar to how the Debian-based container-vm gets used).
Users can override the default version through KUBE_GCE_MASTER_IMAGE and
KUBE_GCE_NODE_IMAGE environment variables.

We expect the default GCI version will be updated relatively frequently stay
updated with newer GCI releases.  We can also automate the process to
automatically bump the hard-coded GCI version in future.
2016-08-31 17:26:00 -07:00
Charles Butler 9cf5952ab7 move '(master)' to end of message for uniformity
This changes the status output from:

```
kubernetes/0  active    idle   3        172.27.24.54    8088/tcp
Kubernetes running.
kubernetes/1  active    idle   4        172.27.24.55    6443/tcp
(master) Kubernetes services started
```
 to this:
 ```
 kubernetes/0  active    idle   3        172.27.24.54    8088/tcp
 Kubernetes running.
 kubernetes/1  active    idle   4        172.27.24.55    6443/tcp
 Kubernetes services started (master)
 ```
2016-08-31 10:42:30 -05:00
Wojciech Tyczynski 3c64346e24 Bump addon-resizer version 2016-08-31 14:53:13 +02:00
Wojciech Tyczynski f75e0ece0a Revert "Bump addon-resizer version in heapster" 2016-08-31 08:30:56 +02:00
Charles Butler 1580863125 Automated testing shouldn't bootstrap
Juju bootstrapping is an act of cost. This should be an explicit action
by the tooling surrounding bundle-tester when testing a charm. Setting
bootstrap:false will allow us to get faster feedback at lower cost when
running the kubernetes charm under ci. Additionally doesn't reset so
no communication attempt is made to the controller

Additionally add tox to test dependency list
2016-08-30 16:12:54 -05:00
Kubernetes Submit Queue a3b17f5e53 Merge pull request #31614 from wojtek-t/bump_pod_nanny_version
Automatic merge from submit-queue

Bump addon-resizer version in heapster

Ref #31105
2016-08-30 12:14:28 -07:00
Matt Bruzek bd1f75a4a2 Removing the Storage plugin from the list 2016-08-30 13:11:04 -05:00
Kubernetes Submit Queue dccf3e9288 Merge pull request #31639 from derekwaynecarr/fix-e2e-local
Automatic merge from submit-queue

Fix running e2e against local cluster

required env vars were not being set.

/cc @pmorie
2016-08-30 09:11:22 -07:00
Kubernetes Submit Queue 3ccb99d87d Merge pull request #31692 from jszczepkowski/master
Automatic merge from submit-queue

Marked HA master feature experimental.

Marked HA master feature experimental.
2016-08-30 07:09:49 -07:00
Kubernetes Submit Queue 1388e664a4 Merge pull request #31637 from freehan/docker0fix
Automatic merge from submit-queue

keep docker0 with private cidr range

fixes: #31465

Keep docker0 when using kubenet on GCI. Assign 169.254.123.1/24 to docker0 to avoid cidr conflict.
2016-08-30 05:40:33 -07:00
Kubernetes Submit Queue 177a6840f8 Merge pull request #31519 from piosz/influxdb
Automatic merge from submit-queue

Update influxdb to 0.12

fix #27630 

```release-note
Update influxdb to 0.12
```
2016-08-30 05:03:47 -07:00
Jerzy Szczepkowski c5f18d517d Marked HA master feautre experimental.
Marked HA master feautre experimental.
2016-08-30 11:50:22 +02:00
Zach Loafman a167a90f80 AWS: Fix unbound SSH_CIDR
Another e2e bug, this one injected by https://github.com/kubernetes/kubernetes/pull/27061
2016-08-29 19:12:16 -07:00
Kubernetes Submit Queue e277ccef94 Merge pull request #31295 from zmerlynn/e2e-what-what
Automatic merge from submit-queue

AWS: Hopefully fix e2e?

**What this PR does / why we need it**: Fix AWS e2e
**Which issue this PR fixes**: fixes build broken by #28499 
**Special notes for your reviewer**: This is a pump & dump, I probably won't be around to respond to comments after this. If it needs a cherry-pick or anything, please check?
2016-08-29 17:10:06 -07:00
derekwaynecarr 275c29e208 Fix running e2e against local cluster 2016-08-29 17:16:13 -04:00
Minhan Xia a876f22102 keep docker0 with private cidr range 2016-08-29 13:57:42 -07:00
Kubernetes Submit Queue 033e473e12 Merge pull request #31242 from wojtek-t/attach_ttls
Automatic merge from submit-queue

Support for TTLs in etcd migration.

Ref #20504
2016-08-29 12:57:57 -07:00
Wojciech Tyczynski 0a0f3fd8a7 Bump addon-resizer version in heapster 2016-08-29 16:39:57 +02:00
Rodolfo Carvalho e24745d6d6 Fix Bash script
Two lines got mixed together.
2016-08-29 14:01:44 +02:00
Kubernetes Submit Queue e6df2db5c3 Merge pull request #31477 from freehan/cnibump
Automatic merge from submit-queue

bump cni to 9d5e6e6

fixes: #31348
2016-08-28 14:46:20 -07:00
Daniel Smith a291846cd1 Revert "Remove deprecated Namespace admission plug-ins" 2016-08-28 10:20:44 -07:00
Kubernetes Submit Queue 90e5559d03 Merge pull request #31250 from derekwaynecarr/deprecated-ns-plugins
Automatic merge from submit-queue

Remove deprecated Namespace admission plug-ins

```release-note
The NamespaceExists and NamespaceAutoProvision admission controllers have been removed.

All cluster operators should use NamespaceLifecycle.
```

Fixes https://github.com/kubernetes/kubernetes/issues/31195
2016-08-27 02:13:25 -07:00
Kubernetes Submit Queue 35ddfcba1a Merge pull request #31486 from jlowdermilk/feature-gate-salt
Automatic merge from submit-queue

fix feature_gates salt plumbing

Fix salt plumbing for `--feature-gate` from `FEATURE_GATES kube env.

Was generating grains.conf and kube-env for master only. Verified it works now for gci and debian master/nodes.

cc @thockin @timstclair
2016-08-26 22:43:02 -07:00
Ritesh H Shukla 9691b82071 Add support for vpshere cloud provider in kubeup
When deploying on vSphere using kube up add configuration
for vSphere cloud provider.
2016-08-26 15:09:11 -07:00
Kubernetes Submit Queue 1b38ba6d8f Merge pull request #31023 from vishh/gci-default
Automatic merge from submit-queue

Use upgraded container-vm by default on worker nodes for GCE k8s clusters

For https://github.com/kubernetes/kubernetes/issues/25276
Depends on https://github.com/kubernetes/test-infra/pull/417
2016-08-26 14:32:07 -07:00
Minhan Xia 69e540e634 bump cni to 9d5e6e6 2016-08-26 13:13:24 -07:00
Vishnu kannan 1e51efe02b enable kubelet eviction whenever inodes free is < 5% on GCE
Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-08-26 12:56:30 -07:00
derekwaynecarr c727fdc81f Remove deprecated namespace admission controllers 2016-08-26 11:14:55 -04:00
Kubernetes Submit Queue 76a458ccb8 Merge pull request #31507 from mwielgus/ca-0.3.0-b4
Automatic merge from submit-queue

Bump cluster autoscaler to 0.3.0-beta4
2016-08-26 04:00:41 -07:00
Piotr Szczesniak 94ca825a19 Update influxdb to 0.12.0 2016-08-26 12:17:00 +02:00
Marcin Wielgus 9812884264 Bump cluster autoscaler to 0.3.0-beta4 2016-08-26 11:24:24 +02:00
Wojciech Tyczynski 793d3acd8b Support for TTLs in etcd migration. 2016-08-26 10:28:00 +02:00
Piotr Szczesniak 0a3372272a Bumped Rescheduler version 2016-08-26 10:22:48 +02:00
Kubernetes Submit Queue d5033c27e4 Merge pull request #31392 from MrHohn/push-kube-dns
Automatic merge from submit-queue

Build and push kube-dns for 1.4 release.

Fix #31355.

Following docker images had been uploaded:
gcr.io/google_containers/kubedns-amd64:1.7
gcr.io/google_containers/kubedns-arm:1.7
gcr.io/google_containers/kubedns-arm64:1.7

Build for ppc64le is disabled by default, and it failed to be built using:
`KUBE_BUILD_PPC64LE=y make release`

I'm still working on making the ppc64le build. Updates will be added following this thread.

@girishkalele @thockin
2016-08-26 00:40:10 -07:00
Kubernetes Submit Queue d3ecad111e Merge pull request #28717 from freehan/ebtable
Automatic merge from submit-queue

Filter duplicate network packets in promiscuous bridge mode (with ebtables)

also fixes: #30783
2016-08-25 19:12:09 -07:00
Jeff Lowdermilk e7c42280f8 fix feature_gates salt plumbing 2016-08-25 17:34:41 -07:00
Kubernetes Submit Queue 36a6aee27f Merge pull request #30931 from Clarifai/ext-svc-ref-dns
Automatic merge from submit-queue

Add ExternalName kube-dns e2e test

ExternalName allows kubedns to return CNAME records for external
services. No proxying is involved.

Built on top of and includes #30599 

See original issue at
https://github.com/kubernetes/kubernetes/issues/13748

Feature tracking at
https://github.com/kubernetes/features/issues/33

The e2e test is at least as comprehensive as the one for headless services (namely, only to some degree)

```release-note
Add ExternalName services as CNAME references to external ones
```
2016-08-25 17:23:01 -07:00
Kubernetes Submit Queue f090fd158a Merge pull request #31367 from Amey-D/gci-kubelet
Automatic merge from submit-queue

gci: decouple from the built-in kubelet version

Prior to this change, configure.sh would:
(1) compare versions of built-in kubelet and downloaded kubelet, and
(2) bind-mount downloaded kubelet at /usr/bin/kubelet in case of
version mismatch
    
With this change, configure.sh:
(1) compares the two versions only on test clusters, and
(2) uses the actual file paths to start kubelet w/o any bind-mounting
    
To allow (2), this change also provides its own version of kubelet
systemd service file.
    
Effectively with this change we will always use the downloaded kubelet
binary along with its own systemd service file on non-test clusters.  The
main advantage is this change does not rely on the kubelet being built in to
the OS image.

@dchen1107 @wonderfly  can you please review

cc/ @kubernetes/goog-image FYI
2016-08-25 15:55:14 -07:00
Marcin Wielgus 5d806e1ebe Bump cluster autoscaler to 0.3.0-beta3 2016-08-25 15:37:38 +02:00
Rudi Chiarito 1e7120f02c Implement ExternalName in kube-dns e2e tests 2016-08-25 09:29:24 -04:00
Kubernetes Submit Queue ff42c1f2b8 Merge pull request #31349 from wojtek-t/enable_gc_in_kubemark
Automatic merge from submit-queue

Enable GC by default in Kubemark

Since GC is enabled by default, we should also enable it by default in kubemark
2016-08-25 00:20:45 -07:00
Amey Deshpande 2939ebdba5 gci: decouple from the built-in kubelet version
Prior to this change, configure.sh would:
(1) compare versions of built-in kubelet and downloaded kubelet, and
(2) bind-mount downloaded kubelet at /usr/bin/kubelet in case of
version mismatch

With this change, configure.sh:
(1) compares the two versions only on test clusters, and
(2) uses the actual file paths to start kubelet w/o any bind-mounting

To allow (2), this change also provides its own version of kubelet
systemd service file.

Effectively with this change we will always use the downloaded kubelet
binary along with its own systemd service file on non-test clusters.  The
main advantage is this change does not rely on the kubelet being built in to
the OS image.
2016-08-24 23:36:08 -07:00
Kubernetes Submit Queue 74b01041cc Merge pull request #31239 from aledbf/update-fluent-images
Automatic merge from submit-queue

Update fluent images

continues #29883 
fix #29782

```release-note
Reduced size of fluentd images.
```
2016-08-24 23:05:04 -07:00
Kubernetes Submit Queue 38d3decdfb Merge pull request #31318 from adityakali/gci53
Automatic merge from submit-queue

Add validation for KUBE_USER

Malformed KUBE_USER causes error in cluster setup.

cc/ @kubernetes/goog-image 
@Q-Lee @Amey-D  Can you please review?
2016-08-24 22:18:39 -07:00
MrHohn f1ff86f189 Build and push kube-dns for 1.4 release 2016-08-24 21:21:52 -07:00
Lucas Käldström d711fd8764 Refactor hyperkube, remove unnecessary packages, optimize layers, bump cni version, add new features, run kube-proxy in a daemonset 2016-08-25 01:24:05 +03:00
Aditya Kali 07d98bebe8 Validate KUBE_USER and KUBE_PASSWORD early on
Make sure KUBE_USER and KUBE_PASSWORD contains valid chars
as soon as we read them from kube config.
2016-08-24 15:01:11 -07:00
Aditya Kali acea7040bc Add validation for KUBE_USER
Malformed KUBE_USER causes error in cluster setup.
2016-08-24 15:01:11 -07:00
Minhan Xia 3ed5c7a8d7 add ebtables into images 2016-08-24 10:57:33 -07:00
Minhan Xia 42a554ec0d add ebtables rules to filter duplicate packets 2016-08-24 10:19:29 -07:00
Wojciech Tyczynski 29b5b0a347 Enable GC by default in Kubemark 2016-08-24 16:38:37 +02:00
Kubernetes Submit Queue ef2718620c Merge pull request #30900 from jsafrane/pvc-admission
Automatic merge from submit-queue

Add admission controller for default storage class.

The admission controller adds a default class to PVCs that do not require any
specific class. This way, users (=PVC authors) do not need to care about
storage classes, administrator can configure a default one and all these PVCs
that do not care about class will get the default one.

The marker of default class is annotation "volume.beta.kubernetes.io/storage-class", which must be set to "true" to work. All other values (or missing annotation) makes the class non-default.

Based on @thockin's code, added tests and made it not to reject a PVC when no class is marked as default.
. 
@kubernetes/sig-storage
2016-08-24 03:32:46 -07:00
Zach Loafman dfcf286036 AWS: Hopefully fix e2e?
Broken by #28499
2016-08-23 13:56:12 -07:00
Matt Liggett 2ddc08e567 Add debugging output when trying to find the name of the master. 2016-08-23 13:18:22 -07:00
Manuel de Brito Fontes 341b2c1736 Update fluent images 2016-08-23 10:11:15 -03:00
Kubernetes Submit Queue e5fbea62c6 Merge pull request #29883 from aledbf/fluent-image-size
Automatic merge from submit-queue

Reduce size of images fluentd-gcp and fluentd-elasticsearch

replaces #26652

```
aledbf/fluentd-elasticsearch                   1.19 769ece5c8ba8 About an hour ago 269.9 MB
gcr.io/google_containers/fluentd-elasticsearch 1.18 0a8cbfbea7f7 5 weeks ago       530.3 MB

aledbf/fluentd-gcp                             1.22 ef979b82a767 About an hour ago 307.9 MB
gcr.io/google_containers/fluentd-gcp           1.21 0ef09b1bcfd7 2 weeks ago       498.5 MB
```

closes #29782
2016-08-23 05:51:44 -07:00
Manuel de Brito Fontes e2c50152dd Remove kubernetes metadata plugin 2016-08-23 08:21:46 -03:00
Manuel de Brito Fontes 5753a3196c Reduce the size of fluentd images 2016-08-23 08:21:45 -03:00
Kubernetes Submit Queue 6e75fa9745 Merge pull request #31103 from mwielgus/scheduling-alg-provider-flag
Automatic merge from submit-queue

Scheduling algorithm provider flag in kube-up.sh

Follow up of:

#30274 #30992

cc: @piosz @wojtek-t @davidopp
2016-08-23 01:44:54 -07:00
Jeff Lowdermilk 5def8f674a Fix feature_gate plumbing in gci configure-helper.sh 2016-08-22 21:53:25 -07:00
Kubernetes Submit Queue f3329b7bae Merge pull request #30923 from Q-Lee/configure-webhook
Automatic merge from submit-queue

Configure webhook

**What this PR does / why we need it**: this configures the image policy webhook + admission controller for gce/gci.

addresses: #22888

**Release note**:
```Configure image verification admission controller and webhook on gce.
```
2016-08-22 21:46:47 -07:00
Gregory Ian 96c6f9dd76 remove NODE_IPS
remove NODE_IPS in create-kube-controller-manager-opts,  useless
2016-08-23 10:51:40 +08:00
Kubernetes Submit Queue 48997a4c44 Merge pull request #31095 from wojtek-t/enable_migration_support
Automatic merge from submit-queue

Support migration in etcd manifest

Ref #20504
2016-08-22 17:40:21 -07:00
Quintin Lee 182a4fd0ac Scripts to configure image verification admission controller for gce. 2016-08-22 16:54:03 -07:00
Kubernetes Submit Queue 45e557e237 Merge pull request #31099 from luxas/remove_kubelet_container
Automatic merge from submit-queue

Remove the kubelet container as it's unmaintained

<!--  Thanks for sending a pull request!  Here are some tips for you:
1. If this is your first time, read our contributor guidelines https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md and developer guide https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md
2. If you want *faster* PR reviews, read how: https://github.com/kubernetes/kubernetes/blob/master/docs/devel/faster_reviews.md
3. Follow the instructions for writing a release note: https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes
-->

**What this PR does / why we need it**:

It removes the outdated and unmainained kubelet image, since we're using the hyperkube image instead.
Should be pretty straightforward to remove this.

@fgrzadkowski @thockin @mikedanese @pmorie
2016-08-22 08:50:10 -07:00
Marcin Wielgus 11fabd7176 Scheduling algorithm provider flag in kube-up.sh 2016-08-22 17:49:00 +02:00
Jan Safranek 5f6efefc40 [squash] Rename and move to storageclass/ 2016-08-22 14:11:01 +02:00
Kubernetes Submit Queue 878e06a71c Merge pull request #30995 from piosz/critical-pods
Automatic merge from submit-queue

Make DNS and Heapster critical pods

ref #29023
```release-note
DNS, Heapster and UI are critical addons
```
2016-08-22 04:59:28 -07:00
Lucas Käldström eb652814db Remove the kubelet container as it's unmaintained 2016-08-22 11:55:14 +03:00
Wojciech Tyczynski c65339c972 Support migration in etcd manifest 2016-08-22 10:12:06 +02:00
Kubernetes Submit Queue 10a25b1709 Merge pull request #28499 from Secful/parameterize_vpc_name
Automatic merge from submit-queue

Parameterize vpc name
2016-08-22 00:54:38 -07:00
Kubernetes Submit Queue 413677110b Merge pull request #27061 from Naddiseo/aws-ip-restrict-ssh-fixes-26661
Automatic merge from submit-queue

kube-up: Allow IP restrictions for SSH and HTTPS API access on AWS.

<!--
Checklist for submitting a Pull Request

Please remove this comment block before submitting.

1. Please read our [contributor guidelines](https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md).
2. See our [developer guide](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md).
3. If you want this PR to automatically close an issue when it is merged,
   add `fixes #<issue number>` or `fixes #<issue number>, fixes #<issue number>`
   to close multiple issues (see: https://github.com/blog/1506-closing-issues-via-pull-requests).
4. Follow the instructions for [labeling and writing a release note for this PR](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes) in the block below.
-->

```release-note

```


[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

Closes #26661
2016-08-21 20:45:06 -07:00
Kubernetes Submit Queue 70ba811663 Merge pull request #29995 from jszczepkowski/ha-poc
Automatic merge from submit-queue

Support for creation/removal of master replicas.

HA master: initial support for creation/removal of masters replicas by
kube-up/kube-down scripts for GCE on gci (other distributions, including debian, are not supported yet).
2016-08-21 15:20:23 -07:00
Kubernetes Submit Queue c39b584ea2 Merge pull request #30583 from colemickens/fix-hack-path-handling
Automatic merge from submit-queue

fix path handling in hack/lib/init.sh

Jenkinsfile pipeline jobs get cloned into "\<project\> (\<branch\>)". As a result, I can't use certain things in `hack/lib/init.sh`.

This is a small fix for that problem.

**Release note**:
<!--  Steps to write your release note:
1. Use the release-note-* labels to set the release note state (if you have access) 
2. Enter your extended release note in the below block; leaving it blank means using the PR title as the release note. If no release note is required, just write `NONE`. 
-->
```release-note
NONE
```
2016-08-21 10:34:32 -07:00
Piotr Szczesniak 3230a9f36f Make DNS and Heapster critical pods 2016-08-21 07:21:47 +02:00
Kubernetes Submit Queue 7228ac1984 Merge pull request #31057 from johscheuer/fix-kube-controller-manager.manifest
Automatic merge from submit-queue

Fixes #31056

This PR fixes the issue described in https://github.com/kubernetes/kubernetes/issues/31056 - In https://github.com/kubernetes/kubernetes/blob/master/cluster/saltbase/salt/kube-controller-manager/kube-controller-manager.manifest#L82 there is a missing `+` after `" "`

result:
```
==> master: Summary
==> master: -------------
==> master: Succeeded: 52 (changed=43)
==> master: Failed:     0
==> master: -------------
==> master: Total states run:     52
```
2016-08-20 13:00:38 -07:00
Johannes Scheuermann f8d2b21327 Fixes #31056 2016-08-20 20:24:01 +02:00
Kubernetes Submit Queue 9030a3234f Merge pull request #30859 from wojtek-t/allow_custom_etcd_in_e2e
Automatic merge from submit-queue

Add possibility to run non-default etcd image in tests

Ref #20504

@lavalamp @hongchaodeng @timothysc - FYI
2016-08-20 09:32:35 -07:00
nikhiljindal 56a2458d29 Adding cert and basic auth files for federation-apiserver 2016-08-20 02:17:39 -07:00
Kubernetes Submit Queue c8c18b1d5c Merge pull request #30480 from caesarxuchao/gc-beta
Automatic merge from submit-queue

Enable the garbage collector by default

Turning GC on by default.

Memory usage of GC is back to normal after #30943. The CPU usage is a little higher than the cap in scalability test (1.11 core vs. 1 core). This PR adjusted the default GC worker to 20 to see if that helps CPU usage.

@kubernetes/sig-api-machinery  @wojtek-t @lavalamp
2016-08-19 22:57:54 -07:00
Kubernetes Submit Queue c39f0eec4a Merge pull request #30993 from mksalawa/bump_heapster_version
Automatic merge from submit-queue

Bump heapster version

Bump heapster version to v1.2.0-beta.1.
Migrate metrics tests and HPA to use List objects introduced in the new version.
2016-08-19 19:36:53 -07:00
Kubernetes Submit Queue 010c976ce8 Merge pull request #30468 from jlowdermilk/feature-config
Automatic merge from submit-queue

Feature gates for kube-system components

Implements [this proposal](https://github.com/kubernetes/kubernetes/blob/master/docs/proposals/runtimeconfig.md). Adds `--feature-gates` to apiserver, scheduler, controller-manager and proxy.

cc @lavalamp @adityakali
2016-08-19 18:15:19 -07:00
Kubernetes Submit Queue 3fab894d06 Merge pull request #30901 from ronnielai/percent1
Automatic merge from submit-queue

Enable pod eviction due to disk pressure in GCE.
2016-08-19 15:46:11 -07:00
Vishnu kannan ff7076060c Switch to using gci by default for GCE k8s clusters
Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-08-19 13:23:44 -07:00
Chao Xu f7a1ef8189 enable gc by default 2016-08-19 10:42:05 -07:00
Jeff Lowdermilk 51198f59da Add --feature-gates to kube-system components
apiserver,scheduler,controller-manager,proxy,kubelet all get
flag. Using one variable to plumb through config via salt/init
scripts for GCE and GKE
2016-08-19 09:07:43 -07:00
mksalawa 4b598fec0c Bump heapster version to v1.2.0-beta.1 2016-08-19 17:26:50 +02:00
Kubernetes Submit Queue a24df66dc8 Merge pull request #30870 from piosz/rescheduler-setup
Automatic merge from submit-queue

Salt configuration for Rescheduler

ref #29023
2016-08-19 02:54:24 -07:00
Kubernetes Submit Queue 1e09eb7949 Merge pull request #30500 from wojtek-t/etcd_migration
Automatic merge from submit-queue

Support for etcd migration

@xiang90 @timothysc @hongchaodeng
2016-08-19 00:34:06 -07:00
Kubernetes Submit Queue 2166ce2fdc Merge pull request #30545 from bprashanth/bump_glbc
Automatic merge from submit-queue

Bump up glbc version to 0.7.1
2016-08-18 13:02:17 -07:00
bindata-mockuser 4cddbccd43 Enable pod eviction due to disk pressure (default threshold is 10%) in GCE. 2016-08-18 10:11:28 -07:00
Jan Safranek 82d35fb461 Add admission controller for default storage class.
The admission controller adds a default class to PVCs that do not require any
specific class. This way, users (=PVC authors) do not need to care about
storage classes, administrator can configure a default one and all these PVCs
that do not care about class will get the default one.
2016-08-18 18:55:35 +02:00
Piotr Szczesniak 1f3fdab063 Salt configuration for Rescheduler 2016-08-18 12:24:09 +02:00
Wojciech Tyczynski 315d9f3689 Allow non-default etcd 2016-08-18 11:56:01 +02:00
Marcin Wielgus b9c2627e7e Bump cluster autoscaler to 0.3.0-beta2 2016-08-18 10:42:06 +02:00
Wojciech Tyczynski f3c32673ec Add migration test 2016-08-18 08:31:33 +02:00
Wojciech Tyczynski b42023eb03 Support for etcd migration 2016-08-18 08:31:33 +02:00
Brad Moylan 3cb6589a97 Use specific version of docker instead of latest. 2016-08-17 22:29:12 -07:00
Brad Moylan 7a4908b278 CentOS Cluster scripts: Upgrade K8S to 1.3.5 2016-08-17 22:20:08 -07:00
Brad Moylan 878684a49f Fix docker download location in CentOS script.
This script currntly downloads a file with a whale saying 404 and tries to daemonize it.
2016-08-17 22:20:08 -07:00
YuPengZTE 3faa38fcb6 The first letter should be capitalized 2016-08-18 11:49:53 +08:00
Zach Loafman ec33089519 AWS: Handle kube-down case where the LaunchConfig is dangling
Always query and attempt to delete the default launch-config
2016-08-17 14:45:43 -07:00
Timothy St. Clair 730fc70107 Update etcd default ports for v3, and validate tests 2016-08-17 07:49:19 -05:00
jianhuiz 9908a02872 lbaas subnet and floating network config; lbaas v2; env variable for fixed network 2016-08-17 02:23:12 -07:00
Kubernetes Submit Queue 68327f76bf Merge pull request #30748 from mwielgus/v-fix
Automatic merge from submit-queue

Fix verbosity flag in cluster autoscaler manifest

cc: @piosz
2016-08-17 00:56:24 -07:00
Marcin Wielgus 9c761f7349 Fix verbosity flag in cluster autoscaler manifest 2016-08-17 08:39:50 +02:00
Kubernetes Submit Queue f236df504a Merge pull request #30679 from mwielgus/ca-0.3.0-b1
Automatic merge from submit-queue

Bump cluster autoscaler to 0.3.0-beta1

cc: @piosz @fgrzadkowski @jszczepkowski
2016-08-16 11:11:37 -07:00
Kubernetes Submit Queue eaea0c3e79 Merge pull request #30595 from kubernetes/cluster-gke/reword
Automatic merge from submit-queue

cluster/gke: reword package docs

Rewords the package docs and removes the confusing dot trailing the file name
2016-08-16 11:11:16 -07:00
Kubernetes Submit Queue 11cfbe6223 Merge pull request #30221 from harryge00/typo-in-fluentd-elasticsearch-addons
Automatic merge from submit-queue

fix typo

Maybe a typo.
2016-08-16 11:10:47 -07:00
Marcin Wielgus bbfd7c2023 Bump cluster autoscaler to 0.3.0-beta1 2016-08-16 15:34:08 +02:00
Cole Mickens 1cb361ea2b Handle spaces in some hack/ scripts. Cleanup after hyperkube build. 2016-08-15 21:13:13 +00:00
Jerzy Szczepkowski 05a41623b0 Support for creation/removes of master replicas.
HA master: initial support for creation/removal of masters replicas by
kube-up/kube-down scripts for GCE on gci.
2016-08-15 22:36:49 +02:00
Kubernetes Submit Queue 914e56c09f Merge pull request #30479 from ixdy/gcloud-list-resources
Automatic merge from submit-queue

Use --regions instead of --region for gcloud list [resource]

gcloud has started complaining:
```
WARNING: Abbreviated flag [--region] will be disabled in release 132.0.0, use the full name [--regions].
WARNING: Abbreviated flag [--region] will be disabled in release 132.0.0, use the full name [--regions].
WARNING: Abbreviated flag [--region] will be disabled in release 132.0.0, use the full name [--regions].
```

We'll probably need to cherry-pick this, as otherwise the list-resources script will start failing at some point in the future.
2016-08-15 11:00:42 -07:00
Tamer Tas 141f70402c cluster/gke: reword package docs 2016-08-14 22:12:51 +03:00
Kubernetes Submit Queue 817256a716 Merge pull request #30401 from caesarxuchao/kubemark-gc-upstream
Automatic merge from submit-queue

Let load and density e2e tests use GC if it's on

I've run the 100 and 500 nodes tests and they both pass.

The test-infra half of the PR is https://github.com/kubernetes/test-infra/pull/369

cc @lavalamp
2016-08-13 16:04:34 -07:00
Kubernetes Submit Queue b47596a856 Merge pull request #30508 from timothysc/etcd304_cleanup
Automatic merge from submit-queue

Update core etcd references to use 3.0.4

This updates the core references to use 3.0.4. 

There are still legacy references in the code base that should be cleaned, or just removed but I'm reluctant to purge.  

/cc @kubernetes/sig-scalability
2016-08-13 02:18:03 -07:00
Kubernetes Submit Queue 9f8625fb2c Merge pull request #30372 from bbreslauer/addons-kubectl-opts
Automatic merge from submit-queue

Add user-specified kubectl arguments to addons start script

This is a simple way, using the same environment variable paradigm used throughout these scripts, to let a user specify kubectl arguments to the addons script.

fixes #30371
2016-08-13 00:20:33 -07:00
bprashanth b29a248bfd Bump up glbc version 2016-08-12 13:07:08 -07:00
Kubernetes Submit Queue 936c5171a5 Merge pull request #30503 from wojtek-t/optimize_gci
Automatic merge from submit-queue

Avoid unnecessary copies on GCI initialization.

The issue I faced was that when starting a cluster I was getting:
```
Aug 12 11:12:46 e2e-test-wojtekt-master configure.sh[1079]: cp: error writing '/home/kubernetes/kubernetes-src.tar.gz': No space left on device
```

This PR reduces amount of space that is needed on startup, as well as this speeds up starting cluster.

@lavalamp @dchen1107
2016-08-12 12:51:11 -07:00
Timothy St. Clair a0d177ca71 Update core etcd references to use 3.0.4 2016-08-12 13:39:07 -05:00
Kubernetes Submit Queue 9fe15e7376 Merge pull request #29037 from matthewdupre/calico-policy-deploy
Automatic merge from submit-queue

Add support for kube-up.sh to deploy Calico network policy to GCI masters

Also remove requirement for calicoctl from Debian / salt installed nodes and clean it up a little by deploying calico-node with a manifest rather than calicoctl.  This also makes it more reliable by retrying properly.

How to use:
```
make quick-release
NETWORK_POLICY_PROVIDER=calico cluster/kube-up.sh
```

One place where I was uncertain:
- CPU allocations (on the master particularly, where there's very little spare capacity).  I took some from etcd, but if there's a better way to decide this, I'm happy to change it.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/29037)
<!-- Reviewable:end -->
2016-08-12 08:12:01 -07:00
Wojciech Tyczynski 4d27f99997 Avoid unnecessary copies on GCI initialization. 2016-08-12 14:57:54 +02:00
Matt 568fb74a9a kube-up: move Calico policy components off master, and add support for GCI master 2016-08-11 17:11:16 -07:00
Jeff Grafton 4a32dc19dd Use --regions instead of --region for gcloud list [resource] 2016-08-11 14:45:20 -07:00
Aaron Crickenberger 4fd7578552 cluster/log-dump scp shouldn't check host keys
parity with cluster/aws/util.sh:ssh-to-node
2016-08-11 13:58:52 -07:00
Chao Xu 3688a78769 let load and density e2e tests use GC if it's on 2016-08-11 11:48:20 -07:00
Kubernetes Submit Queue 74bf443911 Merge pull request #30428 from CodeJuan/master
Automatic merge from submit-queue

fixed typos, the path is not docker



<!-- Reviewable:start -->
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30428)
<!-- Reviewable:end -->
2016-08-11 10:03:56 -07:00
codejuan 849adf5adb fixed typos, the path is not docker 2016-08-11 18:30:24 +08:00
mbohlool a5b2ffffd2 Start etcd-empty-dir-cleanup pod automatically on master 2016-08-10 23:28:21 -07:00
Ben Breslauer e82c3fbd73 Add user-specified kubectl arguments to addons start script 2016-08-10 18:08:01 -07:00
Kubernetes Submit Queue ea69570f61 Merge pull request #30092 from mbruzek/juju-util-fixes
Automatic merge from submit-queue

Juju util fixes

The util.sh file was out of date and caused the kube-up script to error out. This work fixes #23198
```release-note
* Updating the util.sh for the juju provider kube-up.sh 
```

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30092)
<!-- Reviewable:end -->
2016-08-10 17:09:52 -07:00
Kubernetes Submit Queue 97d65ce8e4 Merge pull request #28778 from ivan4th/support-custom-fedora-repos-in-vagrant-provider
Automatic merge from submit-queue

Support custom Fedora repos in vagrant provider

Sometimes `KUBERNETES_PROVIDER=vagrant cluster/kube-up.sh` fails due to problems
with Fedora's metalink URL:
```
Timeout was reached for https://mirrors.fedoraproject.org/metalink?repo=fedora-23&arch=x86_64 [Connection timed out after 120002 milliseconds]
```

This PR makes it possible to specify a custom Fedora repository URL:
```
export CUSTOM_FEDORA_REPOSITORY_URL=https://download.fedoraproject.org/pub/fedora/
```

[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/28778)
<!-- Reviewable:end -->
2016-08-10 16:33:54 -07:00
Kubernetes Submit Queue cbe75f40df Merge pull request #29610 from ivan4th/fix-vagrant-provision-error
Automatic merge from submit-queue

Fix error reporting during vagrant provisioning

<!--
Checklist for submitting a Pull Request

Please remove this comment block before submitting.

1. Please read our [contributor guidelines](https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md).
2. See our [developer guide](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md).
3. If you want this PR to automatically close an issue when it is merged,
   add `fixes #<issue number>` or `fixes #<issue number>, fixes #<issue number>`
   to close multiple issues (see: https://github.com/blog/1506-closing-issues-via-pull-requests).
4. Follow the instructions for [labeling and writing a release note for this PR](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes) in the block below.
-->

`release_not_found` shell function can be used both while running
`provision-master.sh` and `privision-node.sh` (it's used by `install-salt`
function in `provision-utils.sh`, but it was defined in `provision-master.sh`.
Because of this, one of my colleagues got the following diagnostic:

```
==> master: Succeeded: 52 (changed=8)
==> master: Failed:     0
==> master: -------------
==> master: Total states run:     52
==> node-1: Machine already provisioned. Run `vagrant provision` or use the `--provision`
==> node-1: flag to force provisioning. Provisioners marked to run always will still run.
==> node-1: Running provisioner: shell...
    node-1: Running: /tmp/vagrant-shell20160726-19144-hahnl1.sh
==> node-1: Prepare package manager
==> node-1: Provisioning network on node
==> node-1: Network configuration verified
==> node-1: /tmp/vagrant-shell: line 134: release_not_found: command not found
The SSH command responded with a non-zero exit status. Vagrant
assumes that this means the command failed. The output for this command
should be in the log above. Please read the output to determine what
went wrong.
```
... which is rather confusing.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/29610)
<!-- Reviewable:end -->
2016-08-10 15:45:59 -07:00
Kubernetes Submit Queue eef8bfec23 Merge pull request #29815 from vishh/node-e2e-latest-gci
Automatic merge from submit-queue

Use latest GCI image based on a regex in Node e2e

This PR also makes it possible to run node e2e against multiple previous images, sorted by creation time. A regex for the image name can be used to instruct node e2e to identify test images.

Depends on #29577

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/29815)
<!-- Reviewable:end -->
2016-08-10 13:52:21 -07:00
Kubernetes Submit Queue 66c9edfdea Merge pull request #30380 from zmerlynn/fix-aws-teardown
Automatic merge from submit-queue

AWS: Allow no-op kube-down to exit 0

Not exactly sure why hack/e2e.go `IsUp()` is returning true right now,
but I can solve this a different way. This unifies with the GCE
behavior, which is that no-op kube-down returns 0.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30380)
<!-- Reviewable:end -->
2016-08-10 12:05:11 -07:00
Vishnu kannan 2f6514bd63 Node e2e can run tests against GCE images based on a regex.
It can run tests against multiple existing images that match a regex.
GCI images will be using a regex.

Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-08-10 11:24:54 -07:00
Zach Loafman 8d0200e5af AWS: Allow no-op kube-down to exit 0
Not exactly sure why hack/e2e.go IsUp() is returning true right now,
but I can solve this a different way. This unifies with the GCE
behavior, which is that no-op kube-down returns 0.
2016-08-10 10:36:38 -07:00
Kubernetes Submit Queue 0d42ce62ee Merge pull request #30349 from wojtek-t/run_with_etcd3
Automatic merge from submit-queue

Allow running etcd in v3 API (currently just on GCE)

Ref #20504 #25286

@timothysc @xiang90 @hongchaodeng @smarterclayton @kubernetes/sig-api-machinery

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30349)
<!-- Reviewable:end -->
2016-08-10 10:33:19 -07:00
Matt Bruzek 9673cebc29 Update the series and the README to reflect the change. 2016-08-10 11:32:38 -05:00
Wojciech Tyczynski 679afea360 etcd3 support 2016-08-10 13:33:35 +02:00
Kubernetes Submit Queue 2b69a57e6e Merge pull request #30320 from mrdunski/master
Automatic merge from submit-queue

Add nfs-common to hyperkube



<!-- Reviewable:start -->
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30320)
<!-- Reviewable:end -->
2016-08-10 02:36:25 -07:00
Kubernetes Submit Queue bb8d2b213d Merge pull request #30309 from timothysc/etcd304
Automatic merge from submit-queue

Update etcd makefile to build 3.0.4

Bumps the dependency, but we will also need someone to push to the google repos too.  

/cc @kubernetes/sig-scalability  

xref: #29235 #29399

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/30309)
<!-- Reviewable:end -->
2016-08-10 01:23:19 -07:00
Patryk Duński 68dc5e7afd Add nfs-common to hyperkube
Fix for issue #30310
2016-08-10 09:03:28 +02:00
Kubernetes Submit Queue 9dc3858e1f Merge pull request #30273 from bryk/release-v1.1.1
Automatic merge from submit-queue

Update Dashboard UI to version v1.1.1

Release tag: https://github.com/kubernetes/dashboard/releases/tag/v1.1.1

Release issue: https://github.com/kubernetes/dashboard/issues/1078
2016-08-09 19:38:54 -07:00
Kubernetes Submit Queue 5aaaaff07c Merge pull request #30319 from mbohlool/cleanup_sidepod
Automatic merge from submit-queue

Add cleanup addon pod to remove empty keys from etcd

namespace deletion will leave a trace of empty keys on etcd. This PR adds an addon pod to periodically check for those empty keys on etcd and remove them.

fixes #27307
2016-08-09 17:12:19 -07:00
mbohlool 81cc0c5790 Add cleanup addon pod to remove empty keys in etcd 2016-08-09 15:59:45 -07:00
Kubernetes Submit Queue cdee52e5e7 Merge pull request #26790 from rmmh/bash-range
Automatic merge from submit-queue

Use bash ranges "{1..3}" instead of "$(seq 1 3)".




[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.kubernetes.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.kubernetes.io/reviews/kubernetes/kubernetes/26790)
<!-- Reviewable:end -->
2016-08-09 15:18:30 -07:00
Timothy St. Clair d22e7a1b4a Update etcd makefile to build 3.0.4 2016-08-09 15:35:03 -05:00
Timothy St. Clair 456c43c22d Update to shift etcd 2.2 references to use 3.0.3 2016-08-09 08:51:15 -05:00
bryk 0eb1affb85
Increase Dashboard UI version to v1.1.1
Release tag: https://github.com/kubernetes/dashboard/releases/tag/v1.1.1

Release issue: https://github.com/kubernetes/dashboard/issues/1078
2016-08-09 14:56:32 +02:00
Wojciech Tyczynski 38c28177d6 Propagate cluster size through salt 2016-08-09 09:41:48 +02:00
Ryan Hitchman 5508e49ef5 Use bash ranges "{1..3}" instead of "$(seq 1 3)". 2016-08-08 16:23:39 -07:00
Kubernetes Submit Queue 06479bde5e Merge pull request #30104 from mbruzek/juju-etcd-update
Automatic merge from submit-queue

Edits to bring the tls-terminated etcd cluster to the layer.

fixes #23198
```release-note
* Updates required for juju kubernetes to use the tls-terminated etcd charm.
```
2016-08-08 11:48:38 -07:00
haoyuan a1f20cbdf4 fix typo 2016-08-08 19:33:51 +08:00
Anton Mironov 1063af1568 Make Rackspace deploy scripts compatible with Kubernetes v1.3.0
* Use the current stable CoreOS image

 * Switch to etcd2

 * Launch flanneld on master to make nodes accessible

 * Generate Service Account certificate and enable admission controls
2016-08-08 16:05:39 +05:00
bindata-mockuser 68d9b02c1d Adding a default eviction disk check in test 2016-08-05 13:56:42 -07:00
Kubernetes Submit Queue 4d75d6e807 Merge pull request #30115 from timstclair/cleanbuild
Automatic merge from submit-queue

Cleanup k8s script noise with a verbosity concept

Fixes https://github.com/kubernetes/kubernetes/issues/30109

The KUBE_VERBOSE environment variable sets the verbosity level to
use. Log messages can specify a verbosity by setting the V
variable. e.g.

    V=2 kube::log::info foo bar

Would only print "foo bar" if $KUBE_VERBOSE >= 2.

Examples:

Default verbosity (1 for make commands):
```
$ make kubelet
+++ [0804 17:23:32] Generating bindata:
    /usr/local/google/home/stclair/go/k8s3/src/k8s.io/kubernetes/test/e2e/framework/gobindata_util.go
+++ [0804 17:23:37] Building the toolchain targets:
    k8s.io/kubernetes/hack/cmd/teststale
+++ [0804 17:23:37] Building go targets for linux/amd64:
    cmd/kubelet
# k8s.io/kubernetes/pkg/kubelet
pkg/kubelet/kubelet.go:247: undefined: a
make: *** [kubelet] Error 1
```

Extra verbose (5, comparable to previous levels):
<details>
```
$ make kubelet KUBE_VERBOSE=5
I0804 17:31:05.083395    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/trace.go:151:30: cannot use (traceBufHeader literal) (value of type traceBufHeader) as unsafe.ArbitraryType value in argument to unsafe.Sizeof
I0804 17:31:05.083503    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/trace.go:151:7: array length 64 << 10 - unsafe.Sizeof((traceBufHeader literal)) (value of type uintptr) must be constant
I0804 17:31:05.083600    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/mgcwork.go:269:37: cannot use (workbufhdr literal) (value of type workbufhdr) as unsafe.ArbitraryType value in argument to unsafe.Sizeof
I0804 17:31:05.083654    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/mgcwork.go:269:7: array length (_WorkbufSize - unsafe.Sizeof((workbufhdr literal))) / sys.PtrSize (value of type uintptr) must be constant
I0804 17:31:05.084006    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/chan.go:21:28: cannot use (hchan literal) (value of type hchan) as unsafe.ArbitraryType value in argument to unsafe.Sizeof
I0804 17:31:05.084040    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/chan.go:21:66: cannot use (hchan literal) (value of type hchan) as unsafe.ArbitraryType value in argument to unsafe.Sizeof
I0804 17:31:05.084076    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/chan.go:21:14: unsafe.Sizeof((hchan literal)) + uintptr(-int(unsafe.Sizeof((hchan literal))) & (maxAlign - 1)) (value of type uintptr) is not constant
I0804 17:31:05.085536    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/hashmap.go:80:31: cannot use (struct{b bmap; v int64} literal).v (value of type int64) as unsafe.ArbitraryType value in argument to unsafe.Offsetof
I0804 17:31:05.085567    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/hashmap.go:80:15: unsafe.Offsetof((struct{b bmap; v int64} literal).v) (value of type uintptr) is not constant
I0804 17:31:05.085788    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/hashmap.go:1053:45: cannot convert &zeroinitial (value of type *[1024]byte) to unsafe.Pointer
I0804 17:31:05.086995    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/mfinal.go:20:65: cannot use (finalizer literal) (value of type finalizer) as unsafe.ArbitraryType value in argument to unsafe.Sizeof
I0804 17:31:05.087031    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/mfinal.go:20:11: array length (_FinBlockSize - 2 * sys.PtrSize - 2 * 4) / unsafe.Sizeof((finalizer literal)) (value of type uintptr) must be constant
I0804 17:31:05.087957    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/mstats.go:170:39: cannot use memstats.by_size (variable of type [67]struct{size uint32; nmalloc uint64; nfree uint64}) as unsafe.ArbitraryType value in argument to unsafe.Offsetof
I0804 17:31:05.087999    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/mstats.go:170:76: cannot use memstats.by_size[0] (variable of type struct{size uint32; nmalloc uint64; nfree uint64}) as unsafe.ArbitraryType value in argument to unsafe.Sizeof
I0804 17:31:05.088483    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/panic.go:118:34: cannot use (_defer literal) (value of type _defer) as unsafe.ArbitraryType value in argument to unsafe.Sizeof
I0804 17:31:05.088510    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/panic.go:118:20: unsafe.Sizeof((_defer literal)) (value of type uintptr) is not constant
I0804 17:31:05.089812    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/sema.go:42:42: cannot use (semaRoot literal) (value of type semaRoot) as unsafe.ArbitraryType value in argument to unsafe.Sizeof
I0804 17:31:05.089845    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/runtime/sema.go:42:8: array length sys.CacheLineSize - unsafe.Sizeof((semaRoot literal)) (value of type uintptr) must be constant
I0804 17:31:05.094634    2601 parse.go:307] type checking encountered some errors in "runtime", but ignoring.
I0804 17:31:05.875185    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/go/k8s3/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/github.com/davecgh/go-spew/spew/bypass.go:33:26: cannot use (*byte)(nil) (value of type *byte) as unsafe.ArbitraryType value in argument to unsafe.Sizeof
I0804 17:31:05.875234    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/go/k8s3/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/vendor/github.com/davecgh/go-spew/spew/bypass.go:33:12: unsafe.Sizeof((*byte)(nil)) (value of type uintptr) is not constant
I0804 17:31:05.875838    2601 parse.go:307] type checking encountered some errors in "github.com/davecgh/go-spew/spew", but ignoring.
I0804 17:31:05.897216    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/crypto/cipher/xor.go:12:36: cannot use uintptr(0) (constant 0 of type uintptr) as unsafe.ArbitraryType value in argument to unsafe.Sizeof
I0804 17:31:05.897261    2601 parse.go:353] type checker error: /usr/local/google/home/stclair/.gvm/gos/go1.6.2/src/crypto/cipher/xor.go:12:18: int(unsafe.Sizeof(uintptr(0))) (value of type int) is not constant
I0804 17:31:05.897360    2601 parse.go:307] type checking encountered some errors in "crypto/cipher", but ignoring.
I0804 17:31:06.400904    2601 conversion.go:227] considering pkg "k8s.io/kubernetes/federation/apis/core/v1"
I0804 17:31:06.401138    2601 conversion.go:243]   tags: ["k8s.io/kubernetes/federation/apis/core"]
I0804 17:31:06.427408    2601 conversion.go:283]   no viable conversions, not generating for this package
I0804 17:31:06.427508    2601 main.go:73] Completed successfully.
Go version: go version go1.6.2 linux/amd64
+++ [0804 17:31:06] Generating bindata:
    /usr/local/google/home/stclair/go/k8s3/src/k8s.io/kubernetes/test/e2e/framework/gobindata_util.go
Generated bindata file : 11536 ../../..//test/e2e/generated/bindata.go lines of lovely automated artifacts
+++ [0804 17:31:12] Building the toolchain targets:
    k8s.io/kubernetes/hack/cmd/teststale
+++ [0804 17:31:12] Building go targets for linux/amd64:
    cmd/kubelet
# k8s.io/kubernetes/pkg/kubelet
pkg/kubelet/kubelet.go:247: undefined: a
!!! Error in /usr/local/google/home/stclair/go/k8s3/src/k8s.io/kubernetes/hack/lib/golang.sh:506
  'go install "${goflags[@]:+${goflags[@]}}" -gcflags "${gogcflags}" -ldflags "${goldflags}" "${nonstatics[@]:+${nonstatics[@]}}"' exited with status 2
Call stack:
  1: /usr/local/google/home/stclair/go/k8s3/src/k8s.io/kubernetes/hack/lib/golang.sh:506 kube::golang::build_binaries_for_platform(...)
  2: /usr/local/google/home/stclair/go/k8s3/src/k8s.io/kubernetes/hack/lib/golang.sh:692 kube::golang::build_binaries(...)
  3: hack/make-rules/build.sh:27 main(...)
Exiting with status 1
!!! Error in /usr/local/google/home/stclair/go/k8s3/src/k8s.io/kubernetes/hack/lib/golang.sh:596
  '( kube::golang::setup_env; echo "Go version: $(go version)"; local host_platform; host_platform=$(kube::golang::host_platform); local goflags goldflags gogcflags; eval "goflags=(${KUBE_GOFLAGS:-})"; goldflags="${KUBE_GOLDFLAGS:-} $(kube::version::ldflags)"; gogcflags="${KUBE_GOGCFLAGS:-}"; local use_go_build; local -a targets=(); local arg; readonly BINDATAS=("${KUBE_ROOT}/test/e2e/framework/gobindata_util.go"); kube::log::status "Generating bindata:" "${BINDATAS[@]}"; for bindata in ${BINDATAS[@]};
do
    if [[ -f $bindata ]]; then
        go generate "${bindata}";
    fi;
done; for arg in "$@";
do
    if [[ "${arg}" == "--use_go_build" ]]; then
        use_go_build=true;
    else
        if [[ "${arg}" == -* ]]; then
            goflags+=("${arg}");
        else
            targets+=("${arg}");
        fi;
    fi;
done; if [[ ${#targets[@]} -eq 0 ]]; then
    targets=("${KUBE_ALL_TARGETS[@]}");
fi; local -a platforms=(${KUBE_BUILD_PLATFORMS:-}); if [[ ${#platforms[@]} -eq 0 ]]; then
    platforms=("${host_platform}");
fi; local binaries; binaries=($(kube::golang::binaries_from_targets "${targets[@]}")); local parallel=false; if [[ ${#platforms[@]} -gt 1 ]]; then
    local gigs; gigs=$(kube::golang::get_physmem); if [[ ${gigs} -ge ${KUBE_PARALLEL_BUILD_MEMORY} ]]; then
        kube::log::status "Multiple platforms requested and available ${gigs}G >= threshold ${KUBE_PARALLEL_BUILD_MEMORY}G, building platforms in parallel"; parallel=true;
    else
        kube::log::status "Multiple platforms requested, but available ${gigs}G < threshold ${KUBE_PARALLEL_BUILD_MEMORY}G, building platforms in serial"; parallel=false;
    fi;
fi; kube::golang::build_kube_toolchain; if [[ "${parallel}" == "true" ]]; then
    kube::log::status "Building go targets for ${platforms[@]} in parallel (output will appear in a burst when complete):" "${targets[@]}"; local platform; for platform in "${platforms[@]}";
    do
        ( kube::golang::set_platform_envs "${platform}"; kube::log::status "${platform}: go build started"; kube::golang::build_binaries_for_platform ${platform} ${use_go_build:-}; kube::log::status "${platform}: go build finished" ) &> "/tmp//${platform//\//_}.build" &
    done; local fails=0; for job in $(jobs -p);
    do
        wait ${job} || let "fails+=1";
    done; for platform in "${platforms[@]}";
    do
        cat "/tmp//${platform//\//_}.build";
    done; exit ${fails};
else
    for platform in "${platforms[@]}";
    do
        kube::log::status "Building go targets for ${platform}:" "${targets[@]}"; kube::golang::set_platform_envs "${platform}"; kube::golang::build_binaries_for_platform ${platform} ${use_go_build:-};
    done;
fi )' exited with status 1
Call stack:
  1: /usr/local/google/home/stclair/go/k8s3/src/k8s.io/kubernetes/hack/lib/golang.sh:596 kube::golang::build_binaries(...)
  2: hack/make-rules/build.sh:27 main(...)
Exiting with status 1
make: *** [kubelet] Error 1
```
</details>

Remaining work: Add a verbosity label to more log messages.

/cc @kubernetes/sig-api-machinery @kubernetes/contributor-experience
2016-08-05 04:30:06 -07:00
Kubernetes Submit Queue 10b1ffbed8 Merge pull request #30047 from zmerlynn/fix-aws-bringup
Automatic merge from submit-queue

AWS/GCE: Rework use of master name

* Add a pillar for `hostname` (because even if there's a good Salt function for it, I don't trust it to return the short hostname)
* Move `INITIAL_ETCD_CLUSTER` to just the GCE turn-up
* Remove `master_name`, which isn't needed
2016-08-05 02:00:54 -07:00
Kubernetes Submit Queue 6c81ba5b71 Merge pull request #30038 from adityakali/gci53
Automatic merge from submit-queue

Remove use of /usr/share/google/safe_format_and_mount script from GCI

This script was provided by Google Compute Image Packages
(https://github.com/GoogleCloudPlatform/compute-image-packages) and
has been deprecated since over an year. Newer version of the package
doesn't include it at all. So remove its usage and instead follow
recommended instructions from
https://cloud.google.com/compute/docs/disks/add-persistent-disk#formatting.

cc @kubernetes/goog-image
2016-08-05 00:54:20 -07:00
Kubernetes Submit Queue 9189c2f72b Merge pull request #30040 from vishh/etcd-makefile
Automatic merge from submit-queue

make etcd makefile work on OSX
2016-08-04 23:38:43 -07:00
Tim St. Clair 9abdf719b8
Add a verbosity concept to kubernetes scripts
The KUBE_VERBOSE environment variable sets the verbosity level to
use. Log messages can specify a verbosity by setting the V
variable. e.g.

    V=2 kube::log::info foo bar

Would only print "foo bar" if $KUBE_VERBOSE >= 2.
2016-08-04 22:01:22 -07:00
Matt Bruzek 56fc1f23f2 Edits to bring the new etcd cluster to the layer. 2016-08-04 16:14:00 -05:00
Matt Bruzek 1d3b52fd9f Fixing identification script and adding output to ignore. 2016-08-04 19:18:07 +00:00
Matt Bruzek b9ac078be7 Updating the util.sh script to work with latest version of juju. 2016-08-04 12:04:16 -05:00
Zach Loafman 963a05ec72 AWS/GCE: Rework use of master name
* Add a pillar for hostname (because even if there's a good Salt
function for it, I don't trust it to return the short hostname)
* Move INITIAL_ETCD_CLUSTER to just the GCE turn-up
* Remove the master_name, which isn't needed as a pillar
2016-08-04 08:46:36 -07:00
Jerzy Szczepkowski c8d920ea6c Reverted conversion of influx-db to PetSet.
Reverted conversion of influx-db to PetSet.
2016-08-04 17:08:46 +02:00
Kubernetes Submit Queue 33239c1e6f Merge pull request #29948 from mbruzek/juju-kubedns-update
Automatic merge from submit-queue

Replacing skydns with kubedns for the juju cluster. #29720

```release-note
* Updating the cluster/juju provider to use kubedns in place of skydns.
```
2016-08-04 06:38:18 -07:00
Kubernetes Submit Queue 3f27b203a1 Merge pull request #29851 from bboreham/zones-flag
Automatic merge from submit-queue

In cluster scripts correct gcloud list arg from '--zone' to '--zones'

I started getting these messages when doing `kube-up` and similar operations:

    WARNING: Abbreviated flag [--zone] will be disabled in release 132.0.0, use the full name [--zones].

This PR corrects the flag where used.

Note there are many uses of `--zone` on commands like `gcloud instances describe` which are still correct - those commands do not accept multiple zones.
2016-08-03 22:01:36 -07:00
Kubernetes Submit Queue 4037420a47 Merge pull request #29850 from sdminonne/libvirt_coreos
Automatic merge from submit-queue

libvirt_coreos: to remove old skydns fork fetching from addons

@thockin @girishkalele  ref https://github.com/kubernetes/kubernetes/pull/29720.
Goal of this PR is: 

- to remove obsolete DNS config files.
- to propose a way to fetch the real template

As soon https://github.com/kubernetes/kubernetes/pull/29720 will be merged I'm OK to modify this accordingly.

FYI: @lhuard1A
2016-08-03 21:22:16 -07:00
Vishnu Kannan d2915f1267 make etcd makefile work on OSX
Signed-off-by: Vishnu Kannan <vishnuk@google.com>
2016-08-03 17:25:11 -07:00
Aditya Kali 40aeb2e6bb Remove use of /usr/share/google/safe_format_and_mount script
This script was provided by Google Compute Image Packages
(https://github.com/GoogleCloudPlatform/compute-image-packages) and
has been deprecated since over an year. Newer version of the package
doesn't include it at all. So remove its usage and instead follow
recommended instructions from
https://cloud.google.com/compute/docs/disks/add-persistent-disk#formatting.
2016-08-03 17:13:30 -07:00
Matt Bruzek d97157f7a4 Adding back in the kube_master_url that came up in testing. 2016-08-03 16:11:47 -05:00
Kubernetes Submit Queue c19a65c0c6 Merge pull request #29942 from ibm-contribs/issue-29546
Automatic merge from submit-queue

Documented second arg to create-flanneld-opts in cluster/ubuntu/util.sh

This is a bug fix, no release note needed.

Fixes #29546
2016-08-02 21:39:43 -07:00
Kubernetes Submit Queue fa5f3b816e Merge pull request #29877 from spxtr/gke-build
Automatic merge from submit-queue

GKE test-build-release: Actually do the build.

Multiple devs (myself included!) have experienced frustration with the fact that if `KUBERNETES_PROVIDER=gke` then `hack/e2e.go --build` doesn't actually do a build.

Are we actually relying on this behavior anywhere?
2016-08-02 15:20:41 -07:00
Matt Bruzek 34dca937b4 Replacing skydns with kubedns for the juju cluster. #29720 2016-08-02 16:49:27 -05:00
Daniel Smith 651c8a4b2f Revert "Modified influxdb petset to provision persistent volume." 2016-08-02 14:03:37 -07:00
Mike Spreitzer 923b2b4782 Documented second arg to create-flanneld-opts in cluster/ubuntu/util.sh
Fixes #29546
2016-08-02 16:33:55 -04:00
k8s-merge-robot fd4e923890 Merge pull request #29332 from caesarxuchao/gc-e2e
Automatic merge from submit-queue

[Garbage Collector] add e2e tests again

#27151 is reverted because gke didn't start correctly after it's merged (https://github.com/kubernetes/kubernetes/pull/27151#issuecomment-233030686).

The possible problem is the `unbound variable`, which is fixed in the second commit of this PR. However, I cannot verify if the PR will fail the gke suite since I don't have the environment to run that suite.

@wojtek-t @lavalamp
2016-08-02 13:26:43 -07:00
k8s-merge-robot 81ab15ce44 Merge pull request #28700 from colemickens/azure-kube-up-fix-env-var
Automatic merge from submit-queue

azure: kube-up respects AZURE_RESOURCE_GROUP

This fixes #28482.

* declare AZKUBE_ variables as global to workaround lack of bash support for exporting array variables
2016-08-02 12:18:43 -07:00
k8s-merge-robot cadee46753 Merge pull request #28840 from jszczepkowski/influx-ps
Automatic merge from submit-queue

Modified influxdb petset to provision persistent  volume.


[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

[WIP] Modified influxdb petset to create claim.
2016-08-02 11:07:39 -07:00
Chao Xu 35193be088 plumb --enable_garbage_collector from environment variable;
adding a simple e2e test
2016-08-02 10:02:52 -07:00
Jerzy Szczepkowski f7167d11a8 Modified influxdb petset to provision pv.
Modified influxdb petset to provision pv.
2016-08-02 18:09:14 +02:00
k8s-merge-robot d34428a6f4 Merge pull request #29786 from jszczepkowski/hamaster-etcd2
Automatic merge from submit-queue

Modified etcd manifest to support clustering.
2016-08-02 04:18:20 -07:00
k8s-merge-robot 1ec1051170 Merge pull request #29591 from pbx0/symlinks
Automatic merge from submit-queue

cluster/images/hyperkube: re-add hyperkube busybox style symlinks

Originally symlinks were added with a `--make-symlinks` command discussed in https://github.com/kubernetes/kubernetes/issues/24510 and implemented in https://github.com/kubernetes/kubernetes/pull/24511.

It was backed out in https://github.com/kubernetes/kubernetes/pull/25693 because go binaries don't run in qemu and this breaks cross-building the Dockerfile for arm. In this case, due to running `hyperkube --make-symlinks`.

Lets just add the symlinks manually until the upstream bug is fixed (qemu).

fixes #28702

@mikedanese @thockin @yifan-gu @euank
2016-08-01 21:46:16 -07:00
k8s-merge-robot 35fb50ba4c Merge pull request #29801 from rbuskens/multi-thread-config
Automatic merge from submit-queue

Updated fluentd configuration to spawn multiple threads for processing

(by default, fluentd uses a single thread).

@a-robinson @igorpeshansky
2016-08-01 18:41:17 -07:00
Joe Finney 95ea9586da GKE test-build-release: Actually do the build. 2016-08-01 13:31:01 -07:00
Rick Buskens 77bda6fd16 Updated configuration to spawn multiple threads for processing 2016-08-01 15:08:11 -04:00
Bryan Boreham f5159b49c2 Correct gcloud list arg from '--zone' to '--zones'
`--zone` was accepted as an abbreviation but is now deprecated
and will be disabled entirely in gcloud 132.0.0.
2016-08-01 14:49:38 +01:00
Salvatore Dario Minonne a1c323fa75 libvirt_coreos: to remove old skydns fork fetching from addons 2016-08-01 14:41:10 +02:00
Jerzy Szczepkowski 657b30ccf6 Modified etcd manifest to support clustering.
Modified etcd manifest to support clustering.
2016-07-30 16:01:04 +02:00
Vishnu kannan bb4e1e62fa Mention updating node e2e config before updating gci image milestone
Signed-off-by: Vishnu kannan <vishnuk@google.com>
2016-07-29 14:26:15 -07:00
k8s-merge-robot 25b6ccfc86 Merge pull request #29754 from bprashanth/exechealthz_version
Automatic merge from submit-queue

Bump exechealthz image

With the new image at least if we observe an exec container taking more ram than it should (like the oom situation, which shouldn't happen today because of the increased limits), we can kubectl exec and check the pprof endpoints. 

Note that I'm not bumping the rc version, because I just did so with: https://github.com/kubernetes/kubernetes/pull/29693.
2016-07-28 16:25:11 -07:00
Prashanth Balasubramanian 1a0374ce4b Bump exechealthz image 2016-07-28 11:53:13 -07:00
lparam cff87c2017 Delete all deployments when tear down cluster alive resources 2016-07-28 09:20:56 +08:00
k8s-merge-robot 78f7b32e66 Merge pull request #29693 from bprashanth/healthz_limits
Automatic merge from submit-queue

Give healthz more memory to mitigate #29688

This will recreate the rc but not the pods. At least on the clusters we patched, if the pods get recreated they'll ccome back up with the updated limits. 
#29688
2016-07-27 15:34:49 -07:00
Prashanth Balasubramanian 79d7519f67 Give healthz more memory to mitigate #29688 2016-07-27 12:22:36 -07:00
Daniel Smith fb3f02fb68 Revert "Modified etcd manifest to support clustering." 2016-07-27 12:03:21 -07:00
CJ Cullen 6d2c411757 Fix potential unbound KUBE_USER variable in gci/trusty. 2016-07-27 10:50:44 -07:00
Jerzy Szczepkowski 827ee794d6 Modified etcd manifest to support clustering.
Modified etcd manifest to support clustering.
2016-07-26 23:24:14 +02:00
Patrick Baxter 895ac2c1d4 cluster/images/hyperkube: re-add hyperkube busybox style symlinks 2016-07-26 17:55:10 +00:00
Ivan Shvedunov 3e359491ef Fix error reporting during vagrant provisioning 2016-07-26 13:14:35 +03:00
k8s-merge-robot d1734287cb Merge pull request #29475 from cjcullen/customuser
Automatic merge from submit-queue

export KUBE_USER to salt (support custom usernames) for vagrant, vsph…

GCE/GKE were handled in #29164, AWS was handled in #29428. This should cover the rest of the configurations that use ABAC.
2016-07-22 23:12:37 -07:00
k8s-merge-robot ffef5ad4c5 Merge pull request #29426 from justinsb/bump_kubeup_max_time
Automatic merge from submit-queue

kube-up: increase download timeout for kubernetes.tar.gz

Particularly on smaller instances on AWS, we were hitting the 80 second
timeout now that our image is well over the 1GB mark.

Increase the timeout from 80 seconds to 300 seconds.

Fix #29418
2016-07-22 21:03:49 -07:00
k8s-merge-robot 64d185f534 Merge pull request #29474 from luxas/cni_cross
Automatic merge from submit-queue

Include CNI for all architectures in the hyperkube image

Can some of you (@jfrazelle @mikedanese) quickly lgtm this?
I'd like it if we got it merged before v1.4.0-alpha.2

It's not a huge change, I'm just cross-compiling this CNI stuff while waiting for the v0.4.0 which likely will release binaries for all arches.
2016-07-22 17:13:22 -07:00
k8s-merge-robot 3d162d0400 Merge pull request #29427 from justinsb/aws_master_os_distribution
Automatic merge from submit-queue

AWS kube-up: fix MASTER_OS_DISTRIBUTION

On AWS we were defining KUBE_MASTER_OS_DISTRIBUTION, but the scripts
expect MASTER_OS_DISTRIBUTION.

Fixes #29422
2016-07-22 15:35:20 -07:00
CJ Cullen 861583ac3e export KUBE_USER to salt (support custom usernames) for vagrant, vsphere, photon, openstack. 2016-07-22 15:22:03 -07:00
Lucas Käldström 8786dab70a Include CNI for all architectures in the hyperkube image 2016-07-23 01:03:46 +03:00
Hongchao Deng 74e6626967 Update etcd deprecated flag
- "-addr" => "--advertise-client-urls"
- "-bind-addr" => "--listen-client-urls"
2016-07-22 11:01:11 -07:00
k8s-merge-robot f37cadd357 Merge pull request #29445 from wojtek-t/fix_kubemark_after_ip_address_machinations
Automatic merge from submit-queue

Fix Kubemark config after IP addresses machinations
2016-07-22 03:44:46 -07:00
Wojciech Tyczynski 28205d6a43 Fix Kubemark config after IP addresses machinations 2016-07-22 11:49:15 +02:00
Justin Santa Barbara 55d0d3b4fa AWS kube-up: export kube_user to salt
This was done for GCE in #29164, but not for AWS.

Fixes #29424
2016-07-22 00:46:03 -04:00
Justin Santa Barbara 49da8298c9 AWS kube-up: fix MASTER_OS_DISTRIBUTION
On AWS we were defining KUBE_MASTER_OS_DISTRIBUTION, but the scripts
expect MASTER_OS_DISTRIBUTION.

Fixes #29422
2016-07-22 00:45:05 -04:00
Justin Santa Barbara eb3483eaba kube-up: increase download timeout for kubernetes.tar.gz
Particularly on smaller instances on AWS, we were hitting the 80 second
timeout now that our image is well over the 1GB mark.

Increase the timeout from 80 seconds to 300 seconds.

Fix #29418
2016-07-22 00:39:35 -04:00
CJ Cullen e559e305dd append an abac rule for $KUBE_USER. 2016-07-21 09:40:39 -07:00
k8s-merge-robot 20246986df Merge pull request #29295 from fgrzadkowski/ha_master
Automatic merge from submit-queue

Add load balancer in front of apiserver in HA master setup

The first commit is just https://github.com/kubernetes/kubernetes/pull/29201 and has been already LGTMed.

Second commit has some small fixes:
1. Precompute REGION variable in config
2. Add timeout for waiting for loadbalancer
3. Fix kube-down so that it doesn't delete some resources if there are still masters/nodes in other zones

Second commit also fixes bug in https://github.com/kubernetes/kubernetes/pull/29201 where variable `REGION` was unset in `kube-down` when deleting master IP. The bug caused leaking of IP addresses. 

https://github.com/kubernetes/kubernetes/issues/21124

@davidopp @jszczepkowski @wojtek-t @mikedanese
2016-07-21 08:32:30 -07:00
Wojciech Tyczynski e31926def9 Allow for increasing qps limits in kubemark 2016-07-21 10:07:53 +02:00
Zach Loafman 0750eaf533 AWS kube-up: Fix unbound KUBE_MANIFESTS_TAR_URL variable in Salt config
It shouldn't be necessary for all distros to define this env variable.
2016-07-20 10:50:34 -07:00
Filip Grzadkowski e9585fba91 1. Precompute REGION variable in config
2. Add timeout for waiting for loadbalancer
3. Fix kube-down so that it doesn't delete some resources if there are still masters/nodes in other zones
2016-07-20 17:25:25 +02:00
k8s-merge-robot a93fbb108a Merge pull request #29235 from luxas/bump_etcd
Automatic merge from submit-queue

Bump the default etcd version in the Makefile to 3.0.3

Fixes: #29132

I haven't had time to manually validate the arm and arm64 version yet, but I think it should be fine.

cc @xiang90 @hongchaodeng @timothysc @lavalamp @wojtek-t @thockin @kubernetes/sig-scalability @Pensu @laboger
2016-07-20 07:52:14 -07:00
Filip Grzadkowski 70bb57a3e1 Revert "Merge pull request #29278 from kubernetes/revert-29201-ha_master"
This reverts commit ecebdb5707, reversing
changes made to 976ca09d71.
2016-07-20 16:37:31 +02:00
Filip Grzadkowski 194895740c Revert "Add and delete load balancer in front of apiserver." 2016-07-20 14:02:59 +02:00
Piotr Szczesniak 976ca09d71 Merge pull request #29201 from fgrzadkowski/ha_master
Add and delete load balancer in front of apiserver.
2016-07-20 09:38:19 +02:00
k8s-merge-robot 5df9284ff4 Merge pull request #26746 from MHBauer/enable-ssh-compression
Automatic merge from submit-queue

Ubuntu: Enable ssh compression when downloading binaries during cluster creation

<!--
Checklist for submitting a Pull Request

Please remove this comment block before submitting.

1. Please read our [contributor guidelines](https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md).
2. See our [developer guide](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md).
3. If you want this PR to automatically close an issue when it is merged,
   add `fixes #<issue number>` or `fixes #<issue number>, fixes #<issue number>`
   to close multiple issues (see: https://github.com/blog/1506-closing-issues-via-pull-requests).
4. Follow the instructions for [labeling and writing a release note for this PR](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes) in the block below.
-->
resolves #20971 by using the options provided by ssh. 

Native ssh compression has existed for years, and the server is free to disregard the setting, so this should be safe.

With things like the kube binaries I see about a 2x speed increase. 

```
λ time scp kubes-bin.tar   9.30.182.251:/mnt/build/kubin
kubes-bin.tar                                                                                                            100%  344MB  10.7MB/s   00:32

real	0m32.284s
user	0m1.679s
sys	0m1.263s

λ time scp -C kubes-bin.tar   9.30.182.251:/mnt/build/kubin
kubes-bin.tar                                                                                                            100%  344MB  22.9MB/s   00:15

real	0m14.810s
user	0m12.858s
sys	0m0.994s

λ ls -lah kubes-bin.tar
-rw-r--r--  1 mhb  staff   344M Jun  2 15:29 kubes-bin.tar

λ tar -tf kubes-bin.tar
kubectl
master/
master/etcd
master/etcdctl
master/flanneld
master/kube-apiserver
master/kube-controller-manager
master/kube-scheduler
node/
node/flanneld
node/kube-proxy
node/kubelet
```
2016-07-19 19:21:46 -07:00
Lucas Käldström 62357bd767 Bump etcd version to 3.0.3 2016-07-20 01:10:49 +03:00
Filip Grzadkowski 5c0f0daae0 Add and delete load balancer in front of apiserver. 2016-07-19 16:44:21 +02:00
k8s-merge-robot c31882a5f2 Merge pull request #29140 from maisem/gce_on_cvm
Automatic merge from submit-queue

Fixing kube-up for CVM masters.

@roberthbailey @zmerlynn
2016-07-18 20:06:56 -07:00
k8s-merge-robot 8b16c75ba5 Merge pull request #29139 from adityakali/logrotate.1
Automatic merge from submit-queue

fix logrotate config (again)

we need to add the dateformat option so that the logrotate
can create unique logfiles for each rotation. Without this,
logrotation is skipped with message like (generated in
verbose mode of logrotate):

rotating log /var/log/rotate-test.log, log->rotateCount is 5
dateext suffix '-20160718'
glob pattern '-[0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9]'
destination /var/log/rotate-test2.log-20160718.gz already exists, skipping rotation

Tested as follows:
  # config in '/etc/logrotate.d/rotate-test':
  /var/log/rotate-test.log {
    rotate 5
    copytruncate
    missingok
    notifempty
    compress
    maxsize 100M
    daily
    dateext
    dateformat -%Y%m%d-%s
    create 0644 root root
  }

  # create 150Mb of /var/log/rotate-test.log
  $ dd if=/dev/zero of=/var/log/rotate-test.log bs=1048576 count=150 conv=notrunc oflag=append

  # run logrotate
  $ /usr/sbin/logrotate -v /etc/logrotate.conf
  ...
  rotating pattern: /var/log/rotate-test.log  after 1 days (5 rotations)
  empty log files are not rotated, log files >= 104857600 are rotated earlier, old logs are removed
  considering log /var/log/rotate-test.log
    log needs rotating
  rotating log /var/log/rotate-test.log, log->rotateCount is 5
  Converted ' -%Y%m%d-%s' -> '-%Y%m%d-%s'
  dateext suffix '-20160718-1468875268'
  glob pattern '-[0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9]-[0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9]'
  copying /var/log/rotate-test.log to /var/log/rotate-test.log-20160718-1468875268
  truncating /var/log/rotate-test.log
  compressing log with: /bin/gzip

  Repeating 'dd' and 'logrotate' commands now generate logfiles correctly.

#27754 
@bprashanth can you please review?
2016-07-18 18:20:41 -07:00
k8s-merge-robot 1d9199628f Merge pull request #29141 from zmerlynn/fix-node-prefix
Automatic merge from submit-queue

GCE bring-up: Differentiate NODE_TAGS from NODE_INSTANCE_PREFIX
2016-07-18 17:11:40 -07:00
k8s-merge-robot d90e3761ef Merge pull request #28489 from liyimeng/patch-1
Automatic merge from submit-queue

hyperkube: fix build for 3rd party registry (again)


Fixes issue #28487 

This is a minor fix for the issue reported in #28487
2016-07-18 17:11:35 -07:00
Aditya Kali 09b2c27a92 fix logrotate config (again)
we need to add the dateformat option so that the logrotate
can create unique logfiles for each rotation. Without this,
we logrotation is skipped with message like (generated in
verbose mode of logrotate):

rotating log /var/log/rotate-test.log, log->rotateCount is 5
dateext suffix '-20160718'
glob pattern '-[0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9]'
destination /var/log/rotate-test2.log-20160718.gz already exists, skipping rotation

Tested as follows:

  # config in '/etc/logrotate.d/rotate-test':
  /var/log/rotate-test.log {
    rotate 5
    copytruncate
    missingok
    notifempty
    compress
    maxsize 100M
    daily
    dateext
    dateformat -%Y%m%d-%s
    create 0644 root root
  }

  # create 150Mb of /var/log/rotate-test.log
  $ dd if=/dev/zero of=/var/log/rotate-test.log bs=1048576 count=150 conv=notrunc oflag=append

  # run logrotate
  $ /usr/sbin/logrotate -v /etc/logrotate.conf
  ...
  rotating pattern: /var/log/rotate-test.log  after 1 days (5 rotations)
  empty log files are not rotated, log files >= 104857600 are rotated earlier, old logs are removed
  considering log /var/log/rotate-test.log
    log needs rotating
  rotating log /var/log/rotate-test.log, log->rotateCount is 5
  Converted ' -%Y%m%d-%s' -> '-%Y%m%d-%s'
  dateext suffix '-20160718-1468875268'
  glob pattern '-[0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9]-[0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9]'
  copying /var/log/rotate-test.log to /var/log/rotate-test.log-20160718-1468875268
  truncating /var/log/rotate-test.log
  compressing log with: /bin/gzip

  Repeating 'dd' and 'logrotate' commands now generate logfiles correctly.
2016-07-18 15:37:00 -07:00
Maisem Ali fe14340051 Fixing kube-up for CVM masters. 2016-07-18 14:21:41 -07:00
Zach Loafman 4c667c38c9 GCE bring-up: Differentiate NODE_TAGS from NODE_INSTANCE_PREFIX
Kubernetes-side fix to #29074 (GKE-side fix necessary as well)
2016-07-18 14:20:45 -07:00
Prashanth Balasubramanian 1173dd13bf Change maxsize to size in logrotate. 2016-07-18 11:30:50 -07:00
k8s-merge-robot 36c07cc554 Merge pull request #27961 from maisem/os-distribution
Automatic merge from submit-queue

Splitting OS_DISTRIBUTION into NODE_OS_DISTRIBUTION and MASTER_OS_DISTRIBUTION

fixes #26183 
[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()
2016-07-15 14:11:47 -07:00
Maisem Ali 97f3f80833 Splitting OS_DISTRIBUTION into NODE_OS_DISTRIBUTION and
MASTER_OS_DISTRIBUTION.
2016-07-15 12:02:31 -07:00
Mike Danese 95e2e299a9 move kube-dns to the cluster/addons/ directory 2016-07-14 11:44:00 -07:00
k8s-merge-robot ae990defcf Merge pull request #26956 from joe2far/fix-typos
Automatic merge from submit-queue

Fixed several typos
2016-07-14 04:13:15 -07:00
k8s-merge-robot febd37b148 Merge pull request #28164 from intelsdi-x/dont_set_provider_for_conformance_tests
Automatic merge from submit-queue

Unset KUBERNETES_PROVIDER when KUBERNETES_CONFORMANCE_TEST is set

fixes #26269
same as #26530 - i accidentally lost my fork and couldn't rebase there ;)
@mikedanese PTAL
2016-07-14 02:53:08 -07:00
k8s-merge-robot 5b92ee2155 Merge pull request #28823 from zenly/master
Automatic merge from submit-queue

ConfigMap added to kube addon manager

fixes #28775
2016-07-13 16:43:19 -07:00
k8s-merge-robot f9a45e6983 Merge pull request #28673 from cheld/add-cni-config
Automatic merge from submit-queue

add default flannel configuration for cni

I added a default flannel configuration for cni.

So hyperkube can be started with:
```
--network-plugin=kubenet
```
or with flannel:

```
--network-plugin=cni
--network-plugin-dir=/etc/cni/net.d
```

Requires update of cni binaries to 0.3.0 or later to work. See also https://github.com/kubernetes/kubernetes/issues/27603

This PR is intended to support multi-node Hyperkube 
https://github.com/kubernetes/kube-deploy/pull/115



CC @zreigz  

[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()
2016-07-13 14:42:07 -07:00
k8s-merge-robot 783aa1a28b Merge pull request #28872 from lojies/sshoptadd
Automatic merge from submit-queue

Add SSH_OPTS to config ssh and scp port

Add SSH_OPTS support.This can change ssh and scp default port.

fixes #17934
2016-07-13 12:54:25 -07:00
k8s-merge-robot 753ba9f6fe Merge pull request #28806 from silasbw/ubuntu-version-0
Automatic merge from submit-queue

cluster/ubuntu/download-release.sh: if $KUBE_VERSION is set, use it.

```release-note
If $KUBE_VERSION is set in cluster/ubuntu/download-release.sh use that version, 
otherwise set it to the result of `get_latest_version_number`.
```

[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()
2016-07-13 12:54:20 -07:00
k8s-merge-robot 2906a35c1a Merge pull request #28745 from justinsb/fix_28644
Automatic merge from submit-queue

kube-up: install new Docker pre-requisite (libltdl7) when not in image

Docker now has a dependency on libltdl7; we have to specify it manually
if we are installing docker using dpkg (vs using apt-get or similar,
which would pull it in automatically)

Fixes #28644
2016-07-13 10:17:15 -07:00
joe2far 5ead89b5bb Fixed several typos 2016-07-13 15:06:24 +01:00
Angus Salkeld 71a9487f70 Add detect-master to local provider to get e2e working
go run hack/e2e.go -v -test --check_node_count=false --test_args="--ginkgo.focus=\[Feature:Volumes\]"
2016-07-13 09:25:35 +02:00
Tim Hockin 9613e15801 Make releases work 2016-07-12 21:52:54 -07:00
Tim Hockin 881e21c2d5 Link _output/bin/ to real binaries for this arch
This makes followup commits easier wrt finding binaries during build.
2016-07-12 21:52:00 -07:00
Tim Hockin faeef5c4ae Use make as the main build tool
This allows us to start building real dependencies into Makefile.

Leave old hack/* scripts in place but advise to use 'make'.  There are a few
rules that call things like 'go run' or 'build/*' that I left as-is for now.
2016-07-12 21:52:00 -07:00
lojies b00902c9f7 Add SSH_OPTS to config ssh and scp port 2016-07-13 09:42:27 +08:00
Mike Danese c5b5e1f28e fix image staging to non gcr.io repos 2016-07-12 13:46:00 -07:00
Silas Boyd-Wickizer 35e190e6ae cluster/ubuntu/download-release.sh: if $KUBE_VERSION is set, use it.
If $KUBE_VERSION is not set, set it to the result of
`get_latest_version_number`.
2016-07-11 16:29:00 -07:00
Minhan Xia 0bd411878a bump cni version 2016-07-11 14:33:01 -07:00
Pawel Skrzynski 50751f73ab Unset KUBERNETES_PROVIDER when KUBERNETES_CONFORMANCE_TEST is set 2016-07-11 18:43:37 +02:00
Ivan Shvedunov f72f28869a Support custom Fedora repos in vagrant provider 2016-07-11 18:56:14 +03:00
Douglas Gibbons 2a589b0963 ConfigMap added to kube addon manager. 2016-07-11 13:54:18 +01:00
Justin Santa Barbara 4bde831fad kube-up: install libltdl7 when installing docker with dpkg
Docker now has a dependency on libltdl7; we have to specify it manually
if we are installing docker using dpkg (vs using apt-get or similar,
which would pull it in automatically)

Fixes #28644
2016-07-10 19:45:41 -04:00
k8s-merge-robot f83f21f399 Merge pull request #28623 from elsonrodriguez/openstack-release-tar-fix
Automatic merge from submit-queue

Fixes #28205, Check release tar location for Openstack-Heat provider

This does a basic check to see where the release tars are located.

Allows people to use openstack-heat outside of compiling k8s.
2016-07-08 13:32:14 -07:00
Cole Mickens 8b1bd66479 azure kube-up respects AZURE_RESOURCE_GROUP
This fixes #28482.

declare AZKUBE_ variables as global to workaround
lack of bash support for exporting array variables
2016-07-08 11:59:32 -07:00
Elson Rodriguez fbd0ba074e Fixes #28205, Check release tar location for Openstack-Heat provider
This does a basic check to see where the release tars are located.

Allows people to use openstack-heat outside of compiling k8s.
2016-07-08 08:45:47 -07:00
Christoph Held d659c16eb4 add default flannel configuration for cni 2016-07-08 11:36:17 +02:00
k8s-merge-robot 2296108886 Merge pull request #28549 from caseydavenport/cd-default-netpol
Automatic merge from submit-queue

Enable extensions/v1beta1/NetworkPolicy by default

Fixes https://github.com/kubernetes/kubernetes/issues/28401

For some reason this also triggered an update to the swagger spec (which apparently hadn't been done before but wasn't failing validation...)
2016-07-08 01:39:15 -07:00
k8s-merge-robot 9fb45943b5 Merge pull request #28467 from gmarek/addon-manager
Automatic merge from submit-queue

Fix the way addon-manager handles non-namespaced objects

Fixes #28451

cc @wojtek-t
2016-07-07 13:56:21 -07:00
allenmiller 727bd438de Remove unbalanced right-paren 2016-07-07 11:06:01 -07:00
Casey Davenport 097e186e84 Remove --runtime-config logic from kube-up 2016-07-07 10:04:46 -07:00
k8s-merge-robot acda24ae25 Merge pull request #27805 from janetkuo/change-redis-image-gcr
Automatic merge from submit-queue

Change redis image gcr

Follow up https://github.com/kubernetes/kubernetes/pull/27577#discussion_r67809871:
> Any chance we can move these images somewhere in gcr.io?

I pushed `kubernetes/redis:v1` to `gcr.io/google_containers/redis:v1`.  


[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()
2016-07-07 00:53:44 -07:00
Madhusudan.C.S 2e308035f0 Copy FEDERATIONS_DOMAIN_MAP to a local variable since the helper script doesn't allow overwriting the existing variable. 2016-07-06 15:53:45 -07:00
Janet Kuo 6a60f8e542 Moving kubernetes/redis:v1 image to gcr.io 2016-07-06 11:03:38 -07:00
k8s-merge-robot 203e1e9663 Merge pull request #26446 from mbruzek/juju-master-worker
Automatic merge from submit-queue

Implementing a proper master/worker split in the juju cluster code.

```
release-note-none
```

General updates to the cluster/juju Kubernetes provider, to bring it up to date.

Updating the skydns templates to version 11
Updating the etcd container definition to include arch.
Updating the master template to include arch and version for hyperkube container.
Adding dns_domain configuration options.
Adding storage layer options.

[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()
2016-07-05 18:50:40 -07:00
k8s-merge-robot 5e7c309b29 Merge pull request #25473 from andreykurilin/get_kube
Automatic merge from submit-queue

Check existence of kubernetes dir for get-kube.sh

[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

There are a lot of references to https://get.k8s.io/ over the internet.
Most of such references do not describe KUBERNETES_SKIP_DOWNLOAD env variable
and newbies can get into a situation described below:

- execute `wget -q -O - https://get.k8s.io | bash`
- receive a failure due too missed packages or some configs
- fix the issue
- try again `wget -q -O - https://get.k8s.io | bash`

In this case, get-kube.sh will not check that kubernetes directory already
exist and repeat download again.
Lets make get-kube.sh more user-friendly and check existence of kubernetes dir
2016-07-05 11:27:47 -07:00
Matt Bruzek b45002b2b2 Implementing a proper master/worker split in k8s.py
Updating the skydns templates to version 11
Updating the etcd container definition to include arch.
Updating the master template to include arch and version for hyperkube container.
Adding dns_domain configuration options.
Adding storage layer options.
Fixing underscore problem and adding exceptions.

Fixing the underscore flag errors.
2016-07-05 11:16:41 -05:00
gmarek 0c60cfc98d Fix the way addon-manager handles non-namespaced objects 2016-07-05 10:37:30 +02:00
Liyi Meng 0262c0dc72 Fix issue #28487
This is a minor fix for the issues report in #28487
2016-07-05 10:05:19 +02:00
Michael Vilensky bc30b49a1e Parameterize vpc name 2016-07-04 16:22:40 +03:00
k8s-merge-robot 85f75daf25 Merge pull request #28268 from cjcullen/expr
Automatic merge from submit-queue

Make GKE detect-instance-groups work on Mac.

Make the fix from #27803 also work on mac.

The GNU `expr` command supports both the `expr match STRING REGEXP` and `expr STRING : REGEXP` command syntax.

The BSD `expr` command only has the `expr STRING : REGEXP` syntax.

@fabioy @a-robinson
2016-07-01 21:41:11 -07:00
k8s-merge-robot c3e9485dfa Merge pull request #28247 from girishkalele/skydns_godep_up
Automatic merge from submit-queue

Bump skydns godeps to latest

Update Godeps for github.com/skynetservices/skydns and miekg/dns.

Bump kubedns version to 1.6 with latest skynetservices/skydns code
    
Built kube-dns for all architectures and pushed containers to gcr.io.
2016-06-30 11:19:46 -07:00
Girish Kalele 8614be3c71 Bump kubedns version to 1.6 with latest skynetservices/skydns code
Built kube-dns for all architectures and pushed containers to gcr.io
2016-06-30 10:45:00 -07:00
CJ Cullen 65ab7040a7 Make GKE detect-instance-groups work on Mac. 2016-06-29 22:49:26 -07:00
k8s-merge-robot f2ddd60eb9 Merge pull request #26755 from david-mcmahon/fix-headers
Automatic merge from submit-queue

Remove "All rights reserved" from all the headers.

cc @thockin @zmerlynn @brendanburns
2016-06-29 18:46:07 -07:00
David McMahon ef0c9f0c5b Remove "All rights reserved" from all the headers. 2016-06-29 17:47:36 -07:00
Zach Loafman 2d6c632de2 Revert "Revert "Merge pull request #28193 from zmerlynn/pull-ci-elsewhere""
Bring back #28193. We caught a break in
https://github.com/kubernetes/test-infra/issues/240 and discovered the
previous issue, fixed in
https://github.com/kubernetes/test-infra/pull/241 and
https://github.com/kubernetes/test-infra/pull/244, so I have a pretty
good handle on what was causing the previous bringup issues (and it
wasn't #28193). By the time this merges, we'll have good signal on GKE
in the `kubernetes-e2e-gke-updown` job.

This reverts commit ee1d480333.
2016-06-29 15:10:24 -07:00
k8s-merge-robot 9aff7d9e8b Merge pull request #27652 from girishkalele/kubedns_healthz
Automatic merge from submit-queue

Enhance kubedns pod health checks to cover kubedns container

The existing health check hits port 53, the dnsmasq container, with the same domain name every time. Since dnsmasq looks up and caches results from the kubedns container, running on port 10053, the health check is not covering the kubedns container after the first query (and once every TTL expiration).

This PR enhances the health check to directly hit port 10053 (kubedns) in addition to port 53.
2016-06-29 14:58:17 -07:00
k8s-merge-robot 3a6494e9ae Merge pull request #28132 from madhusudancs/fed-kubedns-flags-nodebootstrap
Automatic merge from submit-queue

Substitute federation_domain_map parameter with its value in node bootstrap scripts.

This PR also removes the substitution code we added to the build scripts.

**Release Note**

```release-note
If you use one of the kube-dns replication controller manifest in `cluster/saltbase/salt/kube-dns`, i.e. `cluster/saltbase/salt/kube-dns/{skydns-rc.yaml.base,skydns-rc.yaml.in}`, either substitute one of `__PILLAR__FEDERATIONS__DOMAIN__MAP__` or `{{ pillar['federations_domain_map'] }}` with the corresponding federation name to domain name value or remove them if you do not support cluster federation at this time. If you plan to substitute the parameter with its value, here is an example for `{{ pillar['federations_domain_map'] }`
pillar['federations_domain_map'] = "- --federations=myfederation=federation.test"
where `myfederation` is the name of the federation and `federation.test` is the domain name registered for the federation.
```

cc @erictune  @kubernetes/sig-cluster-federation @MikeSpreitzer @luxas 

[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()
2016-06-29 14:09:46 -07:00
k8s-merge-robot 594e4d883c Merge pull request #27468 from aledbf/remove-duplicated-nginx-image
Automatic merge from submit-queue

Remove duplicated nginx image. Use nginx-slim instead

This PR removes the image `gcr.io/google_containers/nginx:1.7.9` and uses `gcr.io/google_containers/nginx-slim:0.7`.
Besides removing the duplication `1.7.9` is 16 months old.
2016-06-29 12:43:38 -07:00
Zach Loafman ee1d480333 Revert "Merge pull request #28193 from zmerlynn/pull-ci-elsewhere"
This reverts commit d965b4719c, reversing
changes made to 08a28e5123.
2016-06-29 07:55:53 -07:00
k8s-merge-robot d4e6064b70 Merge pull request #28109 from jszczepkowski/influx-ps
Automatic merge from submit-queue

Influxdb migrated to PetSet and PersistentVolumes.

```release-note
Influxdb migrated to PetSet and PersistentVolumes.
```
[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

Influxdb migrated to PetSet and PersistentVolumes.
2016-06-29 05:02:15 -07:00
Marcin Wielgus d7eaad95c4 Merge pull request #28207 from mwielgus/ca-0.2.2
Bump cluster autoscaler to 0.2.2
2016-06-29 10:29:48 +02:00
Zach Loafman 92485326b1 Change references to gs://kubernetes-release/ci
Change over to gs://kubernetes-release-dev/ci. This should be all the
places we reference gs://kubernetes-release/ci or
https://storage.googleapis.com/kubernetes-release/ci. I'm happy to be
wrong.

Follow-on to #28172
2016-06-28 16:45:12 -07:00
k8s-merge-robot a0c4912648 Merge pull request #28131 from yujuhong/docker_debug
Automatic merge from submit-queue

Enable the docker debug mode in a e2e test cluster

This helps debugging a test cluster (e.g., #28124).
2016-06-28 16:33:30 -07:00
Manuel de Brito Fontes ec5cc59696 Remove duplicated nginx image. Use nginx-slim 2016-06-28 17:35:38 -04:00
Marcin Wielgus 4c822c300c Bump cluster autoscaler to 0.2.2 2016-06-28 22:08:44 +02:00
k8s-merge-robot 9f53b07b5b Merge pull request #27937 from PiotrProkop/fluentd-elasticsearch-fix
Automatic merge from submit-queue

Adding option to deploy fluentd-elasticsearch in different namespace.

Fixes #27608 .
2016-06-28 05:54:52 -07:00