Commit Graph

231 Commits (d6852c1d0f116fcfdb216b91ffcd938b31e82e2b)

Author SHA1 Message Date
David McMahon b24fc293e3 Merge pull request #21557 from luxas/fix_typo
Do not push images that don't exist
2016-02-19 11:56:21 -08:00
Mike Danese 132c4271dc add linux fastbuild option to ./build/release.sh 2016-02-19 10:18:05 -08:00
Lucas Käldström bfc9cfdb82 Do not push images that don't exist 2016-02-19 18:45:14 +02:00
k8s-merge-robot 4de373aafd Merge pull request #20714 from fgrzadkowski/push_gcr
Auto commit by PR queue bot
2016-02-18 23:31:13 -08:00
Phillip Wittrock 5fe856c749 Merge pull request #20882 from mikedanese/push-kube-cross
push kube-cross to gcr.io
2016-02-18 16:26:29 -08:00
Filip Grzadkowski 2c51e03759 Switch to k8s.production.user@gmail.com for pushing docker images during the release.
Fixes #19623
2016-02-18 20:15:02 +01:00
laushinka 7ef585be22 Spelling fixes inspired by github.com/client9/misspell 2016-02-18 06:58:05 +07:00
Mike Danese f3b9fa62d6 push kube-cross to gcr.io
And do as much of the build setup work in it as possible.
2016-02-16 10:05:46 -08:00
k8s-merge-robot 62258cab24 Merge pull request #21031 from zmerlynn/distribute-source
Auto commit by PR queue bot
2016-02-14 11:12:18 -08:00
Lucas Käldström b67445b064 Share the host's timezone with the build container 2016-02-11 07:44:05 +02:00
Zach Loafman b857f61009 Output tar of build image during release process
To meet licensing/compliance guidelines, bundle up the source. One of
the easiest ways to do this is just to grab the entire build image
directory - this makes it pretty much guaranteed that the user could
re-run the Docker build again from the exact code point if they wanted
to (they just need to poke at our scripts to figure out how).
2016-02-10 18:04:04 -08:00
k8s-merge-robot fc3316ee1b Merge pull request #20398 from mfanjie/mfanjie-patch-1
Auto commit by PR queue bot
2016-02-09 22:55:18 -08:00
Lucas Käldström c969c041e2 Add support for building arm, arm64 and ppc64le server and client targets 2016-02-07 20:35:14 +02:00
fmeng aaea05980c change sed_opts as array 2016-02-06 16:49:35 +08:00
Daniel Smith 75c1dcaacd Merge pull request #20463 from andyzheng0831/trusty-master
Support master on Ubuntu Trusty
2016-02-05 15:49:28 -08:00
fmeng ef42dad78e update proxy settings for kubernetes build. 2016-02-04 17:38:07 +08:00
Zach Loafman e87b93f1b8 KUBE_BUILD_GOLANG_VERSION=1.4.2 2016-02-03 11:46:03 -08:00
Andy Zheng b103f0f279 Support master on Ubuntu Trusty
This change support running kubernetes master on Ubuntu Trusty.
It uses pure cloud-config and shell scripts, and completely gets
rid of saltstack or the release salt tarball.
2016-02-03 11:22:28 -08:00
fmeng 368fb2225c fix sed error in build/common.sh 2016-01-29 10:45:50 +08:00
k8s-merge-robot a95f1b84cb Merge pull request #17243 from yifan-gu/gce_coreos
Auto commit by PR queue bot
2016-01-27 13:02:20 -08:00
Zach Loafman 07c304b43d build: Use Go version in cross image tag
The new tag format is cross-<go version>-<cross version>, starting
with cross-1.5.3-1.

Also bump the image we pre-pull / warn-on to 1.5.3

Fixes #19990
2016-01-22 11:45:41 -08:00
Yifan Gu 723402c4e9 build/common.sh: Copy manifests. 2016-01-21 16:32:15 -08:00
Alex Mohr e98fb3c424 Merge pull request #19810 from spiffxp/empty-docker-opts-cp
Support building on remote docker-machine instances
2016-01-21 14:30:57 -08:00
Alex Mohr ae56a2a1d5 Merge pull request #19555 from spiffxp/verify-prereqs-noargs
verify_prereqs doesn't special-case on 'clean' arg
2016-01-21 10:43:41 -08:00
Isaac Hollander McCreery 041f152e80 Add flag to force pull on docker build 2016-01-20 09:14:57 -08:00
Aaron Crickenberger d46a97224a Support building on remote docker-machine instances
Use case: I have a docker-machine instance in the cloud, and an empty
DOCKER_OPTS env var.  I want to `build/run.sh hack/build-go.sh`

Previously, this would invoke `docker '' cp` which was erroring out
with: '' not a command.
2016-01-18 17:44:23 -08:00
Mike Danese c446bf508e Merge pull request #19431 from spiffxp/docker-machine-rm-hardcode
Allow for use of docker-machine not named kube-dev
2016-01-14 13:46:10 -08:00
Aaron Crickenberger 4488f7d33c verify_prereqs doesn't special-case on 'clean' arg
update docs and invocation accordingly
2016-01-12 11:26:59 -08:00
k8s-merge-robot cc7acc0c58 Merge pull request #19061 from fgrzadkowski/release_docker
Auto commit by PR queue bot
2016-01-11 20:56:00 -08:00
k8s-merge-robot ce9b117a19 Merge pull request #16698 from mml/issue3885
Auto commit by PR queue bot
2016-01-09 13:38:41 -08:00
Aaron Crickenberger 5062197ec6 Allow for use of docker-machine not named kube-dev 2016-01-08 17:07:48 -08:00
Matt Liggett c6e9ad066e Initial node drain implementation for #3885.
It cordons (marks unschedulable) the given node, and then deletes every
pod on it, optionally using a grace period.  It will not delete pods
managed by neither a ReplicationController nor a DaemonSet without the
use of --force.

Also add cordon/uncordon, which just toggle node schedulability.
2016-01-06 17:28:18 -08:00
Andy Zheng d27e3ae8a1 Run kube-proxy in Trusty in a static pod.
We copy the manifest from salt configurations, and then remove the salt
content in the file and replace the variables with values.
2016-01-05 16:11:58 -08:00
Filip Grzadkowski e7e8c5af84 Push docker images for cluster components during release. 2016-01-05 12:36:10 +01:00
Mike Danese c00dfe82f8 Revert "Push server docker images during the release" 2015-12-22 19:59:56 -08:00
k8s-merge-robot 78b573e803 Merge pull request #18893 from fgrzadkowski/release_docker
Auto commit by PR queue bot
2015-12-22 16:54:18 -08:00
k8s-merge-robot 3f91f18a55 Merge pull request #18488 from yifan-gu/dockerized_python
Auto commit by PR queue bot
2015-12-19 10:52:15 -08:00
Yifan Gu 516032f336 kube-addons: Use python container if python is not found on the machine.
To build the python image, BUILD_PYTHON_IMAGE should be set during make.
When the addon script is running, it will check if python is installed
on the machine, if not, it will use the python image that built previously.
2015-12-18 15:14:56 -08:00
Filip Grzadkowski f6fce5cd43 Push docker images during the release. 2015-12-18 16:08:44 +01:00
Andy Zheng 75e23a3845 Add release support for trusty kube-system manifests.
This is a follow-up work for PR 18115. It adds release support for
kube-system manifests.
2015-12-10 10:47:01 -08:00
k8s-merge-robot ac65782e03 Merge pull request #17121 from mikedanese/kube-proxy-static
Auto commit by PR queue bot
2015-11-20 07:19:26 -08:00
k8s-merge-robot c8d2ec6ffd Merge pull request #16919 from ihmccreery/enable-prerelease-push-official-release
Auto commit by PR queue bot
2015-11-20 06:47:23 -08:00
Isaac Hollander McCreery 2fad9a1271 Use env variables instead of BASH_REMATCH for parse_and_validates 2015-11-19 09:51:51 -08:00
Isaac Hollander McCreery 58eaa33979 Enable push-official-version to deal with prereleases 2015-11-19 09:51:51 -08:00
Mike Danese 1d9d11c836 run kube-proxy in a static pod 2015-11-18 16:52:10 -08:00
Mike Danese ae05eed14a add a way to discover git version from a built release 2015-11-18 11:11:50 -08:00
k8s-merge-robot 840f3dad53 Merge pull request #16960 from andyzheng0831/trusty
Auto commit by PR queue bot
2015-11-17 01:21:15 -08:00
k8s-merge-robot b250006e65 Merge pull request #17194 from mikedanese/configure-baseimage
Auto commit by PR queue bot
2015-11-16 13:48:49 -08:00
Matt Moore b750d1dddc Drop the beta for GCR v2 images.
beta.gcr.io is no longer needed to pull through v2.
2015-11-14 12:19:02 -08:00
Andy Zheng 5ca070478e Refactor cluster/gce/trusty/node.yaml
The node.yaml has some logic that will be also used by the kubernetes
master on trusty work (issue #16702). This change moves the code
shared by the master and node configuration to a separate script, and
the master and node configuration can source it to use the code.
Moreover, this change stages the script for GKE use.
2015-11-13 16:46:55 -08:00
Mike Danese d68c36a268 all wrapped binaries to use a configurable image as the base image 2015-11-13 08:58:31 -08:00
Matt Liggett d9a178915a Make verify-generated-docs work inside docker.
Add a few missing files to the docker tarball.
2015-11-05 16:59:21 -08:00
Isaac Hollander McCreery eaefc11df9 Fix beta versioning for build/push_ci_build.sh 2015-11-04 13:24:17 -08:00
k8s-merge-robot a3f2ba2e34 Merge pull request #11694 from ncdc/add-spdy-proxy-support
Auto commit by PR queue bot
2015-10-15 06:56:15 -07:00
Steve Milner 57fc4bfa56 build: test/images in test tar and a static kubectl
* release tar now includes test/images/*
* kubectl is now built as a static binary in the test
2015-10-14 09:42:04 -04:00
Isaac Hollander McCreery 5ac539abd5 Implement branched/versioned ci publishing to GCS. 2015-10-13 14:35:58 -07:00
k8s-merge-robot 8580804f77 Merge pull request #15138 from mattmoor/limited-beta-rewrite
Auto commit by PR queue bot
2015-10-10 11:41:34 -07:00
Isaac Hollander McCreery ec43cb0ed0 Make latest.txt files non-cacheable 2015-10-08 11:29:18 -07:00
Matt Moore eeb4eeb17c Move pause and fluentd-elasticsearch to GCR v2.
This scopes down the initially ambitious PR:
https://github.com/kubernetes/kubernetes/pull/14960 to replace just
`pause` and `fluentd-elasticsearch` to come through `beta.gcr.io`.

The v2 versions have been pushed under new tags, `pause:2.0` and
`fluentd-elastisearch:1.12`.

NOTE: `beta.gcr.io` will still serve images using v1 until they are repushed with v2.  Pulls through `gcr.io` will still work after pushing through `beta.gcr.io`, but will be served over v1 (via compat logic).
2015-10-06 16:39:07 -07:00
Isaac Hollander McCreery 9e61f8d632 Use kube::release::gcs::publish_latest_official logic in mark-stable-release.sh and add quote fixups, fixes #14785; implement major- and minor-pinned version releases, fixes #14920 2015-10-06 09:17:48 -07:00
JanetKuo a7cd53bc7e Distribute kubectl bash completion file with kubernetes binaries 2015-09-10 14:25:39 -07:00
Kel Cecil 12647523d2 Fix docker-machine typo in daemon help 2015-08-28 13:33:57 -04:00
Kel Cecil 60905867f1 Refactor to use docker-machine or boot2docker 2015-08-26 17:33:02 -04:00
Andy Zheng 94896d1340 Stage trusty/node.yaml for GKE use 2015-08-24 11:04:57 -07:00
Muhammed Uluyol 3dc10a209b Use gcr.io for proxy image 2015-08-21 13:32:08 -07:00
Muhammed Uluyol 7129d477d3 Launch a cluster-local registry.
This registry can be accessed through proxies that run on each node
listening on port 5000. We send the proxy images to the nodes directly
to avoid requests that hit the network during cluster launch. For now,
we continue to pull the registry itself over the network, especially
given its large size (we should be able to dramatically shrink the
image). On GCE we create a PD and use that for storage, otherwise we
use an emptyDir. The registry is not enabled outside of GCE. All
communication is currently plain HTTP. In order to use SSL, we will
need to be able to request a certificate/key from the apiserver signed
by the apiserver's CA cert.
2015-08-20 18:44:05 -07:00
Jeff Grafton 67b10ac222 Handle errors properly in kube::gcs::release functions 2015-08-06 12:36:08 -07:00
Alex Mohr 8d11137ed6 Merge pull request #12177 from ixdy/retry-gsutil-upload
Retry uploading/publishing CI builds to work around gsutil bug
2015-08-03 21:26:53 -07:00
Jeff Grafton 1289165aeb Add environment variable to delete existing release on GCS 2015-08-03 17:01:50 -07:00
Stef Walter f06474d938 build: Fix docker image lookup for docker 1.6+
Some versions of docker display image listings like this:

docker.io/golang    1.4                 ebd45caf377c        2 weeks ago

The regular expression used to detect presence of images
needs to be updated. It's unfortunate that we're still
screen-scaping here, due to:

https://github.com/docker/docker/issues/8048
2015-07-27 09:58:15 +02:00
Mike Danese 337772a91f fix all tests 2015-07-14 21:51:30 -07:00
Zach Loafman d63860411a Add `build-official-release.sh`
This commit does 4 things:
* Adds a script which will: (a) clone from a git tag, make release,
and give you very detailed instructions as to what to do from that
point.
* Changes `push-official-release.sh` so we can't push "dirty"
releases anymore (which `build-official-release.sh` also double
checks at the end.)
* Fixes #9576 by ensuring a correct umask.
* Changes common.sh to gtar all the way through, to ensure that
bloody OS X tar never touches the release process, because I don't
want to have to understand two tar programs and how release
artifacts are created from both (c.f. #10615.)
2015-07-08 15:20:22 -07:00
Jeff Grafton 1b9219ab25 Revert "Add `build-official-release.sh`"
This reverts commit d64c818744.

The push-*.sh scripts were broken due to TAR not being defined.
2015-07-06 16:55:59 -07:00
Zach Loafman d64c818744 Add `build-official-release.sh`
This commit does 4 things:
* Adds a script which will: (a) clone from a git tag, make release,
and give you very detailed instructions as to what to do from that
point.
* Changes `push-official-release.sh` so we can't push "dirty"
releases anymore (which `build-official-release.sh` also double
checks at the end.)
* Fixes #9576 by ensuring a correct umask.
* Changes common.sh to gtar all the way through, to ensure that
bloody OS X tar never touches the release process, because I don't
want to have to understand two tar programs and how release
artifacts are created from both (c.f. #10615.)
2015-07-02 14:24:34 -07:00
Abhi Shah 3277925ece Revert "Remove raw binaries from distro that are already included in docker image" 2015-06-12 14:25:52 -07:00
Filip Grzadkowski 31fc217527 Remove raw binaries from distro that are already included in docker image 2015-06-12 17:01:12 +02:00
James DeFelice 91238f8b44 Make building contrib code optional 2015-06-10 20:30:10 +00:00
Zach Loafman 8f70779b1b Don't die if the "docker rmi" fails
Slightly neuters #8955, but we haven't had a build succeed in a while
for whatever reason. (I checked on Jenkins and the images in the build
log where deletion was attempted were actually deleted, so I think
this is primarily an exit code / API issue of some sort.)
2015-05-30 09:20:09 -07:00
Dawn Chen 21ade7a531 Remove useless master component images after saving image as tar file. 2015-05-28 14:38:39 -07:00
saadali 4569de7a46 Enable Google Cloud Monitoring and Google Cloud Logging instead of
Influxdb for Google Compute Engine deployments.
2015-05-06 15:23:40 -07:00
Daniel Smith fbe3ec7513 Merge pull request #7316 from ArtfulCoder/master_components_logs
logs for master components
2015-05-04 11:20:03 -07:00
Eric Paris 6b3a6e6b98 Make copyright ownership statement generic
Instead of saying "Google Inc." (which is not always correct) say "The
Kubernetes Authors", which is generic.
2015-05-01 17:49:56 -04:00
Zach Loafman d3dbaa0008 Build: Push .md5 and .sha1 files for every file we push to GCS
Also by pre-staging and pushing all at once, and by doing the ACL
modify in parallel, this shaves the push time down anyways, despite
the extra I/O.

Along the way: Updates to longer hashes ala #6615
2015-05-01 10:55:44 -07:00
Abhishek Shah 96439b5a52 logs for master components 2015-04-29 09:51:09 -07:00
Abhishek Shah 0f25014d5b use busybox as base image for kube-master docker images 2015-04-16 22:22:04 -07:00
Rohit Jnagal 8b4914dd0f Merge pull request #6472 from zmerlynn/fix_build_status
Add kube::util::wait-for-jobs to report status, unlike builtin wait
2015-04-06 13:39:58 -07:00
Zach Loafman 3b8bbb32bb Fix cluster up failures by cleaning docker build dirs (sigh) 2015-04-06 13:08:15 -07:00
Zach Loafman 2bc5dd559a Add kube::util::wait-for-jobs to report status, unlike builtin wait
** Sigh **

Fixes an additional complaint in #6463
2015-04-06 11:11:49 -07:00
Zach Loafman af34ef4c16 Remove "-f Dockerfile.blah" from make release
Rework the parallel docker build path to create separate docker build
directories for each binary, rather than just separate files,
eliminating the use of "-f Dockerfile.foo". (I think this also shaves
a little more time off, because it was previously sending the whole
dir each time to the docker daemon.)

Also some minor cleanup.

Fixes #6463
2015-04-06 09:43:30 -07:00
Jeff Grafton 274c607f6d Merge pull request #6425 from zmerlynn/less_chatty_push
Be less chatty when we're uploading to GCS
2015-04-03 15:43:41 -07:00
Zach Loafman 18a11c1cb7 Be less chatty when we're uploading to GCS 2015-04-03 14:54:52 -07:00
Zach Loafman 5b6c75f986 And re-tabify that (to make previous easier to review) 2015-04-02 18:40:27 -07:00
Zach Loafman e57171d2cc Parallelize Docker build as well 2015-04-02 18:39:40 -07:00
Zach Loafman 9a6e04dc1f Cleanup output of Docker builds, fix #6389 2015-04-02 18:18:24 -07:00
Zach Loafman 03c7182cac Also build entire tarball phases in parallel 2015-04-02 17:56:45 -07:00
Zach Loafman 04813f0dcd Revert "Revert "Parallelize architectures in both the building and packaging phases of `make release`""
This reverts commit 9f60dde320.
2015-04-02 17:56:44 -07:00
Abhishek Shah b1b779a8d5 docker image creation 2015-04-02 12:39:12 -07:00
Jeff Grafton 46e8c08fe8 Update kube::log::{error,status} to include timestamp.
Additionally, make the build scripts call these rather than calling
'echo' directly.
2015-03-25 16:02:48 -07:00
Zach Loafman 3458246c10 Publish a gs://kubernetes-release/release/latest.txt when we publish a build
Adds a kube::release::gcs::publish_latest_official that checks the
current contents of this file in GCS, verifies that we're pushing a
newer build, and updates it if so. (i.e. it handles the case of
pushing a 0.13.1 and then later pushing a 0.12.3.) This follows the
pattern of the ci/ build, which Jenkins just updates unconditionally.

I already updated the file for 0.13.1. After this we can update the
get-k8s script, so we don't have to keep updating it.
2015-03-17 13:53:05 -07:00
Zach Loafman 120dba474e Change GCE to use standalone Saltstack config:
Change provisioning to pass all variables to both master and node. Run
Salt in a masterless setup on all nodes ala
http://docs.saltstack.com/en/latest/topics/tutorials/quickstart.html,
which involves ensuring Salt daemon is NOT running after install. Kill
Salt master install. And fix push to actually work in this new flow.

As part of this, the GCE Salt config no longer has access to the Salt
mine, which is primarily obnoxious for two reasons: - The minions
can't use Salt to see the master: this is easily fixed by static
config. - The master can't see the list of all the minions: this is
fixed temporarily by static config in util.sh, but later, by other
means (see
https://github.com/GoogleCloudPlatform/kubernetes/issues/156, which
should eventually remove this direction).

As part of it, flatten all of cluster/gce/templates/* into
configure-vm.sh, using a single, separate piece of YAML to drive the
environment variables, rather than constantly rewriting the startup
script.
2015-03-10 09:04:29 -07:00