Commit Graph

273 Commits (41743ce87a73aee2ec41ac7890e78cf4c37790fa)

Author SHA1 Message Date
Justin Santa Barbara 41743ce87a AWS: Delete ASGs by following instances
We can't tag ASGs, but we can see what instances are running in an ASG,
and we can match those by our tags.

So look for our running instances, and look for the ASGs that created
them, and delete those.

This can be defeated (most notably if users change the ASG size to 0),
but it is safer that other deletion methods.
2015-11-03 11:58:05 -05:00
Justin Santa Barbara cf86ecc604 AWS: Only match minions in the current ASG
i.e. don't assume there is only one ASG any more
2015-11-03 11:58:05 -05:00
Justin Santa Barbara d64643fe26 AWS: Experimental support for multiple subnets/AZs in kube-up
By setting KUBE_SHARE_MASTER=true we reuse an existing master, rather
than creating a new one.

By setting KUBE_SUBNET_CIDR=172.20.1.0/24 you can specify the CIDR for a
new subnet, avoiding conflicts.

Both these options are documented only in kube-up and clearly marked as
'experimental' i.e. likely to change.

By combining these, you can kube-up a cluster normally, and then kube-up
a cluster in a different AZ, and the new nodes will attach to the same
master.

KUBE_SHARE_MASTER is also useful for addding a second node
auto-scaling-group, for example if you wanted to mix spot & on-demand
instances.
2015-11-03 11:57:59 -05:00
Justin Santa Barbara df3897c4ab Split main kube-up function into sub-functions
Makes it a little easier to read, also lets us reuse a master in the
next commit without a complex diff.
2015-11-03 10:16:32 -05:00
Justin Santa Barbara 1607ac1a7a AWS: use filters in get_igw_id & get_subnet_id
Also remove unused get_route_table_id
2015-11-03 10:09:51 -05:00
Jeff Lowdermilk de4f29f1f5 Load or generate auth from kubeconfig on kube-up
Allows loading existing auth from kubeconfig on kube-up if a
valid KUBE_CONTEXT is specified, instead of always force
regenerating auth (basic or token) when creating a new cluster.
2015-10-30 10:19:40 -07:00
Jan Safranek fe0741bffe Configure cluster for e2e tests.
When KUBE_E2E_STORAGE_TEST_ENVIRONMENT is set to 'true', kube-up.sh script
will:

- Install the right packages for all storage volumes.
- Use devicemapper as docker storage backend. 'aufs', the default one on
Debian, does not support extended attibutes required by Ceph RBD and Gluster
server containers.

Tested on GCE and Vagrant, e2e tests for storage volumes passes without any
additional configuration.
2015-10-29 11:03:34 +01:00
k8s-merge-robot f13ed3ff75 Merge pull request #16056 from paralin/fix-aws-reboot-failure
Auto commit by PR queue bot
2015-10-28 22:07:37 -07:00
Juan Valencia 8f5a2deada Fixed #16188 2015-10-27 09:17:28 -07:00
k8s-merge-robot 3298eff212 Merge pull request #15936 from justinsb/aws_enable_deployments
Auto commit by PR queue bot
2015-10-24 11:43:05 -07:00
k8s-merge-robot 74a1f7e86f Merge pull request #16131 from brendandburns/aws2
Auto commit by PR queue bot
2015-10-23 23:19:47 -07:00
Dawn Chen 038f871c43 Merge pull request #16071 from brendandburns/heapster
Make heapster config creation dynamic
2015-10-23 09:25:59 -07:00
Brendan Burns d32e713b77 Make AWS node sizes dynamic in the number of nodes. 2015-10-22 20:22:00 -07:00
Brendan Burns 90d9e6e935 Make heapster config creation dynamic 2015-10-22 12:05:49 -07:00
Justin Santa Barbara ff44cd113a AWS: Wire-up ENABLE_DEPLOYMENT env var
The AWS equivalent of a558fca24b
2015-10-21 21:57:38 -04:00
k8s-merge-robot 7f7f9e343e Merge pull request #15984 from mikedanese/aws-extensions
Auto commit by PR queue bot
2015-10-21 16:45:12 -07:00
Christian Stewart baa61c14da
cluster/aws: Fix #14162 reboot docker failure
Fixes AWS ubuntu deployment due to extra-$(uname) vs extra-virtual
package being installed. See issue #14162

Signed-off-by: Christian Stewart <christian@paral.in>
2015-10-21 17:43:21 -04:00
Mike Danese e9ff8e7f97 fix extensions enabling in aws kube-up 2015-10-20 15:59:30 -07:00
Piotr Szczesniak 57a5f8d5a5 Removed flag ENABLE_HORIZONTAL_POD_AUTOSCALER which is no longer used 2015-10-20 13:59:00 +02:00
Isaac Hollander McCreery a379e52c57 Factor find-release-tars into cluster/common 2015-10-16 13:09:52 -07:00
Justin Santa Barbara 33d0541a00 AWS: Add configuration for ENABLE_EXPERIMENTAL
We need this for some tests; not all the options are fully plumbed in,
but should enable experimental/v1alpha1, as needed for jobs tests.

In particular, ENABLE_NODE_AUTOSCALER is not yet actually implemented.
2015-10-08 10:15:10 -04:00
Abhi Shah aa9957e754 Merge pull request #15035 from ArtfulCoder/admissionChange
Removed DenyEscalatingExec from the list of default admission control…
2015-10-06 14:25:12 -07:00
Abhishek Shah a1b6dbe870 Removed DenyEscalatingExec from the list of default admission controllers. 2015-10-06 13:35:32 -07:00
Alex Robinson 1efee0b49e Merge pull request #8255 from iterion/default_dhcp_option_set
AWS: Create DHCP Option Set on kube-up
2015-10-05 16:29:48 -07:00
Alex Robinson 0b6bcab091 Merge pull request #15049 from Juniper/opencontrail-provisioning
Add opencontrail networking provisioning support in kubernetes via salt based provisioning
2015-10-05 14:40:11 -07:00
Adam Sunderland 1c77179652 Adding DHCP Option Setup
Fix Spacing
2015-10-05 14:13:40 -05:00
Alex Robinson 8b68089ac4 Merge pull request #15071 from justinsb/aws_include_distro_when_not_recognized
AWS: Log the distro when we don't recognize it
2015-10-05 11:19:38 -07:00
Justin Santa Barbara d898834037 AWS: Log the distro when we don't recognize it
Similar to #15070, we should log the distro if we're going to tell the
user we can't match it (so the user can see if they have typoed it, and
so it will hopefully be included to us in error reports)
2015-10-05 09:25:59 -04:00
Justin Santa Barbara f763c59743 AWS: Increase the timeout for S3 bucket creation
The current timeout of 5 seconds is needlessly short, given that we
fail kube-up if the (eventually consistent?) bucket creation takes
longer.

Raise it to 120 seconds.

Possibly related to issue #14278
2015-10-05 09:17:12 -04:00
Ananth Suryanarayana d50d7763da Add opencontrail networking provisioning support in kubernetes salt based provisioning
OpenContrail is an open-source based networking software which provides virtualization support for the cloud.

This change-set adds ability to install and provision opencontrail software for networking in kubernetes based cloud environment.

There are basically 3 components

o kube-network-manager -- plugin between contrail components and kubernets components
o provision_master.sh -- OpenContrail software installer and provisioner in master node
o provision_minion.sh -- OpenContrail software installer and provisioner in minion node(s)

These are driven via salt configuration files

One can provision opencontrail by just setting "export NETWORK_PROVIDER=opencontrail"
Optionally, OPENCONTRAIL_TAG, and OPENCONTRAIL_KUBERNETES_TAG can be used to
specify opencontrail and contrail-kubernetes software versions to install and provision.

Public-IP Subnet provided by contrail can be configured via OPENCONTRAIL_PUBLIC_SUBNET
environment variable

At this moment, plan is to add support for aws, gce and vagrant based platforms

For more information on contrail-kubernetes, please visit https://github.com/juniper/contrail-kubernetes For more information on opencontrail, please visit http://www.opencontrail.org
2015-10-03 08:03:02 -07:00
Brendan Burns 5545630641 Merge pull request #13185 from xsamurai/master
Changed SSH_USER to core instead ubuntu, also applied fixes from #11975
2015-09-30 11:29:46 -07:00
Brian Grant 1b8727ada1 Merge pull request #13072 from mikaelh/master
Elastic IP need to be assigned after the instance is in running state
2015-09-24 17:39:26 -07:00
Paul Weil ed80c2b940 pid mode 2015-09-15 13:51:44 -04:00
Justin Santa Barbara 9f4ec648b4 AWS: Create one storage pool for aufs, not two
We were splitting the aufs storage into docker & kubernetes areas, but
the kubernetes area was filling up very quickly because empty volumes
went on there, and I had originally not sized it big enough for that.

Instead, create one volume for both so they can share space freely.  We
can't do this for devicemapper, but that configuration seems to be
deprecated by Docker anyway.
2015-09-10 07:06:34 -07:00
derekwaynecarr 06bbe00642 Remove NamespaceExists from configuration 2015-09-03 13:42:09 -04:00
Yu-Ju Hong 781d40c4a3 Merge pull request #13029 from justinsb/aws_config_test_disk
AWS: Add disk size/type defaults to config-test
2015-08-26 09:53:45 -07:00
root 5f5d97b6e7 Changed SSH_USER to core instead ubuntu, also applied fixes from #11975 2015-08-26 01:29:56 -07:00
Justin Santa Barbara a13a0ac3e8 AWS: Add disk size/type defaults to config-test
Otherwise they needed to be manually specified (for example in the
Jenkins jobs)
2015-08-25 07:54:03 -04:00
Mikael Hammarin c82e645f9d Elastic IP need to be assigned after the instance is in running state. Currently always fails with "The pending instance x is not in a valid state for this operation" and defaults to public ip.
Fix: Moved assign-elastic-ip to run after wait-for-instance-running
2015-08-23 13:39:01 +02:00
Jeff Lowdermilk 438216844f Stop reusing basic auth on cluster create 2015-08-22 11:45:46 -07:00
Wojciech Tyczynski 04af904cbb Merge pull request #12909 from justinsb/fix_12855
AWS: Always install aufs module & tools
2015-08-20 08:26:47 +02:00
Justin Santa Barbara fba216c7b3 AWS: Always install aufs module & tools
Clean up the installation of aufs supporting modules & tools, so we
always install both and only install in one place.

Fixes #12855
2015-08-19 07:27:12 -04:00
erulabs 5ee816e905 Add config option for AWS EBS root volume size 2015-08-18 11:03:23 -07:00
Veres Lajos 9f77e49109 typofix - https://github.com/vlajos/misspell_fixer 2015-08-08 22:31:48 +01:00
Eric Paris 86ca88be61 convert cluster/ from --flag_name= --flag-name= 2015-08-07 11:00:13 -04:00
Justin Santa Barbara 230de787be AWS: Query for location of S3 bucket, use that
Previously we would rely on the s3 bucket's region being configured
correctly, at least for the existence check.  By querying for the bucket
region and then going direct to the correct region, we avoid errors and
we avoid potential eventual consistency problems.

May be related to issue: #12109
2015-08-01 14:09:23 -04:00
Piotr Szczesniak f48543aba5 Made enabling Kube UI configurable 2015-07-27 08:23:04 +02:00
Piotr Szczesniak 06b3406cef Added possibility to overwrite ENABLE_CLUSTER_DNS with env var
It's for autoscaling tests purposes and making the config consistent with
other flags like ENABLE_NODE_LOGGING
2015-07-23 10:25:06 +02:00
Justin Santa Barbara 355e922b5d AWS: Restore (erroneously) removed get_instance_private_ip
Fix #11201
2015-07-14 13:45:12 -04:00
Victor Marmol ee8d2857fc Merge pull request #9381 from justinsb/aws_support_jessie
AWS: Add support for Vivid Vervet & Debian Jessie
2015-07-09 15:20:37 -07:00