7760d079ae
Update SSH User For Master SSH Check
2015-06-12 15:38:48 -05:00
d82bfffe9d
Use RSA to Generate Fingerprint
2015-06-12 15:29:37 -05:00
82aa8f9984
Merge pull request #9371 from justinsb/aws_support_wheezy
...
AWS: Support wheezy, for parity with GCE
2015-06-11 15:08:32 -07:00
064e7146e1
Merge pull request #9481 from justinsb/aws_fix_push
...
AWS: Include (idempotent) ensure-temp-dir in upload-server-tars
2015-06-11 11:24:18 -07:00
8aae864784
AWS: Support wheezy, for parity with GCE
2015-06-09 23:45:41 -04:00
e19e4bcd12
Merge pull request #9365 from justinsb/fix_9246
...
AWS: Only log "Starting cluster using os distro..." in kube-up
2015-06-09 09:51:22 -07:00
d92863523f
AWS: Include (idempotent) ensure-temp-dir in upload-server-tars
...
This way we won't forget it. Fixes kube-push, where I forgot it.
2015-06-09 11:10:15 -04:00
e14d9038fe
Merge pull request #9367 from justinsb/aws_ssh_check
...
AWS: Check for SSH connectivity & better logging on failure
2015-06-08 16:48:04 -07:00
1c229e5284
Removed extra blank line in aws util.sh
2015-06-08 16:59:03 -04:00
2619b6198a
AWS: Mount ephemeral devices, even if not specified in the AMI
...
We mount up to 4; this covers almost all instance types.
2015-06-08 16:59:03 -04:00
72496e7368
AWS: Check for SSH connectivity & better logging on failure
2015-06-06 14:27:41 -04:00
a9e1e1033b
AWS: Only log "Starting cluster using os distro..." in kube-up
...
Fixes #9246
2015-06-06 12:48:49 -04:00
112a013567
AWS: Support different docker storage mechanism by setting DOCKER_STORAGE
...
For parity with GCE, we really want to support aufs.
But we previously supported btrfs, so we want to expose that.
Most of the work here is required for aufs, and we let advanced users choose
devicemapper/btrfs if they have a setup that works for those configurations.
2015-06-06 12:13:51 -04:00
48e8a8b0ec
AWS: Set up security groups, to mirror GCE firewalling
...
Some slightly fussy code to enable load-balancers to talk to
instances, but otherwise relatively simple.
2015-06-05 16:10:08 -04:00
33a3d884f2
AWS: Filter by Cluster tag, rationalize EC2 abstraction
...
Whenever we do a list we now filter on tags so we only see resources relating
to our cluster.
Also, rationalize all the DescribeX calls:
* They all take a request object (so that we can pass filters)
* They do paging if that is required (and return the underlying resources)
* They wrap any error with a "error while listing X: %v" message
2015-06-05 16:09:01 -04:00
710df2b619
Merge pull request #9294 from justinsb/aws_ssh_key_fingerprint
...
AWS: Support multiple SSH keys (embed the hash in the name)
2015-06-05 09:37:31 -07:00
d8dc416b5b
AWS: Support multiple SSH keys (embed the hash in the name)
...
This should eliminate a nasty problem where the script doesn't cope well if
your keys don't match.
2015-06-04 21:40:57 -04:00
c92c63b3a9
AWS: Use s3 sync to optimize upload to s3 when nothing changed
2015-06-04 10:14:45 -04:00
3c067b766a
Merge pull request #8996 from manolitto/aws_cluster_monitoring_fix
...
aws: fix cluster monitoring (new option "influxdb" instead of "true")
2015-06-01 13:43:43 -07:00
5b3e01d2fd
Merge pull request #8653 from matschaffer/s3-creation-wait
...
Check that s3 bucket has been created
2015-06-01 10:29:03 -07:00
8c8f8feb62
aws: fix cluster monitoring ("none" instead of "false")
2015-06-01 09:12:41 +02:00
ac3cc3c518
Rename PORTAL_NET all over
2015-05-28 16:10:44 -07:00
e7ae425385
Colorize errors for consistency with other checks
2015-05-23 16:12:24 +09:00
26736e494c
Check that s3 bucket has been created
...
Fixes #8395
2015-05-22 14:12:36 +09:00
04c4d25065
Merge pull request #7905 from bakins/aws-coreos
...
AWS: use CoreOS for nodes
2015-05-21 09:05:56 -07:00
ce4b54ec70
Merge pull request #8209 from krousey/v1beta1_cluster
...
Removing some v1beta1 uses in cluster/
2015-05-15 14:56:41 -07:00
98c457c397
Updating /cluster to use v1beta 3 specs, and change a lot of polling to
...
healthz instead of api endpoints.
2015-05-15 14:17:55 -07:00
9d6c032929
Merge pull request #7888 from madis/associate_aws_elastic_ip_with_master
...
Associate master instance with AWS Elastic IP
2015-05-14 13:18:19 -07:00
15643a2c72
Add 'auto' option for MASTER_RESERVED_IP. No ElasticIP allocation by default.
...
Default behaviour when setting up a cluster is using the Amazon-assigned public ip.
It will change between reboots. If MASTER_RESERVED_IP is set to 'auto', new Elastic
IP will be allocated & assigned to master. If MASTER_RESERVED_IP is set to an existing
Elastic IP, it will be used. When something fails, original Amazon-given IP will be used.
2015-05-14 08:33:07 +03:00
fac4350fa6
Initial addition of CoreOS as minion for AWS cluster
2015-05-13 16:39:22 -04:00
eb220f05a6
Properly get return value (considering errexit). Quote variables.
2015-05-13 10:45:51 +03:00
d4d02a9028
Optionally associate master instance with AWS Elastic IP
...
When MASTER_RESERVED_IP is set to elastic IP from AWS, then aws/util.sh will
associate it with master instance and assign it to KUBE_MASTER_IP. If no MASTER_RESERVED_IP
is set, new elastic ip will be requested from amazon. This allows cluster certificates to
be generated for an IP that doesn't change between stopping & starting cluster instances.
The requested elastic ip is not released when kube-down.sh is run. I think it is good
because user could have created DNS records and it would be bad if the IP was removed.
He can reuse it next time through MASTER_RESERVED_IP when setting up cluster again.
2015-05-13 10:45:51 +03:00
ffb0e7f9b8
Install specific salt version on AWS, based on GCE
...
The latest salt version breaks the container_bridge.py _state function
We can lock to the same version as GCE. This is not a full fix,
because we can't update to the latest salt without breaking GCE,
but this at least unbreaks and sync AWS with GCE.
This isn't a straight copy from GCE, because we still use
the salt master on AWS (for now)
Fixes #8114
2015-05-12 16:33:56 -04:00
c5c62f7d57
fixed second missing $ and added curly brackets
2015-05-08 17:18:52 +02:00
1119340260
fixed missing $
2015-05-08 16:58:49 +02:00
205ed2bf6e
AWS: make it possible to disable minion public ip association
2015-05-08 00:09:47 +02:00
57f7b658bb
AWS: Change apiserver to listen on 443 directly, not through nginx
...
Mirrors changes in GCE. I think the same changes will be needed for vagrant.
2015-05-02 16:59:04 -04:00
6b3a6e6b98
Make copyright ownership statement generic
...
Instead of saying "Google Inc." (which is not always correct) say "The
Kubernetes Authors", which is generic.
2015-05-01 17:49:56 -04:00
637cd57a25
Merge pull request #6606 from gust1n/aws-existing-vpc
...
AWS: Improving getting existing VPC and subnet
2015-04-27 11:11:25 -07:00
645d6d1f26
Use existing subnet when launching AWS cluster in existing VPC
2015-04-23 11:01:17 +02:00
9253ae6dca
AWS: Fix some bash style problems: variable quoting & locals
2015-04-22 18:30:09 -07:00
45b658ea7c
AWS: don't try to create undefined config_dir
2015-04-20 19:14:16 -07:00
3787fc5eca
set KUBECONFIG in common.sh, default to new location
...
and preserve value in ginkgo e2e test driver
2015-04-20 11:07:35 -07:00
4f6dc99075
Generate kubeconfig for all providers in cluster/ that use auth
2015-04-20 11:07:35 -07:00
034412aff1
Support multiple k8s clusters
2015-04-10 13:25:43 -07:00
609208b8b5
update scripts with correct templates
2015-04-07 08:07:24 -04:00
2fb573c482
Create instances in the specified AZ
2015-04-03 08:04:53 -07:00
fc8ba8d77b
Merge pull request #6011 from justinsb/aws_specify_zone
...
Fix AWS region vs zone
2015-03-31 12:26:05 -07:00
edbebd653c
Fix S3 location handling for US classic
2015-03-31 05:42:10 -07:00
194143e61b
Use the correct region for the S3 bucket
...
We may not have created the bucket!
2015-03-27 12:58:47 -07:00
7179f5f004
Change AWS_ZONE to ZONE, for compatibility with e2e tests
2015-03-27 08:53:45 -07:00
583892da2d
Fix AWS region vs zone
...
We were specifying a region, but naming it as a zone in util.sh
The zone matters just as much as the region, e.g. for EBS volumes.
We also change the config to require a Zone, not a Region.
But we fallback to get the information from the metadata service.
2015-03-26 15:11:05 -07:00
e5914915b8
Merge pull request #6003 from justinsb/aws_wait_for_instance
...
Wait for master to be started on AWS
2015-03-26 14:06:25 -07:00
f256d3b77a
Wait for ELBs to be deleted
2015-03-26 13:50:35 -07:00
53bdbec64e
Launch minions in parallel
2015-03-26 10:58:18 -07:00
9556318c58
Wait for master instance running before adding route
2015-03-26 10:23:25 -07:00
f3ebe30605
Merge pull request #5940 from justinsb/fix_bash_style
...
Fix bash style issues in AWS script
2015-03-25 14:40:42 -07:00
06704bb94f
Security group should be scoped to our vpc
...
Note that security group names only need to be unique with a VPC as well,
which is handy here.
2015-03-25 12:53:12 -07:00
ac12665f48
Quote AWS_SSH_KEY
2015-03-25 12:41:02 -07:00
80ba56a371
Fix variable dollar-char errors
2015-03-25 12:36:52 -07:00
505488269c
Use double-square brackets in if tests
2015-03-25 12:36:20 -07:00
c22d4c6b3f
Merge pull request #5916 from justinsb/aws_cleanup_loadbalancers
...
Remove load balancers as part of kube-down.sh
2015-03-25 10:32:14 -07:00
68935e0798
Remove load balancers as part of kube-down.sh
2015-03-25 05:36:47 -07:00
cf72cf098a
Disable validation on AWS where it doesn't work.
...
Also add an advanced route for the master which I forgot previously.
2015-03-24 21:08:04 -07:00
8bac135f85
Configure docker and kubelet on AWS master.
2015-03-24 17:19:06 -07:00
b152d8e884
Merge pull request #5822 from justinsb/aws_idempotent_kube_down
...
More idempotent kube-down for AWS, and delete multiple security groups
2015-03-24 07:58:03 -07:00
b01f1f9baf
Merge pull request #5683 from justinsb/aws_ephemeral_disks
...
Format ephemeral disks with btrfs, put Docker storage on there
2015-03-24 07:36:01 -07:00
2a042fc423
More idempotent kube-down for AWS, and delete multiple security groups
...
There may be multiple security groups if we were using ELB, and
we have to delete them all apart from the default one, which EC2
prevents us from deleting.
Also use the same looping logic to clean up from partial up/downs.
2015-03-23 13:00:34 -07:00
407d1fec45
Both @satnam6502 and E2E tests confirm: This code is no longer needed
...
Deletion is wonderful. The only weird thing was where to put the
message about the proxy URLs. Satnam suggested kubectl clusterinfo,
which seemed like a good option to put at the end of cluster turn-up.
2015-03-19 22:23:11 -07:00
6fec242f89
Format ephemeral disks with btrfs, put Docker storage on there
...
Docker's default storage has severe bugs with older (stable) kernels.
Use btrfs to bypass those issues.
2015-03-19 19:23:29 -04:00
2537665ecc
Merge pull request #5381 from justinsb/aws_s3_in_us_east
...
Create S3 bucket in known region (default to us-east-1)
2015-03-18 09:34:59 -07:00
8b535ff17a
Fix copy-and-paste error in log message
2015-03-16 14:30:24 -07:00
9361b76977
Configure separate IAM roles for master & minion, create roles automatically
2015-03-16 10:37:25 -07:00
2413d25d29
Create S3 bucket in us-east-1, unless set by AWS_S3_REGION
...
Buckets are globally named, so we want a single bucket for all our regions.
2015-03-16 08:37:06 -07:00
e3e6c8377f
Allow the S3 bucket name to be specified via AWS_S3_BUCKET
2015-03-13 16:44:26 -04:00
55ed70f723
Merge pull request #5382 from justinsb/aws_image_by_region
...
Choose AWS image by region
2015-03-12 10:31:00 -07:00
9344934637
Merge pull request #5377 from justinsb/aws_s3_not_world_readable
...
Don't make the s3 bucket world-readable (just the files)
2015-03-12 09:52:38 -07:00
70b448b5d0
Choose AWS image by region
...
Also update to the latest LTS image (fewer security updates needed)
2015-03-12 12:05:45 -04:00
0330cf616a
Don't make the s3 bucket world-readable (just the files)
2015-03-12 11:52:56 -04:00
c43e8b192f
Don't print a full-stop after the conf filename, it make copy&paste hard
2015-03-12 11:07:44 -04:00
663bdb91c9
Remove monitoring firewall setup methods. Heapster anf Grafana are now accessible via the API server proxy.
2015-03-11 23:20:45 +00:00
20853410bd
Unify azure and aws admission control
2015-03-11 11:06:00 -04:00
83c3c53ff6
Merge pull request #5014 from justinsb/aws_cluster_push
...
Copy download-or-bust helper from gce to aws
2015-03-04 16:26:01 -08:00
05d4aea3bf
Copy download-or-bust helper from gce to aws
...
During a push, we were wget-ing to <filename>.1, .2, etc, which wasn't working
2015-03-04 16:30:11 -05:00
12e785c3b8
Implement restart-apiserver for AWS, fix comment
2015-03-04 15:35:29 -05:00
8fd315e324
Merge pull request #4988 from justinsb/sync_aws_with_gce
...
Use new config file & sync with GCE script
2015-03-03 11:41:48 -08:00
e1ad29e071
Merge pull request #4987 from justinsb/aws_ssh
...
Make public-ip detection more robust for AWS, enable SSH function
2015-03-03 11:41:05 -08:00
6508ca78a5
Use new config file & sync with GCE script
2015-03-03 12:24:56 -05:00
6b067b3c85
Make public-ip detection more robust for AWS, enable SSH function
2015-03-03 12:21:44 -05:00
94a433157e
Use internal ip for connecting to salt master, with clearer env var
2015-03-03 12:18:12 -05:00
19b927ea57
Name a cluster and use it to make forwarding rules for GCE
2015-02-23 17:04:33 -08:00
cf470f7da4
Fixes to get AWS tests to run
...
They don't pass (yet), but they at least run!
2015-02-11 15:58:33 -05:00
d8791acdba
Pause between launching master and minions
...
Salt does not retry if master is not ready, apparently
2015-01-29 21:08:27 -05:00
8058632f5f
Move tag creation & retry logic to a function
2015-01-29 20:35:36 -05:00
a305269e18
Deferred creation of SkyDNS, monitoring and logging objects
...
This implements phase 1 of the proposal in #3579 , moving the creation
of the pods, RCs, and services to the master after the apiserver is
available.
This is such a wide commit because our existing initial config story
is special:
* Add kube-addons service and associated salt configuration:
** We configure /etc/kubernetes/addons to be a directory of objects
that are appropriately configured for the current cluster.
** "/etc/init.d/kube-addons start" slurps up everything in that dir.
(Most of the difficult is the business logic in salt around getting
that directory built at all.)
** We cheat and overlay cluster/addons into saltbase/salt/kube-addons
as config files for the kube-addons meta-service.
* Change .yaml.in files to salt templates
* Rename {setup,teardown}-{monitoring,logging} to
{setup,teardown}-{monitoring,logging}-firewall to properly reflect
their real purpose now (the purpose of these functions is now ONLY to
bring up the firewall rules, and possibly to relay the IP to the user).
* Rework GCE {setup,teardown}-{monitoring,logging}-firewall: Both
functions were improperly configuring global rules, yet used
lifecycles tied to the cluster. Use $NODE_INSTANCE_PREFIX with the
rule. The logging rule needed a $NETWORK specifier. The monitoring
rule tried gcloud describe first, but given the instancing, this feels
like a waste of time now.
* Plumb ENABLE_CLUSTER_MONITORING, ENABLE_CLUSTER_LOGGING,
ELASTICSEARCH_LOGGING_REPLICAS and DNS_REPLICAS down to the master,
since these are needed there now.
(Desperately want just a yaml or json file we can share between
providers that has all this crap. Maybe #3525 is an answer?)
Huge caveats: I've gone pretty firm testing on GCE, including
twiddling the env variables and making sure the objects I expect to
come up, come up. I've tested that it doesn't break GKE bringup
somehow. But I haven't had a chance to test the other providers.
2015-01-21 12:25:50 -08:00
295bd3768d
Launch Elasticsearch and Kibana automatically
2015-01-09 13:41:46 -08:00
59164ca844
Make DNS an option for cluster turnup
2014-12-29 09:18:12 -08:00
d8efaab679
Merge pull request #3068 from brendandburns/dutchcoders-master
...
Fix up AWS support...
2014-12-19 15:14:26 -08:00
2369f0d50d
Update aws.
2014-12-19 14:16:57 -08:00
824122f410
Merge pull request #2651 from justinsb/specify_zone_to_ec2
...
Specify AWS_DEFAULT_REGION to match configured region
2014-12-19 12:26:40 -08:00
bd712b61e6
Merge branch 'master' of https://github.com/dutchcoders/kubernetes into dutchcoders-master
...
Conflicts:
cluster/aws/config-default.sh
cluster/saltbase/salt/kube-controller-manager/default
2014-12-19 11:45:46 -08:00
5b33534dcf
Merge pull request #2652 from justinsb/default_vpc_has_no_tags
...
Don't assume every AWS VPC has tags
2014-12-08 15:53:47 -08:00
0b05068f40
Default ENABLE_CLUSTER_MONITORING to false
...
Otherwise kube-down fails because the variable is not defined
2014-11-27 18:07:51 -08:00
a549468853
Specify AWS_DEFAULT_REGION to match configured region
...
The AWS CLI is configured with a default region, but it might not match
the configured Kubernetes region. Specify the region to be sure.
2014-11-27 17:56:14 -08:00
f9a9c75697
Don't assume every AWS VPC has tags
...
The default VPC has no tags (by default), so we should use get()
2014-11-27 17:32:38 -08:00
1265db9686
fix(aws): fix with non us standard region
2014-11-26 16:18:57 +01:00
6d79fab0c2
enhancement(aws): added logging variable and more verbose output
2014-11-26 16:18:26 +01:00
cbaa48bbc2
enhancement(aws): using iam role to pass aws credentials
2014-11-26 16:16:57 +01:00
2118c31bdb
enhancement(aws): checks for existing kubernetes vpc first
...
without this check, kube-up creates a new vpc every time. Now it will
reuse the vpc tagged Kubernetes.
2014-11-26 12:17:14 +01:00
72bd5311bf
fix(aws): error with other instances without tags
...
while starting the cluster, and having already other non-kubernetes
instances active without tags, an KeyError throwed.
2014-11-26 12:15:51 +01:00
47141f05c7
standard config opt names: logging
2014-11-25 17:41:53 -08:00
52ad94d766
standard config opt names: node monitoring
2014-11-25 17:39:28 -08:00
fad806d1d1
standard config opt names: cluster monitoring
2014-11-25 17:38:30 -08:00
ee2f030623
Give the API server access to TLS certs.
...
Moved the cert generation to a separate salt state and put it in a more appropriate sharable location (`/srv/kubernetes/`).
2014-11-12 18:14:24 -08:00
945339362f
Strip extra '-' from md5sum output when creating S3 bucket
...
md5sum prints out the hash, followed by the filename. When piped in from
stdin, this equates to a '-' character.
cluster/aws/util.sh was incorrect including this '-' character as part
of the S3 bucket name, causing the script to fail on Linux machines with
the md5sum binary.
i.e. "s3://kubernetes-staging-0ac68d8c77915cc1069a9e2f5e1f1d2d -"
Fixed by using `awk` to return only the first column (up to the space)
2014-11-12 16:56:50 +10:00
48498cf9bb
Fix docs somewhat, add monitoring hooks.
2014-11-10 17:17:25 -08:00
62bd634c07
Update the AWS config.
2014-11-10 13:33:43 -08:00
1ff79fdeb0
AWS support draft
...
Fix calling function before declaration
Set Name tags on instances
Hide import-key-pair error
Fix instances names resolution
Implement kube-down for AWS provider
Add cluster validation routines. Make changes according to #1255
Implement post-deployment cluster validation
Set proper master name in userdata scripts
Fix kube-down path in hint
Add getting started for AWS
2014-11-10 13:32:52 -08:00
Adam Sunderland