Commit Graph

380 Commits (87b0783808bde7513847d812d3d2c194f80afe26)

Author SHA1 Message Date
Satnam Singh c84fd94b11 Update Elasticsearch cluster level service to add version label 2015-05-18 14:43:58 -07:00
Victor Marmol 397b7d1bf2 Merge pull request #8427 from vishh/heapster_v0.12.1
Updating heapster to v0.12.1.
2015-05-18 14:01:20 -07:00
Vishnu Kannan 63a5e3895c Updating heapster to v0.12.1. This adds support for tokens and improves scalability
in large clusters.
2015-05-18 12:04:46 -07:00
Paul Weil e565b20b37 fix gendocs 2015-05-18 13:32:55 -04:00
Victor Marmol d064e843ab Merge pull request #8287 from vishh/kube2sky
Adding unit tests for existing kube2sky logic
2015-05-18 08:40:19 -07:00
Victor Marmol 4ba22e713a Merge pull request #8296 from jlowdermilk/gen-analytics
Add ga-beacon analytics to gendocs scripts
2015-05-18 08:40:02 -07:00
Victor Marmol d0e7040b94 Merge pull request #8367 from thockin/kube2sky
Add docs on making a release
2015-05-18 08:37:28 -07:00
Vishnu Kannan 684122f2a7 Adding unit tests for existing kube2sky logic. 2015-05-17 19:13:50 -07:00
Jeff Lowdermilk 553f9f822b Add ga-beacon analytics to gendocs scripts
hack/run-gendocs.sh puts ga-beacon analytics link into all md files,
hack/verify-gendocs.sh verifies presence of link.
2015-05-15 18:56:38 -07:00
Tim Hockin 284f87040c Add docs on making a release 2015-05-15 17:51:01 -07:00
Vishnu Kannan 50522a207b Revert kube2sky to use kubernetes-ro service until the dns-token is updated
to not use dns names.
2015-05-15 16:44:20 -07:00
Daniel Smith ce4b54ec70 Merge pull request #8209 from krousey/v1beta1_cluster
Removing some v1beta1 uses in cluster/
2015-05-15 14:56:41 -07:00
Kris Rousey 98c457c397 Updating /cluster to use v1beta 3 specs, and change a lot of polling to
healthz instead of api endpoints.
2015-05-15 14:17:55 -07:00
Tim Hockin 850e0e682e Base the kube2sky container on busybox 2015-05-15 08:49:52 -07:00
Satnam Singh e8f55e81e5 Add a TAG Makefile variable for the kube2sky image 2015-05-14 10:57:45 -07:00
Tim Hockin 1b1010621f Fix spurious quote in DNS healthcheck 2015-05-14 09:39:02 -07:00
Vish Kannan f49757cba5 Merge pull request #8221 from ArtfulCoder/use_https
Use https to access apiserver from kube2sky
2015-05-13 17:21:41 -07:00
Abhishek Shah 71a10c2044 Use https 2015-05-13 17:03:29 -07:00
Vish Kannan 5b8e70181f Merge pull request #8199 from satnam6502/es
Revert to using emptyDir for Elasticsearch data
2015-05-13 14:47:03 -07:00
Satnam Singh ca121ee98d Revert to using emptyDir for Elasticsearch data 2015-05-13 12:52:56 -07:00
Tim Hockin ab30484a4f Fix DNS health check 2015-05-13 08:51:06 -07:00
Nikhil Jindal c2fecff3d5 Merge pull request #8067 from piosz/kubectl
Added label kubernetes.io/name to cluster services
2015-05-12 17:09:22 -07:00
Satnam Singh 7cff506c93 Make the Elasticsearch logging pods discover each other 2015-05-12 15:26:09 -07:00
Tim Hockin e83e49b076 rename default DNS domain to cluster.local 2015-05-11 23:00:43 -07:00
Daniel Smith caddcd8cd3 Merge pull request #7901 from vishh/kube2sky
Updated kube2sky to use the controller framework.
2015-05-11 13:49:20 -07:00
Alex Robinson 8bec62e42c Merge pull request #7995 from satnam6502/es-logging
Upgrade to Kibana 4 for cluster logging
2015-05-11 10:40:41 -07:00
Piotr Szczesniak 12e44ff8a9 Added label kubernetes.io/name to cluster services
The label specifies service name which is displayed in kubectl cluster-info
2015-05-11 19:35:53 +02:00
Piotr Szczesniak 02aa97d695 Added name to kube-dns service
Fixes #7922
2015-05-11 12:42:22 +02:00
Satnam Singh fcbe2229df Kibana by itself
Upgrade to Kibana 4 for cluster logging
2015-05-08 14:55:52 -07:00
Vishnu Kannan e521b3f1af Updated kube2sky to use the controller framework.
Refactored the code a bit to make it easy for future enhancements and
unit testing.
Tested the change manually on a kube node with and without kubeConfig based tokens.
2015-05-07 14:40:44 -07:00
Tim Hockin ec8ba4a62f Expose 53/TCP on DNS service 2015-05-07 00:40:39 -07:00
Tim Hockin 9eb1fb85bd Convert DNS service to v1beta3 2015-05-07 00:40:35 -07:00
Tim Hockin 58a18447fa Expose 53/TCP in DNS pod (not service yet) 2015-05-07 00:40:31 -07:00
Tim Hockin dfe81b7974 Cleanups in DNS pod YAML. 2015-05-07 00:40:23 -07:00
saadali 4569de7a46 Enable Google Cloud Monitoring and Google Cloud Logging instead of
Influxdb for Google Compute Engine deployments.
2015-05-06 15:23:40 -07:00
António Meireles 24a0e5618a skydns: use the etcd-2.x native syntax, enable IANA attributed ports.
per https://github.com/coreos/etcd/blob/master/Documentation/backward_compatibility.md
(there are no functional changes, we just stop using the legacy flags, for
consistency.)

Signed-off-by: António Meireles <antonio.meireles@reformi.st>
2015-05-06 10:07:34 +01:00
Alex Robinson 9ea76dc004 Add a liveness probe to the DNS container. 2015-05-05 17:41:08 +00:00
Alex Robinson 07adb84c23 Update the DNS replication controller to be v1beta3. 2015-05-05 17:41:08 +00:00
CJ Cullen 1ec0fb2e3d Make changes suggested in #7675 2015-05-04 21:58:13 -07:00
CJ Cullen a21713a771 Fix kube2sky flakes. Fix tools.GetEtcdVersion to work with etcd > 2.0.7 2015-05-04 13:01:35 -07:00
Eric Paris 6b3a6e6b98 Make copyright ownership statement generic
Instead of saying "Google Inc." (which is not always correct) say "The
Kubernetes Authors", which is generic.
2015-05-01 17:49:56 -04:00
Ido Shamun e86316bc4d revert back INFLUXDB_EXTERNAL_URL to api v1beta1 2015-05-01 21:13:04 +03:00
Ido Shamun 37040fb0e3 bump heapster to v0.11.0 and grafana to v0.7.0 2015-05-01 19:42:30 +03:00
Alex Robinson 8d24f73bab Merge pull request #7579 from satnam6502/fluentd-es-image
Improve comment in Fluentd to ES logging config file
2015-04-30 13:45:03 -07:00
Satnam Singh 95007d7217 Improve comment in Fluentd to ES logging config file 2015-04-30 13:42:30 -07:00
Satnam Singh 941a457851 Trim Fleuntd tag for Cloud Logging 2015-04-30 13:39:35 -07:00
Alex Robinson 58ede77a58 Merge pull request #7539 from satnam6502/master
Trim cluster log tags to pod name and container name
2015-04-30 10:29:41 -07:00
Satnam Singh e65f0aafd5 Trim cluster log tags to pod name and container name 2015-04-29 18:24:13 -07:00
CJ Cullen 44cffec157 Bump kube2sky to 1.2. Point it at https endpoint (3rd try). 2015-04-29 14:58:56 -07:00
Zach Loafman 89195b0a14 Merge pull request #7461 from cjcullen/dns
Revert kube2sky from 1.2 back to 1.1 until we figure out why it's flaky.
2015-04-28 17:23:55 -07:00
Satnam Singh dc31c58443 Upgrade Elasticsearch to 1.5.2 for cluster logging 2015-04-28 16:20:03 -07:00
CJ Cullen 2b50ee53e0 Revert the change that bumped kube2sky from 1.1->1.2 until we figure out why it's flaky. 2015-04-28 14:57:44 -07:00
Alex Robinson 3e841510de Merge pull request #7393 from satnam6502/fluentd-gcp-image
New Fluentd to Cloud Logging Dockerfile with args
2015-04-28 11:01:14 -07:00
Satnam Singh 20a0905d61 New Fluentd to Cloud Logging Dockerfile with args 2015-04-28 10:30:32 -07:00
Alex Robinson ada9242155 Remove unused env variable from the fluentd dockerfiles and make their apt-get
arguments consistent.
2015-04-27 20:47:38 +00:00
Robert Bailey a9f8f17299 Fetch the kibana tar.gz over SSL. 2015-04-26 21:57:49 -07:00
saadali acbd3d78f1 Specify host/container ports for InfluxDB, so that the UI is accessible. 2015-04-24 16:22:50 -07:00
Nikhil Jindal 84cb48be11 Merge pull request #7246 from satnam6502/es
Convert Elasticsearch logging to v1beta3 and de-salt
2015-04-24 09:21:41 -07:00
CJ Cullen 80af1c9e40 kube2sky using kubeconfig secret: take 2. Point system secrets at https://kubernetes. Override in clients that can't use DNS. 2015-04-23 18:13:16 -07:00
Satnam Singh c9b9e7651e Convert Elasticsearch logging to v1beta and de-salt 2015-04-23 13:06:15 -07:00
Satnam Singh 0abc34245a Update Kibana RC and service to v1beta3 2015-04-23 12:19:17 -07:00
Dawn Chen f9156c281a Merge pull request #7123 from satnam6502/logging
Propagate pod and container name for log files
2015-04-23 10:13:08 -07:00
Fabio Yeon 0a0bd88db6 Revert "Change kube2sky to use token-system-dns secret, point at https endpoint ..." 2015-04-22 17:56:34 -07:00
Satnam Singh e4e830badc Update Kibana pod to speak to Elasticsearchusing v1beta3 2015-04-22 17:37:47 -07:00
Satnam Singh 2444c1f943 Propagate pod and container name for log files 2015-04-22 15:08:51 -07:00
CJ Cullen e982ac5b55 Change kube2sky to use token-system-dns secret, point at https endpoint (instead of kubernetes-ro service). 2015-04-21 23:10:12 -07:00
Alex Robinson 059a8c92bd Move the logging-related directories to where I think they belong.
1. Move fluentd-gcp to be a core cluster addon, rather than a contrib.
2. Get rid of the synthetic logger under contrib, since the exact same
synthetic logger was also included in the logging-demo.
3. Move the logging-demo to examples, since it's effectively an example.

We should also consider adding on a GCP section to the logging-demo
example :)
2015-04-17 23:59:50 +00:00
Tim Hockin c2bacd588d Stop using dockerfile/* images
As per
http://blog.docker.com/2015/03/updates-available-to-popular-repos-update-your-images/
docker has stopped answering dockerfile/redis and dockerfile/nginx.  Fix all
users in our tree.  Sadly this means a lot of published examples are now broken.
2015-04-16 12:20:43 -07:00
Satnam Singh 4c0f06ec66 Convert es-image for gcr.io 2015-04-15 16:28:02 -04:00
Rohit Jnagal 013653bd58 Fix heapster config to talk to the right kubelet port.
The config was updated for v1bet1, but the tests are using v1beta3.
2015-04-10 22:58:38 +00:00
Satnam Singh cfb8577324 Update Kibana to v1.2 which paramaterizes location of Elasticsearch 2015-04-03 14:55:00 -07:00
Satnam Singh e4c91df35f Merge pull request #5776 from jonlangemak/fluentd-elasticsearch-kibanafix
Added API variables so Kibana could access ES through the API server
2015-04-03 14:43:05 -07:00
Jon Langemak 35038dc19a Added ES ENV variables so Kibana can be access in other ways 2015-04-02 21:58:10 -05:00
Robert Bailey 4488ff95a2 Create an insecure (http) read-only port on the kubelet so that
heapster can collect metrics. Update the heapster config to
point to the non-secured port.
2015-04-02 10:45:49 -07:00
Vishnu Kannan e6833639a2 Update heapster version to v0.10.0 2015-04-02 00:39:24 +00:00
Jeff Lowdermilk 506887515d Rename google-containers to google_containers in image names 2015-04-01 09:16:48 -07:00
Satnam Singh 73a9ab2928 Rename logging image to use google_containers 2015-03-31 16:00:52 -07:00
Tim Hockin eeff1b74fb Fixes from feedback and testing 2015-03-30 23:52:37 -07:00
Tim Hockin 186818d787 WIP: Implement multi-port Services 2015-03-30 19:28:11 -07:00
Jeff Lowdermilk bec982774b Merge pull request #6038 from satnam6502/fluentd-es-image
Create a gcr.io image for Flunentd to Elasticsearch node level logging
2015-03-27 09:05:00 -07:00
Satnam Singh 19e621c951 Create a gcr.io image for Flunentd to Elasticsearch node level logging 2015-03-26 21:07:15 -07:00
Jeff Lowdermilk 2b71857816 Pull cluster addon images from gcr.io 2015-03-26 19:59:27 -07:00
Dawn Chen 7a6490f572 Merge pull request #5729 from thockin/plural_endpoints_30_restart
Rename Service.ContainerPort to TargetPort in v1b3
2015-03-20 14:37:46 -07:00
Tim Hockin 4375376e9c Rename Service.ContainerPort to TargetPort in v1b3
Fix all callers and examples.  Part of multi-port service cleanup.
2015-03-20 13:50:06 -07:00
Abhishek Gupta b0c23c1046 Headless Services: Adding option to specify None for PortalIP 2015-03-20 12:10:03 -07:00
Subin M bd52a0cb80 update v1beta3 yaml files 2015-03-19 20:31:10 +05:30
Salvatore Dario Minonne 31ddefc347 Finalize fields.Selector 2015-03-17 22:55:43 +01:00
Satnam Singh 985d5c1f95 Add a prefix to the POS file for Fluentd to Elasticsearch 2015-03-17 13:13:03 -07:00
Vishnu Kannan e89dd7e235 Updating heapster version to v0.9.
Updated the e2e test to work with the new version.
2015-03-14 19:00:18 +00:00
Victor Marmol c03b080328 Merge pull request #5332 from vishh/heapster_e2e
Adding a ginkgo version of monitoring e2e test
2015-03-12 08:37:45 -07:00
Piotr Szczesniak db5fc4ff90 Added label name to kube-dns service
It will be displayed in kubectl clusterinfo command.
2015-03-12 13:15:35 +01:00
Vishnu Kannan 425dd7e3ee Adding a heapster ginkgo e2e test. 2015-03-11 21:47:47 +00:00
Kieran O'Mahony 2b05820619 Update SkyDNS version
I had some trouble with the kubernetes docker image for SkyDNS being outdated. In my experience the version in `kubernetes/skydns:2014-12-23-001` will not behave correctly if it manages to startup before etcd, for details see skynetservices/skydns#142

 Updating to SkyDNS latest fixes this.
2015-03-11 09:46:46 +00:00
Satnam Singh 3ce0ede78e Modify Fluentd to ES setup to pass flags 2015-03-10 10:11:26 -07:00
Satnam Singh 2486de1287 Change Fluentd config to read from head of Docker container logs 2015-03-09 23:25:52 -07:00
rsokolowski 5aa46e6342 Update version of kube2sky to 1.1. 2015-03-06 10:00:57 +01:00
Fabio Yeon 01f7d459d3 Add etcd server check at startup to kube2sky (with retry loop). 2015-03-05 11:43:16 -08:00
rsokolowski 5026142636 Crash kube2sky after repeated etcd mutation failures. 2015-03-05 08:31:14 +01:00
Vish Kannan 5aed317ffc Merge pull request #4853 from sub-mod/grafana_v1beta3
v1beta3 api json for grafana example
2015-03-03 15:43:16 -08:00
Satnam Singh 709476cb5b Merge pull request #4657 from piosz/kubectl
Added new command clusterinfo to kubectl
2015-03-03 11:34:17 -08:00
Piotr Szczesniak e92192d379 Added new command clusterinfo to kubectl
This is first version of the command. It prints IPs of master and cluster
services. Should be improved once generalized labels are implemented #341.

It requires label kubernet.io/cluster-service=true set for cluster services.

Follow up cl after discussion in #4417.
2015-03-03 20:14:24 +01:00
Piotr Szczesniak 3abaa6b3c8 Added cluster-service lavel to monitoring services
Monitoring services will be now displayed in kubectl cluster command (#4657).

This partially addresses #4620
2015-03-03 10:44:46 +01:00
Satnam Singh 72183c064c Use proxy instead of load balancer 2015-03-02 13:44:41 -08:00
Tim Hockin e0e6741027 Stop using named ports in examples and scripts. 2015-03-01 21:30:45 -08:00
Zach Loafman e10f54eebf Merge pull request #4762 from satnam6502/es-image
Make a Kubernetes specific version of an Elasticsearch Docker container
2015-02-26 11:24:09 -08:00
Subin M fc21144d4e v1beta3 api json for grafana example 2015-02-27 00:10:08 +05:30
rsokolowski b05274e237 Update skydns's etcd to version 2.0.3 2015-02-25 18:22:23 +01:00
Satnam Singh eda8a676f4 Make a Kubernetes specific version of an Elasticsearch Docker container 2015-02-23 18:41:56 -08:00
Vishnu Kannan e9271dabde Use heapster v0.8. 2015-02-23 18:11:02 +00:00
Zach Loafman ea5d2f99ae Merge pull request #4622 from satnam6502/cluster-logging
Update cluster logging documentation to use kubectl for public IPs
2015-02-23 09:57:46 -08:00
Vishnu Kannan e2cdcad555 Update to heapster version v0.7.
Added the new label required for cluster addon services.
Made Grafana UI accessble via the proxy on the api-server.
2015-02-20 03:22:41 +00:00
Satnam Singh df2dfd6695 Add kubernetes.io/cluster-service label to cluster level logging services 2015-02-19 16:03:41 -08:00
Tim Hockin fcfe420685 Add cluster-service label to DNS
Also rename the rc, pod, and service, which I have meant to do for a long time.
2015-02-19 14:15:48 -08:00
Satnam Singh b2fcb14db1 Update cluster logging documentation to use kubectl for obtaining the public IPs 2015-02-19 14:05:16 -08:00
Zach Loafman ae27f29c56 Reinstate cluster logging URLs to the end of kube-up.sh
Adds labels to the services, waits for them to be created (which
should be instant, but just in case), query the forwarding rules like
as we did before.

Fixes #3893
2015-02-03 08:27:02 -08:00
Clayton Coleman 053c2b2100 Fix grafana and heapster RC names 2015-01-29 16:26:39 -05:00
Vishnu Kannan 82bbb3e78b Update monitoring components to the latest released versions. 2015-01-23 18:59:05 +00:00
Tim Hockin 61293afad6 better DNS docs 2015-01-22 12:18:25 -08:00
Zach Loafman a305269e18 Deferred creation of SkyDNS, monitoring and logging objects
This implements phase 1 of the proposal in #3579, moving the creation
of the pods, RCs, and services to the master after the apiserver is
available.

This is such a wide commit because our existing initial config story
is special:

* Add kube-addons service and associated salt configuration:
** We configure /etc/kubernetes/addons to be a directory of objects
that are appropriately configured for the current cluster.
** "/etc/init.d/kube-addons start" slurps up everything in that dir.
(Most of the difficult is the business logic in salt around getting
that directory built at all.)
** We cheat and overlay cluster/addons into saltbase/salt/kube-addons
as config files for the kube-addons meta-service.
* Change .yaml.in files to salt templates
* Rename {setup,teardown}-{monitoring,logging} to
{setup,teardown}-{monitoring,logging}-firewall to properly reflect
their real purpose now (the purpose of these functions is now ONLY to
bring up the firewall rules, and possibly to relay the IP to the user).
* Rework GCE {setup,teardown}-{monitoring,logging}-firewall: Both
functions were improperly configuring global rules, yet used
lifecycles tied to the cluster. Use $NODE_INSTANCE_PREFIX with the
rule. The logging rule needed a $NETWORK specifier. The monitoring
rule tried gcloud describe first, but given the instancing, this feels
like a waste of time now.
* Plumb ENABLE_CLUSTER_MONITORING, ENABLE_CLUSTER_LOGGING,
ELASTICSEARCH_LOGGING_REPLICAS and DNS_REPLICAS down to the master,
since these are needed there now.

(Desperately want just a yaml or json file we can share between
providers that has all this crap. Maybe #3525 is an answer?)

Huge caveats: I've gone pretty firm testing on GCE, including
twiddling the env variables and making sure the objects I expect to
come up, come up. I've tested that it doesn't break GKE bringup
somehow. But I haven't had a chance to test the other providers.
2015-01-21 12:25:50 -08:00
Joe Beda d20b9d4567 Merge pull request #3666 from thockin/golang-static
Fix static builds in go1.4
2015-01-21 10:07:41 -08:00
Tim Hockin 0a538132cf Fix static builds in go1.4
https://github.com/golang/go/issues/9344
2015-01-20 21:04:04 -08:00
Tim Hockin 2367360321 Update DNS doc 2015-01-17 19:42:09 -08:00
Vishnu Kannan 50c32fbba4 Adding a replication controller for all monitoring pods.
Removed auth for Grafana to facilitate usage via service proxy on the api-server.
Added a grafana service
Removed elasticsearch dependency for monitoring - faster startup times.
2015-01-16 18:37:46 +00:00
Zach Loafman 43cd9e91f6 Revert "Adding a replication controller for all monitoring pods." 2015-01-16 07:16:54 -08:00
Satnam Singh d443dd8ea6 Merge pull request #3489 from vishh/monitoring_rc
Adding a replication controller for all monitoring pods.
2015-01-15 18:18:54 -08:00
Vishnu Kannan ca2267e3e9 Adding a replication controller for all monitoring pods.
Removed auth for Grafana to facilitate usage via service proxy on the api-server.
Added a grafana service
Removed elasticsearch dependency for monitoring - faster startup times.
2015-01-16 00:56:51 +00:00
Satnam Singh cd5a44e381 Remove curl check from Kibana image 2015-01-14 21:32:29 -08:00
Satnam Singh 295bd3768d Launch Elasticsearch and Kibana automatically 2015-01-09 13:41:46 -08:00
Joe Beda 9aa48b7628 Move heapster data files to cluster/addons.
Also pretty up the JSON (make it real JSON) and streamline the sed in cluster/gce/init.sh.
2015-01-05 12:32:35 -08:00
Joe Beda 6df6aab077 Move DNS from contrib to cluster/addons
This fixes #3190.
2015-01-05 12:32:35 -08:00