Commit Graph

94 Commits (40c74be460e27aaf7c924d45f808aa0ed91236cc)

Author SHA1 Message Date
Rick Buskens 77bda6fd16 Updated configuration to spawn multiple threads for processing 2016-08-01 15:08:11 -04:00
David McMahon ef0c9f0c5b Remove "All rights reserved" from all the headers. 2016-06-29 17:47:36 -07:00
pprokop fa91b3e461 Adding option to deploy fluentd-elasticsearch in diffrent namespace then kube-system 2016-06-27 18:15:41 +02:00
Alex Robinson bb51c94172 Add collection of the new glbc and cluster-autoscaler logs 2016-06-03 15:50:52 +00:00
Alex Robinson 8579509293 Rebuild elasticsearch image to include changes since 1.2 2016-06-01 20:48:20 +00:00
keontang 1520a01d97 Fixed #25127 2016-05-16 09:03:00 +08:00
Mike Zupan dc643d2592 Fixing a simple typo 2016-03-06 23:49:35 -08:00
Alex Robinson 29eb6020fb Merge pull request #22074 from a-robinson/images
Update the logging images to parse sub-second docker timestamps.
2016-03-04 09:04:33 -08:00
Alex Robinson feea376b5c Update the logging images to parse sub-second docker timestamps. 2016-03-03 10:21:30 -08:00
Alex Robinson f8965a6f41 Fix parsing of kube logs to handle logs split across lines.
I didn't expect glog to split single log statements onto multiple lines,
but apparently it does if they're long enough. This groups them back
together appropriately.
2016-02-26 22:58:46 +00:00
Christopher Eck c34ecf7100 Enable fluentd to parse the sub-second portion of timestamps coming from docker logs. 2016-02-18 11:07:27 -08:00
Alex Robinson e5c5f76402 Update the default fluentd images to parse system logs. 2016-02-04 23:29:27 +00:00
Alex Robinson 592da85a81 Parse system logs into structured messages in fluentd.
This allows you to filter based on components of the log,
like their severity, in the developers console or elasticsearch.
2016-02-04 08:14:59 +00:00
Paul Morie b672785d72 Add boilerplate checks for Dockerfiles 2016-02-03 18:35:26 -05:00
Paul Morie 05bd107301 Add boilerplate checks for Makefiles 2016-02-03 18:35:26 -05:00
Alex Robinson 6acf297231 Update the fluentd versions to include fixes for #19405. 2016-01-27 00:30:53 +00:00
Alex Robinson ac13e851e2 Don't let fluentd pipe its own logs directly back into itself. 2016-01-27 00:30:53 +00:00
Alex Robinson 95a4ea3fc8 Increase the fluentd buffer chunk size to improve write throughput.
Also reduce the max wait between retries, 30 seconds should be more than
enough backoff.
2016-01-27 00:30:50 +00:00
gmarek 2d5c429f9d Add resource requests to addons 2015-12-17 10:13:15 +01:00
Minhan Xia b4c72e56ce enforce node quorum to prevent es split brain problem 2015-12-14 18:16:04 -08:00
Matt Moore b750d1dddc Drop the beta for GCR v2 images.
beta.gcr.io is no longer needed to pull through v2.
2015-11-14 12:19:02 -08:00
Matt Moore eeb4eeb17c Move pause and fluentd-elasticsearch to GCR v2.
This scopes down the initially ambitious PR:
https://github.com/kubernetes/kubernetes/pull/14960 to replace just
`pause` and `fluentd-elasticsearch` to come through `beta.gcr.io`.

The v2 versions have been pushed under new tags, `pause:2.0` and
`fluentd-elastisearch:1.12`.

NOTE: `beta.gcr.io` will still serve images using v1 until they are repushed with v2.  Pulls through `gcr.io` will still work after pushing through `beta.gcr.io`, but will be served over v1 (via compat logic).
2015-10-06 16:39:07 -07:00
Tamer Tas cb5f921df1 Add newline to the end of bash scripts 2015-09-18 19:35:05 +03:00
Eric Paris 04fc8ae3dd s|github.com/GoogleCloudPlatform/kubernetes|github.com/kubernetes/kubernetes| 2015-09-03 10:10:11 -04:00
Jimmi Dyson e07da97447 Switch to fluentd kubernetes metadata plugin to enrich logs with more searchable kubernetes metadata 2015-09-02 10:33:15 +01:00
Alex Robinson d02dc64036 Let fluentd-es log by not redirecting to a file within the container
and only using -q (warning logs only) rather than -qq (error logs only).
2015-08-27 21:41:44 +00:00
Alex Robinson f6f8cb07ae Transfer maintainer responsibilities for fluentd configs/images. 2015-08-26 21:48:51 +00:00
Satnam Singh 278a3911fd Fetch fluentd td agent securely 2015-08-19 13:34:03 -07:00
Kris Rousey ae6c64d9bb Moving everyone to unversioned client 2015-08-18 10:23:03 -07:00
Alex Robinson c887ad75b8 Stop collecting monit logs via fluentd. 2015-08-07 00:12:21 +00:00
Mike Danese 17defc7383 run gofmt on everything we touched 2015-08-05 17:52:56 -07:00
Mike Danese 8e33cbfa28 rewrite go imports 2015-08-05 17:30:03 -07:00
Alex Robinson cc02e50fc7 Collect more of the VM's log files (monit, salt) in fluentd-es. 2015-08-05 00:22:38 +00:00
Alex Robinson 69ab7026af Update fluentd-es to collect etcd logs and remove merge conflict cruft. 2015-07-30 22:21:01 +00:00
Satnam Singh 691c07763c Remove use of v1beta3 from ES logging 2015-07-06 18:47:45 -07:00
Brendan Burns 988aa6fdf6 Move things into a 'kube-system' namespace. 2015-07-06 15:08:23 -07:00
Zach Loafman a2250d1caf Merge pull request #10597 from a-robinson/fluentd
Run fluentd on the master to collect the core master logs
2015-07-04 21:12:47 -07:00
Alex Robinson 4bfbd5f553 Add limits to the fluentd buffer size. 2015-07-03 23:24:08 +00:00
Zach Loafman 1d16be675c Merge pull request #10653 from dchen1107/resource_management
Set resource limit for addon containers
2015-07-01 19:35:28 -07:00
Dawn Chen 6b61918b67 Set resource limit for both elasticsearch and kibana containers based on data collected by #10335 2015-07-01 16:01:09 -07:00
nikhiljindal 274792d7bb Stop exposing v1beta3 by default 2015-07-01 14:38:02 -07:00
Alex Robinson 8855371763 Configure fluentd to collect additional log files, including master log files.
This also merges the output blocks together because there's no compelling
reason to have a separate output block for each input.
2015-07-01 20:07:47 +00:00
Satnam Singh 4e58e001da Change port names to avoid validation failure 2015-06-30 10:56:20 -07:00
Satnam Singh cb9f7d17f5 Add readiness probes to Elasticsearch and Kibana logging 2015-06-22 12:40:15 -07:00
Tim St. Clair f5830edbbc s/gcloud preview docker/gcloud docker/ 2015-06-18 12:27:08 -07:00
Satnam Singh ce49c32d6a Add readiness probe to Elasticsearch and Kibana logging pods 2015-06-18 10:46:05 -07:00
Daniel Smith 40eb1599dd fix elasticsearch 2015-06-03 15:41:09 -07:00
Victor Marmol 7dde223c2a Merge pull request #8458 from satnam6502/elasticsearch
Give explicit version number to Elasticsearch logging RC
2015-05-18 16:27:08 -07:00
Satnam Singh 3337cea8bb Give explicit version number to Kibana RC 2015-05-18 16:04:13 -07:00
Victor Marmol e83a4e3fd8 Merge pull request #8450 from satnam6502/kibana
Add version label to Kibana controller and service
2015-05-18 15:56:27 -07:00