Commit Graph

268 Commits (0fa23716f04aa89bf0e5f28a7537d6620c92be79)

Author SHA1 Message Date
André Bauer 2c48c6fe7a
added monotek to fluentd-elasticsearch OWNERS file 2018-12-11 19:52:39 +01:00
Lantao Liu 1670b4089a Make fluentd container runtime service configurable. 2018-11-16 02:17:55 -08:00
Davanum Srinivas 954996e231
Move from glog to klog
- Move from the old github.com/golang/glog to k8s.io/klog
- klog as explicit InitFlags() so we add them as necessary
- we update the other repositories that we vendor that made a similar
change from glog to klog
  * github.com/kubernetes/repo-infra
  * k8s.io/gengo/
  * k8s.io/kube-openapi/
  * github.com/google/cadvisor
- Entirely remove all references to glog
- Fix some tests by explicit InitFlags in their init() methods

Change-Id: I92db545ff36fcec83afe98f550c9e630098b3135
2018-11-10 07:50:31 -05:00
k8s-ci-robot 123d0a74ef
Merge pull request #70610 from zhihuiwu/min-master-nodes
Fix a wrong judgement in elasticsearch_logging_discovery.go
2018-11-05 12:58:16 -08:00
zhihui wu eed65f75f9 Modify the judgement condtion in elasticsearch_logging_discovery.go
The number of endpoints's addresses can be greater or equal to the
value of "MINIMUM_MASTER_NODES".

Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2018-11-03 14:12:03 +08:00
Cédric de Saint Martin def00298c3 Fluentd: concatenate long logs (>16KB) which have been splitted by Docker into several lines.
See https://github.com/kubernetes/kubernetes/issues/52444.

Signed-off-by: Cédric de Saint Martin <cdesaintmartin@wiremind.fr>
2018-10-16 23:44:37 +02:00
Cédric de Saint Martin 46c5c8e20a fluent-es-image: sort plugins in Gemfile.
Signed-off-by: Cédric de Saint Martin <cdesaintmartin@wiremind.fr>
2018-10-16 23:44:37 +02:00
Cédric de Saint Martin 079136fd59 fluent-es-image: add fluentd-plugin-concat to gemfile.
Signed-off-by: Cédric de Saint Martin <cdesaintmartin@wiremind.fr>
2018-10-16 23:44:37 +02:00
htkuan 1cdc9059ba Update elasticsearch to v6.3.0 2018-10-08 23:51:40 +08:00
k8s-ci-robot 9c29560ac8
Merge pull request #68064 from gianrubio/fluentd-signal
fluentd doesn't receive the signal TERM
2018-09-25 03:52:00 -07:00
Giancarlo Rubio a37c8afe02 Pass the terminaton signal to fluentd 2018-08-30 13:58:14 +02:00
Lubomir I. Ivanov aefb5b3c0e cluser/addons: add labels to fluentd owner files 2018-08-30 00:38:08 +03:00
saravanan30erd c493bef26e fix the fluentd config params 2018-08-28 17:26:27 +04:00
liangwei 5ea138f4e9 remove rescheduler 2018-08-22 11:49:14 +08:00
Kubernetes Submit Queue 3f6717a097
Merge pull request #67582 from monotek/kibana
Automatic merge from submit-queue (batch tested with PRs 67493, 67617, 67582, 67337). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

updates kibana to 6.3.2

**What this PR does / why we need it**:
* updates kibana to 6.3.2 

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

**Special notes for your reviewer**:
needed as es was updated to 6.3.2 too in https://github.com/kubernetes/kubernetes/pull/67484


**Release note**:

```release-note
updates kibana to 6.3.2 
```
2018-08-20 20:39:13 -07:00
André Bauer f8cea1b028 updates kibana to 6.3.2 2018-08-20 10:00:01 +02:00
André Bauer 6390e590cc added missing pos files & added mapping type name in fluentd config 2018-08-20 09:55:38 +02:00
André Bauer 9b5c5650eb use image 2.2.0 again 2018-08-17 21:49:44 +02:00
André Bauer 6ab218d4dd fixed typo 2018-08-17 21:48:44 +02:00
André Bauer 61a709a7b2 fixed json logging in fluentd-elasticsearch image 2018-08-17 16:43:27 +02:00
André Bauer 9f88fe8016 updates es-image to elasticsearch 6.3.2 2018-08-16 09:51:52 +02:00
André Bauer 2b12f2f944 updated fluentd to 1.2.4 2018-08-15 15:17:00 +02:00
Oleg Ivanov 7e814ec5cc Incremented the elasticsearch version 2018-07-06 22:00:51 +03:00
Oleg Ivanov ad381d885d Fixed the wrong elasticsearch node counter 2018-06-29 23:03:04 +03:00
Jeff Grafton 23ceebac22 Run hack/update-bazel.sh 2018-06-22 16:22:57 -07:00
André Bauer cee9deb12c updated gems and versions 2018-06-20 09:33:04 +02:00
Kubernetes Submit Queue fea9a3f1c5
Merge pull request #62910 from jklare/bump_addon_fluentd-es
Automatic merge from submit-queue (batch tested with PRs 64142, 64426, 62910, 63942, 64548). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

update fluentd-elasticsearch addon

**What this PR does / why we need it**:
Elastic now provides a fully opensource version for their prebuild
docker images (elasticsearch, kibana and so on). To avoid running into
licensing conflicts for this addon example, we should rather use these
images instead of the premium ones (were we also have to disable premium
features manually right now).

This PR updates:
- fluentd from <=1.1.0 to ~>1.1.3
- elasticsearch and kibana from 5.6.2 to 6.2.4
- fluentd-elasticsearch-plugin from 2.4.1 to 2.9.1

**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Fixes #

https://github.com/fluent/fluentd/issues/1894

**Special notes for your reviewer**:

**Release note**:

```release-note

```
2018-06-20 00:05:14 -07:00
RaviSantosh Gudimetla 872addf9e3
Revert "Remove rescheduler and corresponding tests from master" 2018-05-31 22:18:49 -04:00
Kubernetes Submit Queue a762ea1beb
Merge pull request #64364 from ravisantoshgudimetla/remove-rescheduler
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Remove rescheduler and corresponding tests from master

**What this PR does / why we need it**:
This is to remove rescheduler from master branch as we are promoting priority and preemption to beta.
**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
Part of #57471

**Special notes for your reviewer**:
/cc @bsalamat @aveshagarwal 
**Release note**:

```release-note
Remove rescheduler from master.
```
2018-05-30 22:20:26 -07:00
André Bauer 807047a792 updated versions 2018-05-30 23:04:54 +02:00
ravisantoshgudimetla aeccffc339 Phase out rescheduler in favor of priority and preemption 2018-05-29 19:52:06 -04:00
André Bauer 1f7a61b6aa raised version tag to 2.1.0 2018-05-27 13:54:27 +02:00
André Bauer d4d7976b05 updated fluentd in fluentd-es-image to version 1.2.1 2018-05-27 13:50:01 +02:00
Zhen Wang e9c7fe57d3 Use default seccomp profile for flutend-elasticsearch addon 2018-05-24 11:22:17 -07:00
Kubernetes Submit Queue 0c3edc6f96
Merge pull request #62166 from mbert/master
Automatic merge from submit-queue (batch tested with PRs 57954, 62166). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

fluentd-elasticsearch addon: allow graceful shutdown in fluentd-es image.

This PR contains an optimisation to the fluentd-elasticsearch addon. Restarting fluentd pods took unnecessarily long because the start script in the image did not support propagating signals to the actual fluentd process. This patch fixes this behaviour.

```release-note
NONE
```
2018-05-09 07:17:12 -07:00
Jan Klare a7ed23be8e
update fluentd-elasticsearch addon
* elastic now provides a fully opensource version for their prebuild
docker images (elasticsearch, kibana and so on). To avoid running into
licensing conflicts for this addon example, we should rather use these
images instead of the premium ones (were we also have to disable premium
features manually right now)
* remove disable flags for xpack, since *-oss images do not include this anymore
* bump elasticsearch and kibana version from 5.6.4 to 6.2.4
* use oss version from elastic as baseimg for kibana and elasticsearch
* bump fluentd version to ~>1.1.3
* bump gem 'fluent-plugin-elasticsearch' to '~>2.9.1' to allow usage of elasticsearch 6.x
* bump fluentd-es-image to v2.1.0
* fix elasticserach run.sh to align with new elasticsearch upstream container structure
2018-04-25 10:04:40 +02:00
Dobes Vandermeer c73cb05a7e
Capture kernel logs in example fluentd.conf
I find it useful to have the kernel logs available for searching, for example that's the only place you can see processes killed when they hit memory limits.
2018-04-05 23:10:14 -07:00
Martin Dietze 6a79d9e67b fluentd-elasticsearc addon: allow graceful shutdown in fluentd-es image. 2018-04-05 15:45:24 +02:00
Mikhail Vyatskov 300fe8f179 Remove crassirostris from owners and reviewers
Signed-off-by: Mikhail Vyatskov <crassirostris@yandex.com>
2018-04-04 18:36:44 +02:00
Lantao Liu db110f1b71 Add CRI container log format support back. 2018-03-28 01:29:00 +00:00
Filipe Brandenburger cea4c98508 Remove mapping to /host/lib from fluentd-gcp container.
This mapping is no longer needed since fluentd-gcp v2.0.16, in which it
started using a container image based on Debian Stretch, in which the
systemd libraries already include support for all the supported
compression algorithms.

The /run.sh in the image no longer accesses /host/lib anyways, so let's
stop mapping it here.

Related changes:
- fluentd-gcp on GoogleCloudPlatform/k8s-stackdriver#101
- fluentd-es on GoogleCloudPlatform/google-fluentd#80
2018-03-02 10:20:08 -08:00
Mike Danese c0b7364563 remove gcloud docker -- since it's deprecated 2018-02-28 00:24:27 -08:00
Mike Danese 7b4722964d remove deprecated /proxy paths
These were depercated in v1.2.
2018-02-20 14:42:19 -08:00
Jeff Grafton ef56a8d6bb Autogenerated: hack/update-bazel.sh 2018-02-16 13:43:01 -08:00
Kubernetes Submit Queue bc9c6df31d
Merge pull request #59103 from Random-Liu/upload-container-runtime-log
Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Upload container runtime log to sd/es.

I've verified this in my environment. My stackdriver has an extra `container-runtime` entry for node log, and it collects container runtime daemon log correctly.

@yujuhong @feiskyer @crassirostris @piosz 
@kubernetes/sig-node-pr-reviews @kubernetes/sig-instrumentation-pr-reviews 
Signed-off-by: Lantao Liu <lantaol@google.com>

**Release note**:

```release-note
Container runtime daemon (e.g. dockerd) logs in GCE cluster will be uploaded to stackdriver and elasticsearch with tag `container-runtime`
```
2018-02-14 03:33:21 -08:00
Lantao Liu 8d920d095c Upload container runtime log to sd/es.
Signed-off-by: Lantao Liu <lantaol@google.com>
2018-02-13 18:25:02 +00:00
talk2vino c1643e5871 libffi-dev dependency added in fluent-es-image Dockerfile to solve the docker build error 2018-02-13 21:27:40 +05:30
Kubernetes Submit Queue 7ef11bd964
Merge pull request #59237 from tanshanshan/addons1
Automatic merge from submit-queue (batch tested with PRs 59767, 56454, 59237, 59730, 55479). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.

Change critical pods’ template to use priority

**What this PR does / why we need it**:
Change critical pods’ template to use priority
Thanks.
**Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
ref #57471

**Special notes for your reviewer**:

**Release note**:

```release-note

```
2018-02-12 15:44:36 -08:00
tanshanshan 95b2b94b1b Change critical pods’ template to use priority 2018-02-08 15:06:27 +08:00
Tim Hockin 3586986416 Switch to k8s.gcr.io vanity domain
This is the 2nd attempt.  The previous was reverted while we figured out
the regional mirrors (oops).

New plan: k8s.gcr.io is a read-only facade that auto-detects your source
region (us, eu, or asia for now) and pulls from the closest.  To publish
an image, push k8s-staging.gcr.io and it will be synced to the regionals
automatically (similar to today).  For now the staging is an alias to
gcr.io/google_containers (the legacy URL).

When we move off of google-owned projects (working on it), then we just
do a one-time sync, and change the google-internal config, and nobody
outside should notice.

We can, in parallel, change the auto-sync into a manual sync - send a PR
to "promote" something from staging, and a bot activates it.  Nice and
visible, easy to keep track of.
2018-02-07 21:14:19 -08:00