github
/
k3s
mirror of https://github.com/k3s-io/k3s
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
k3s/examples
History
Kubernetes Submit Queue c08758e95d Merge pull request #39199 from deimosfr/cassandra_exemple_fix_shutdown 
Automatic merge from submit-queue (batch tested with PRs 39199, 37273, 29183, 39638, 40199)

fixing Cassandra shutdown example to avoid data corruption

Hi,

I was playing with Cassandra example stored in the Kubernetes project and I encountered issues on shutdown (not anytime). After checking it looks like the shutdown of a node is brutal and data corruption may occur during a flush on disk. To avoid that, I'm suggesting a hook to gracefully shutdown Cassandra before stopping the container.

Here are logs of corruption after a pod delete:
```
/10.2.76.4:[-8699848499000118463, -8567123670484406873, -8496767951391579058, -8426990834929543369, -7697118318683556771, -6942779781591907873, -6795880495022459877, -6496399078175245235, -5450122121479522544, -5002551029990001224, -4914532712178218138, -4884518674849288097, -3667338763252443465, -3316742521554936832, -2844544359955291760, -1291351295404368159, -794348397160283083, -705240847455001090, -652995206518489298, -284127251294286231, 173240967232234690, 616476682204879844, 826670457841382100, 1815369334084765465, 4431706613761077084, 4743606016174161647, 5637469692783959686, 5802957011124852712, 6759688243703331970, 7679657413128857702, 7713766696628426028, 9098158217036036188]

ERROR 16:23:06 Exception in thread Thread[CompactionExecutor:2,1,main]
org.apache.cassandra.io.sstable.CorruptSSTableException: Corrupted: /cassandra_data/data/system/sstable_activity-5a1ff267ace03f128563cfae6103c65e/mc-2-big-Data.db
	at org.apache.cassandra.io.sstable.format.big.BigTableScanner$KeyScanningIterator.computeNext(BigTableScanner.java:351) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.io.sstable.format.big.BigTableScanner$KeyScanningIterator.computeNext(BigTableScanner.java:265) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.io.sstable.format.big.BigTableScanner.hasNext(BigTableScanner.java:245) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:374) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.advance(MergeIterator.java:186) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:155) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.utils.AbstractIterator.hasNext(AbstractIterator.java:47) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.db.partitions.UnfilteredPartitionIterators$2.hasNext(UnfilteredPartitionIterators.java:150) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.db.transform.BasePartitions.hasNext(BasePartitions.java:92) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.db.compaction.CompactionIterator.hasNext(CompactionIterator.java:232) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:184) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:82) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:60) ~[apache-cassandra-3.9.jar:3.9]
	at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:264) ~[apache-cassandra-3.9.jar:3.9]

```

It works well for me now and do not have data corruption anymore.
 		2017-01-23 00:30:11 -08:00
..
apiserver move pkg/fields to apimachinery 2017-01-19 09:50:16 -05:00
cluster-dns fix kube-dns link in examples 2017-01-20 09:54:45 -06:00
cockroachdb examples: use 'kubectl scale' in cockroach statefulset example 2016-12-23 15:37:18 +01:00
elasticsearch Merge pull request #34894 from allancaffee/patch-1 2016-11-28 11:44:39 -08:00
explorer Always --pull in docker build to ensure recent base images 2017-01-10 16:21:05 -08:00
guestbook fix munge-docs build errors 2016-11-17 16:49:00 +01:00
guestbook-go Always --pull in docker build to ensure recent base images 2017-01-10 16:21:05 -08:00
https-nginx Correct import statements 2017-01-17 16:18:18 -05:00
javaee Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00
javaweb-tomcat-sidecar Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00
job Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00
k8petstore Enable auto-generating sources rules 2017-01-05 14:14:13 -08:00
kubectl-container Always --pull in docker build to ensure recent base images 2017-01-10 16:21:05 -08:00
meteor Remove all MAINTAINER statements in the codebase as they aren't very useful and now deprecated 2016-12-17 20:34:10 +02:00
mysql-cinder-pd Fix typos and linted_packages sorting 2016-10-31 18:31:08 +01:00
mysql-wordpress-pd fix kube-dns link in examples 2017-01-20 09:54:45 -06:00
newrelic Update New Relic sample docs with dynamic hostname info 2017-01-03 13:45:11 -05:00
nodesjs-mongodb Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00
openshift-origin examples: fix OpenShift example 2017-01-09 09:58:35 +01:00
persistent-volume-provisioning Move provisioning examples out of 'experimental' directory. 2017-01-06 13:58:04 +01:00
phabricator Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00
podsecuritypolicy/rbac Remove a few versioned-warnings that snuck in, again 2016-11-18 13:28:46 -08:00
runtime-constraints Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00
selenium Update selenium docker images 2016-11-30 14:34:43 -03:00
sharing-clusters Correct import statements 2017-01-17 16:18:18 -05:00
spark fix kube-dns link in examples 2017-01-20 09:54:45 -06:00
storage fixing Cassandra shutdown example to avoid data corruption 2017-01-12 22:22:47 +01:00
storm Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00
sysdig-cloud Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00
volumes Remove all MAINTAINER statements in the codebase as they aren't very useful and now deprecated 2016-12-17 20:34:10 +02:00
BUILD start the apimachinery repo 2017-01-11 09:09:48 -05:00
OWNERS Updated top level owners file to match new format 2017-01-19 11:29:16 -08:00
README.md Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00
doc.go Use Go canonical import paths 2016-07-16 13:48:21 -04:00
examples_test.go start the apimachinery repo 2017-01-11 09:09:48 -05:00
guidelines.md Fix typos and linted_packages sorting 2016-10-31 18:31:08 +01:00
pod examples/pod: Revert the previous changes. 2016-09-13 15:09:25 -07:00
scheduler-policy-config-with-extender.json PodFitsPorts has been replaced by PodFitsHostPorts 2017-01-11 14:52:45 +08:00
scheduler-policy-config.json PodFitsPorts has been replaced by PodFitsHostPorts 2017-01-11 14:52:45 +08:00
simple-nginx.md Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00

README.md

Kubernetes Examples: releases.k8s.io/HEAD

This directory contains a number of examples of how to run real applications with Kubernetes.

Demonstrations of how to use specific Kubernetes features can be found in our documents.

Maintained Examples

Maintained Examples are expected to be updated with every Kubernetes release, to use the latest and greatest features, current guidelines and best practices, and to refresh command syntax, output, changed prerequisites, as needed.

Name Description Notable Features Used Complexity Level
Guestbook PHP app with Redis Replication Controller, Service Beginner
WordPress WordPress with MySQL Deployment, Persistent Volume with Claim Beginner
Cassandra Cloud Native Cassandra Daemon Set Intermediate

Note: Please add examples to the list above that are maintained.

See Example Guidelines for a description of what goes in this directory, and what examples should contain.

Analytics