You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Łukasz Mierzwa 3c80963e81 Use a linked list for memSeries.headChunk (#11818) ... Currently memSeries holds a single head chunk in-memory and a slice of mmapped chunks. When append() is called on memSeries it might decide that a new headChunk is needed to use for given append() call. If that happens it will first mmap existing head chunk and only after that happens it will create a new empty headChunk and continue appending our sample to it. Since appending samples uses write lock on memSeries no other read or write can happen until any append is completed. When we have an append() that must create a new head chunk the whole memSeries is blocked until mmapping of existing head chunk finishes. Mmapping itself uses a lock as it needs to be serialised, which means that the more chunks to mmap we have the longer each chunk might wait for it to be mmapped. If there's enough chunks that require mmapping some memSeries will be locked for long enough that it will start affecting queries and scrapes. Queries might timeout, since by default they have a 2 minute timeout set. Scrapes will be blocked inside append() call, which means there will be a gap between samples. This will first affect range queries or calls using rate() and such, since the time range requested in the query might have too few samples to calculate anything. To avoid this we need to remove mmapping from append path, since mmapping is blocking. But this means that when we cut a new head chunk we need to keep the old one around, so we can mmap it later. This change makes memSeries.headChunk a linked list, memSeries.headChunk still points to the 'open' head chunk that receives new samples, while older, yet to be mmapped, chunks are linked to it. Mmapping is done on a schedule by iterating all memSeries one by one. Thanks to this we control when mmapping is done, since we trigger it manually, which reduces the risk that it will have to compete for mmap locks with other chunks. Signed-off-by: Łukasz Mierzwa <l.mierzwa@gmail.com>		1 year ago
..
chunk_write_queue.go	Fix: getting rid of EncOOOXOR chunk encoding (#12111)	2 years ago
chunk_write_queue_test.go	Fix: getting rid of EncOOOXOR chunk encoding (#12111)	2 years ago
chunks.go	Use a linked list for memSeries.headChunk (#11818)	1 year ago
chunks_test.go	Add out-of-order sample support to the TSDB (#11075)	2 years ago
head_chunks.go	Fix race condition in ChunkDiskMapper.Truncate() (#12500)	1 year ago
head_chunks_other.go	tsdb/chunks: preallocate at least some space on non-Windows systems (#9581)	3 years ago
head_chunks_test.go	Fix race condition in ChunkDiskMapper.Truncate() (#12500)	1 year ago
head_chunks_windows.go	Format Go source files using 'gofumpt -w -s -extra'	3 years ago
queue.go	Reduce chunk write queue memory usage 2 (#10874)	2 years ago
queue_test.go	Reduce chunk write queue memory usage 2 (#10874)	2 years ago