History

Bryan Boreham 9a74d53935 [BUGFIX] TSDB: Fix query overlapping in-order and ooo head (#14693 ) * tsdb: Unit test query overlapping in order and ooo head Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com> * TSDB: Merge overlapping head chunk The basic idea is that getOOOSeriesChunks can populate Meta.Chunk, but since it only returns one Meta per overlapping time-slot, that pointer may end up in a Meta with a head-chunk ID. So we need HeadAndOOOChunkReader.ChunkOrIterable() to call mergedChunks in that case. Previously, mergedChunks was checking that meta.Ref was a valid OOO chunk reference, but it never actually uses that reference; it just finds all chunks overlapping in time. So we can delete that code. Signed-off-by: Bryan Boreham <bjboreham@gmail.com> Co-authored-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com>		3 months ago
..
agent	[PRW 2.0] Merging `remote-write-2.0` feature branch to main (PRW 2.0 support + metadata in WAL) (#14395 )	5 months ago
chunkenc	Fix corrupting spans via iterator sharing	4 months ago
chunks	Upgrade golangci-lint to v1.60.1	3 months ago
docs	Fix language in docs and comments (#14041 )	7 months ago
encoding	tsdb/encoding: use Go standard errors package	1 year ago
errors	Enable default revive rules (#13068 )	1 year ago
fileutil	tests: remove err from message when testify prints it already	10 months ago
goversion	remove obsolete build tag	10 months ago
index	Upgrade golangci-lint to v1.60.1	3 months ago
record	Fix a couple of comments	5 months ago
testdata	tsdb: Delete blocks atomically; Remove tmp blocks on start; Added test. (#7772 )	4 years ago
tombstones	Update tombstones.go	1 year ago
tsdbutil	Ignore stale histograms for counter reset detection	4 months ago
wlog	Upgrade golangci-lint to v1.60.1	3 months ago
.gitignore	Moving tsdb into its own subdirectory	5 years ago
CHANGELOG.md	Rename default branch to main	4 years ago
README.md	Fixed broken link in tsdb README.md	2 years ago
block.go	TSDB: Review feedback	3 months ago
block_test.go	tsdb: Extend compactor interface to allow compactions to create multiple output blocks (#14143 )	6 months ago
blockwriter.go	tsdb: Extend compactor interface to allow compactions to create multiple output blocks (#14143 )	6 months ago
blockwriter_test.go	Add a chunk size limit in bytes (#12054 )	1 year ago
compact.go	TSDB: Change block populator to accept postings index function (#14213 )	5 months ago
compact_test.go	feat: allow to delay head compaction start time helping Prometheus instances to	4 months ago
db.go	Upgrade golangci-lint to v1.60.1	3 months ago
db_test.go	[BUGFIX] TSDB: Fix query overlapping in-order and ooo head (#14693 )	3 months ago
example_test.go	Add context argument to Querier.Select (#12660 )	1 year ago
exemplar.go	[ENHANCEMENT] TSDB: Save map lookup on validation	6 months ago
exemplar_test.go	[Test] TSDB: BenchmarkResizeExemplar multiple per series	6 months ago
head.go	Revert the option regardless of error	4 months ago
head_append.go	Upgrade golangci-lint to v1.60.1	3 months ago
head_bench_test.go	tsdb: use Go standard errors	12 months ago
head_dedupelabels.go	tsdb: reset symbol table for exemplars periodically	5 months ago
head_other.go	TSDB: rebuild labels symbol-table on each compaction	5 months ago
head_read.go	[BUGFIX] TSDB: Fix query overlapping in-order and ooo head (#14693 )	3 months ago
head_read_test.go	TSDB: Simplify OOO Select by copying the head chunk (#14396 )	5 months ago
head_test.go	Upgrade golangci-lint to v1.60.1	3 months ago
head_wal.go	TSDB: Never go over maximum number of OOO chunks	3 months ago
isolation.go	tsdb: create isolation transaction slice on demand	1 year ago
isolation_test.go	tsdb: turn off transaction isolation for head compaction (#11317 )	2 years ago
mocks_test.go	tsdb: use Go standard errors	12 months ago
ooo_head.go	TSDB: Remove code for querying OOO-head only	3 months ago
ooo_head_read.go	[BUGFIX] TSDB: Fix query overlapping in-order and ooo head (#14693 )	3 months ago
ooo_head_read_test.go	TSDB: Remove OOOHeadIndexReader	3 months ago
ooo_head_test.go	Fix ToEncodedChunks minT for recoded chunks	4 months ago
ooo_isolation.go	Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )	1 year ago
ooo_isolation_test.go	Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )	1 year ago
querier.go	[PERF] TSDB: Query head and ooo-head together	3 months ago
querier_bench_test.go	TSDB: Review feedback	3 months ago
querier_test.go	TSDB tests: Fix up BenchmarkQueries	3 months ago
repair.go	tsdb: use Go standard errors	12 months ago
repair_test.go	tsdb tests: use go-cmp instead of DeepEquals	10 months ago
testutil.go	Testutil refactoring	5 months ago
tsdbblockutil.go	Optimize histogram iterators (#13340 )	10 months ago

README.md

TSDB

This directory contains the Prometheus TSDB (Time Series DataBase) library, which handles storage and querying of all Prometheus v2 data.

Documentation

External resources

A writeup of the original design can be found here.
Video: Storing 16 Bytes at Scale from PromCon 2017.
Compression is based on the Gorilla TSDB white paper.

A series of blog posts explaining different components of TSDB: