History

Fiona Liao 5bee0cfce2 Change `ChunkReader.Chunk()` to `ChunkOrIterable()` The ChunkReader interface's Chunk() has been changed to ChunkOrIterable(). This is a precursor to OOO native histogram support - with OOO native histograms, the chunks.Meta passed to Chunk() can result in multiple chunks being returned rather than just a single chunk (e.g. if oooMergedChunk has a counter reset in the middle). To support this, ChunkOrIterable() requires either a single chunk or an iterable to be returned. If an iterable is returned, the caller has the responsibility of converting the samples from the iterable into possibly multiple chunks. The OOOHeadChunkReader now returns an iterable rather than a chunk to prepare for the native histograms case. Also as a beneficial side effect, oooMergedChunk and boundedChunk has been simplified as they only need to implement the Iterable interface now, not the full Chunk interface. --------- Signed-off-by: Fiona Liao <fiona.y.liao@gmail.com> Co-authored-by: George Krajcsovits <krajorama@users.noreply.github.com>		1 year ago
..
agent	tsdb/agent: use Go standard errors package	1 year ago
chunkenc	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
chunks	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
docs	Merge branch 'main' into sparsehistogram	2 years ago
encoding	tsdb/encoding: use Go standard errors package	1 year ago
errors	tsdb/errors: fix errorlint linter	1 year ago
fileutil	tsdb/fileutil: use Go standard errors	1 year ago
goversion	lint: Adjust to the lint warnings raised by current versions of golint-ci	2 years ago
index	Merge pull request #13124 from mmorel-35/patch-5	1 year ago
record	Labels: reduce allocations when creating from TSDB WAL (#13044 )	1 year ago
testdata	…
tombstones	Update tombstones.go	1 year ago
tsdbutil	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
wlog	remplace errors.Errorf by fmt.Errorf	1 year ago
.gitignore	…
CHANGELOG.md	…
README.md	Fixed broken link in tsdb README.md	2 years ago
block.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
block_test.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
blockwriter.go	Merge 'main' into sparsehistogram	2 years ago
blockwriter_test.go	Add a chunk size limit in bytes (#12054 )	1 year ago
compact.go	remplace errors.Errorf by fmt.Errorf	1 year ago
compact_test.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
db.go	Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )	1 year ago
db_test.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
example_test.go	Add context argument to Querier.Select (#12660 )	1 year ago
exemplar.go	Fix error on ingesting out-of-order exemplars (#13021 )	1 year ago
exemplar_test.go	tsdb: in tests use labels.FromStrings	2 years ago
head.go	tsdb: seriesHashmap.set by making receiver a pointer (#13193 )	1 year ago
head_append.go	Fix panic during tsdb Commit (#13092 )	1 year ago
head_bench_test.go	Pass ref to SeriesLifecycleCallback.PostDeletion (#12626 )	1 year ago
head_read.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
head_read_test.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
head_test.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
head_wal.go	remplace errors.Errorf by fmt.Errorf	1 year ago
isolation.go	ci(lint): enable predeclared linter	2 years ago
isolation_test.go	tsdb: turn off transaction isolation for head compaction (#11317 )	2 years ago
mocks_test.go	Move packages out of deprecated pkg directory	3 years ago
ooo_head.go	Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )	1 year ago
ooo_head_read.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
ooo_head_read_test.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
ooo_head_test.go	ci(lint): enable godot; append dot at the end of comments	1 year ago
ooo_isolation.go	Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )	1 year ago
ooo_isolation_test.go	Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )	1 year ago
querier.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
querier_bench_test.go	ci(lint): enable nolintlint and remove redundant comments (#12926 )	1 year ago
querier_test.go	Change `ChunkReader.Chunk()` to `ChunkOrIterable()`	1 year ago
repair.go	remplace errors.Errorf by fmt.Errorf	1 year ago
repair_test.go	Add context argument to IndexReader.Postings (#12667 )	1 year ago
tsdbblockutil.go	Support FloatHistogram in TSDB (#11522 )	2 years ago
wal.go	remplace errors.Errorf by fmt.Errorf	1 year ago
wal_test.go	Add Zstandard compression option for wlog (#11666 )	1 year ago

README.md

TSDB

This directory contains the Prometheus TSDB (Time Series DataBase) library, which handles storage and querying of all Prometheus v2 data.

Documentation

External resources

A writeup of the original design can be found here.
Video: Storing 16 Bytes at Scale from PromCon 2017.
Compression is based on the Gorilla TSDB white paper.

A series of blog posts explaining different components of TSDB: