The Prometheus monitoring system and time series database.

prometheus hacktoberfest metrics alerting graphing monitoring time-series

Peter Štibraný ffc60d8397 Reduce chunk write queue memory usage 2 (#10874 ) * Job queue This PR reimplements chan chunkWriteJob with custom buffered queue that should use less memory, because it doesn't preallocate entire buffer for maximum queue size at once. Instead it allocates individual "segments" with smaller size. As elements are added to the queue, they fill individual segments. When elements are removed from the queue (and segments), empty segments can be thrown away. This doesn't change memory usage of the queue when it's full, but should decrease its memory footprint when it's empty (queue will keep max 1 segment in such case). Signed-off-by: Peter Štibraný <pstibrany@gmail.com> * Modify test to work with low resolution timer. Signed-off-by: Peter Štibraný <pstibrany@gmail.com> * Improve comments. Signed-off-by: Peter Štibraný <pstibrany@gmail.com>		2 years ago
..
agent	unit tests: make all Labels sorted alphabetically (#10532 )	3 years ago
chunkenc	Add SyncForState Implementation for Ruler HA (#10070 )	3 years ago
chunks	Reduce chunk write queue memory usage 2 (#10874 )	2 years ago
docs	Update godoc links and remove note about TSDB versioning (#10754 )	3 years ago
encoding	Format Go source files using 'gofumpt -w -s -extra'	3 years ago
errors	Address golint failures from revive	3 years ago
fileutil	Make necessary change to compile promql parser to wasm (#10683 )	3 years ago
goversion	Add new Go build tags.	3 years ago
index	Fix typo in symbol table size exceeded error message (#10746 )	3 years ago
record	Add basic initial developer docs for TSDB (#9451 )	3 years ago
test	Move packages out of deprecated pkg directory	3 years ago
testdata	…
tombstones	refactor: move from io/ioutil to io and os packages (#10528 )	3 years ago
tsdbutil	refactor: move from io/ioutil to io and os packages (#10528 )	3 years ago
wal	Remote Write: Rename confusing `walDir` parameter to `dir` (#10464 )	3 years ago
.gitignore	…
CHANGELOG.md	…
README.md	Update godoc links and remove note about TSDB versioning (#10754 )	3 years ago
block.go	fix typo (#10696 )	3 years ago
block_test.go	unit tests: make all Labels sorted alphabetically (#10532 )	3 years ago
blockwriter.go	refactor: move from io/ioutil to io and os packages (#10528 )	3 years ago
blockwriter_test.go	refactor: use `T.TempDir()` and `B.TempDir` to create temporary directory	3 years ago
compact.go	CompactBlockMetas should produce correct mint/maxt for overlapping blocks. (#10108 )	3 years ago
compact_test.go	refactor: use `T.TempDir()` and `B.TempDir` to create temporary directory	3 years ago
db.go	Don't increment prometheus_tsdb_compactions_failed_total when context is canceled (#10772 )	2 years ago
db_test.go	test(tsdb): break up repeated test to avoid timeout (#10671 )	3 years ago
example_test.go	refactor: move from io/ioutil to io and os packages (#10528 )	3 years ago
exemplar.go	tsdb: use simpler map key to improve exemplar ingest performance (#10111 )	3 years ago
exemplar_test.go	unit tests: make all Labels sorted alphabetically (#10532 )	3 years ago
head.go	fix(tsdb): inc mmap corruption counter on mmap out of sequence error (#10406 )	2 years ago
head_append.go	Fix chunk overflow appending samples at a variable rate (#10607 )	3 years ago
head_bench_test.go	refactor: use `T.TempDir()` and `B.TempDir` to create temporary directory	3 years ago
head_read.go	Label values with matchers by intersecting postings (#9907 )	3 years ago
head_test.go	unit tests: make all Labels sorted alphabetically (#10532 )	3 years ago
head_wal.go	tsdb: reduce sleep time when reading WAL (#10859 )	2 years ago
isolation.go	Add the ability to disable tsdb isolation (#9270 )	3 years ago
isolation_test.go	Add the ability to disable tsdb isolation (#9270 )	3 years ago
mocks_test.go	Move packages out of deprecated pkg directory	3 years ago
querier.go	Label values with matchers by intersecting postings (#9907 )	3 years ago
querier_bench_test.go	refactor: use `T.TempDir()` and `B.TempDir` to create temporary directory	3 years ago
querier_test.go	refactor: use `T.TempDir()` and `B.TempDir` to create temporary directory	3 years ago
repair.go	refactor: move from io/ioutil to io and os packages (#10528 )	3 years ago
repair_test.go	refactor: use `T.TempDir()` and `B.TempDir` to create temporary directory	3 years ago
tsdbblockutil.go	tsdb: commit data periodically in CreateBlock (#10788 )	2 years ago
wal.go	fix potential goroutine leaks	3 years ago
wal_test.go	refactor: move from io/ioutil to io and os packages (#10528 )	3 years ago

README.md

TSDB

This directory contains the Prometheus TSDB (Time Series DataBase) library, which handles storage and querying of all Prometheus v2 data.

Documentation

External resources

A writeup of the original design can be found here.
Video: Storing 16 Bytes at Scale from PromCon 2017.
Compression is based on the Gorilla TSDB white paper.

A series of blog posts explaining different components of TSDB: