The Prometheus monitoring system and time series database.

prometheus hacktoberfest metrics alerting graphing monitoring time-series

George Krajcsovits 00ab05c3b9 Native histograms: fix spurios counter reset when merging recoded chunk to normal chunk (#14513 ) * chunkenc: allow missing empty buckets on histogram append Allow appending to chunks when the histogram to be added is missing some buckets, but the missing buckets are empty in the chunk. For example bucket at index 5 is present in the chunk, but its value is 0 and the new histogram doesn't have a bucket at index 5. This fixes an issue of merging chunks where one chunk was recoded to retroactively have some empty buckets in all the histograms and we are merging in a histogram that doesn't have the empty bucket (because it was not recoded yet). The operation alters the histogram that is being added, however this has already been the case when appending gauge histograms. Thus the test TestHistogramSeriesToChunks in storage package is changed to explicitly test what happened to the appended histogram - Compact(0) call is removed. The new expandIntSpansAndBuckets and expandFloatSpansAndBuckets functions are a merge of expandSpansForward and counterResetInAnyBucket and counterResetInAnyFloatBucket. Signed-off-by: György Krajcsovits <gyorgy.krajcsovits@grafana.com>		4 months ago
..
agent	[PRW 2.0] Merging `remote-write-2.0` feature branch to main (PRW 2.0 support + metadata in WAL) (#14395 )	5 months ago
chunkenc	Native histograms: fix spurios counter reset when merging recoded chunk to normal chunk (#14513 )	4 months ago
chunks	TSDB: Simplify OOO Select by copying the head chunk (#14396 )	5 months ago
docs	Fix language in docs and comments (#14041 )	7 months ago
encoding	tsdb/encoding: use Go standard errors package	1 year ago
errors	Enable default revive rules (#13068 )	12 months ago
fileutil	tests: remove err from message when testify prints it already	10 months ago
goversion	remove obsolete build tag	10 months ago
index	Replace `ListPostings.Seek`'s binary search call by the generic `slices.BinarySearch` (#14393 )	5 months ago
record	Fix a couple of comments	5 months ago
testdata	tsdb: Delete blocks atomically; Remove tmp blocks on start; Added test. (#7772 )	4 years ago
tombstones	Update tombstones.go	1 year ago
tsdbutil	Ignore stale histograms for counter reset detection	4 months ago
wlog	Merge branch 'release-2.53' into merge-2.53.1	4 months ago
.gitignore	Moving tsdb into its own subdirectory	5 years ago
CHANGELOG.md	Rename default branch to main	4 years ago
README.md	Fixed broken link in tsdb README.md	2 years ago
block.go	tsdb: Extend compactor interface to allow compactions to create multiple output blocks (#14143 )	5 months ago
block_test.go	tsdb: Extend compactor interface to allow compactions to create multiple output blocks (#14143 )	5 months ago
blockwriter.go	tsdb: Extend compactor interface to allow compactions to create multiple output blocks (#14143 )	5 months ago
blockwriter_test.go	Add a chunk size limit in bytes (#12054 )	1 year ago
compact.go	TSDB: Change block populator to accept postings index function (#14213 )	5 months ago
compact_test.go	TSDB: Change block populator to accept postings index function (#14213 )	5 months ago
db.go	TSDB: rebuild labels symbol-table on each compaction	5 months ago
db_test.go	feat: add Google cloud roundtripper for remote write (#14346 )	4 months ago
example_test.go	Add context argument to Querier.Select (#12660 )	1 year ago
exemplar.go	[ENHANCEMENT] TSDB: Save map lookup on validation	6 months ago
exemplar_test.go	[Test] TSDB: BenchmarkResizeExemplar multiple per series	6 months ago
head.go	Revert the option regardless of error	4 months ago
head_append.go	Merge pull request #14438 from prometheus/cedwards/ooo-chunk-encoding	4 months ago
head_bench_test.go	tsdb: use Go standard errors	12 months ago
head_dedupelabels.go	tsdb: reset symbol table for exemplars periodically	5 months ago
head_other.go	TSDB: rebuild labels symbol-table on each compaction	5 months ago
head_read.go	Store mmMaxTime in same field as seriesShard	4 months ago
head_read_test.go	TSDB: Simplify OOO Select by copying the head chunk (#14396 )	5 months ago
head_test.go	Add BenchmarkLoadRealWLs	4 months ago
head_wal.go	Store mmMaxTime in same field as seriesShard	4 months ago
isolation.go	tsdb: create isolation transaction slice on demand	1 year ago
isolation_test.go	tsdb: turn off transaction isolation for head compaction (#11317 )	2 years ago
mocks_test.go	tsdb: use Go standard errors	12 months ago
ooo_head.go	Fix linting	4 months ago
ooo_head_read.go	Merge pull request #14438 from prometheus/cedwards/ooo-chunk-encoding	4 months ago
ooo_head_read_test.go	Fix test	5 months ago
ooo_head_test.go	ci(lint): enable godot; append dot at the end of comments	1 year ago
ooo_isolation.go	Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )	1 year ago
ooo_isolation_test.go	Fix issue where queries can fail or omit OOO samples if OOO head compaction occurs between creating a querier and reading chunks (#13115 )	1 year ago
querier.go	Pass limit param as hint to storage.Querier	5 months ago
querier_bench_test.go	Optimize label values with matchers by taking shortcuts (#13426 )	10 months ago
querier_test.go	Pass limit param as hint to storage.Querier	5 months ago
repair.go	tsdb: use Go standard errors	12 months ago
repair_test.go	tsdb tests: use go-cmp instead of DeepEquals	10 months ago
testutil.go	Testutil refactoring	5 months ago
tsdbblockutil.go	Optimize histogram iterators (#13340 )	10 months ago

README.md

TSDB

This directory contains the Prometheus TSDB (Time Series DataBase) library, which handles storage and querying of all Prometheus v2 data.

Documentation

External resources

A writeup of the original design can be found here.
Video: Storing 16 Bytes at Scale from PromCon 2017.
Compression is based on the Gorilla TSDB white paper.

A series of blog posts explaining different components of TSDB: