107 Commits (24a9f278d405201cb754c86721c2faa2a75327c5)

Author	SHA1	Message	Date
Bartek Plotka	fada85a83c	repair + compact: Improved logging for easier future debug purposes. ... This is based on my experience while debugging https://github.com/prometheus/prometheus/issues/3943. I needed to deduct few things, and all that would be just bit easier with these two logs: - new block's ULID on each compaction. - actual list of Blocks (ulid + time range) on Prometheus startup (easy to log that while repairing blocks). We don't really need blocks that takes part in compaction - that can be deducted easily based on time ranges of blocks we have currently in system. What do you think? Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	7 years ago
Bartek Plotka	328c0ff5b0	Simplified the flow and tests. ... Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	7 years ago
Bartek Plotka	483da43660	compact: Exclude last block with shortest range instead of newest one by ULID. ... Fixes https://github.com/prometheus/prometheus/issues/3943 issue. Added tests. Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	7 years ago
Fabian Reinartz	8cd32d8fd4	Improve usability of snapshots	7 years ago
Fabian Reinartz	d09283f60a	Add repair of bad index version	7 years ago
Goutham Veeramachaneni	6c62437101	Fix metric unit (#275) ... Fixes #274 Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Simon Pasquier	5d47710f8a	Fix panic on nil index writer	7 years ago
Shubheksha Jalan	44052bc937	Make version for index format configurable	7 years ago
Fabian Reinartz	1e55b7987f	Improve comments, handle allPostingsKey properly	7 years ago
Fabian Reinartz	7087f68647	Return new block ULID in compactor	7 years ago
Fabian Reinartz	67f0ca8f0e	Move index and chunk encoders to own packages	7 years ago
Goutham Veeramachaneni	f35e9c7fec	Merge branch 'master' into fix-dels ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Goutham Veeramachaneni	24ff293dc9	Merge pull request #207 from Gouthamve/compact-fail ... Don't retry failed compactions.	7 years ago
Fabian Reinartz	cf7f6108fd	Order postings lists in index file by key ... Aligning postings list for similar keys close to each other improves page cache hit rates in typical queries that select postings for multiple label pairs with the same name.	7 years ago
Goutham Veeramachaneni	1fc94a02d1	Don't retry failed compactions. ... Fixes prometheus/prometheus#3487 Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Goutham Veeramachaneni	1627a47640	A copy is being assigned newChunk not the original ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Fabian Reinartz	a031cf7424	Return ULID in Compactor	7 years ago
Fabian Reinartz	f1512a368a	Expose ChunkSeriesSet and lookups methods.	7 years ago
Fabian Reinartz	3ef4326114	Refactor tombstone reader types	7 years ago
ranbochen	a27cf34a36	fix bugs on platform windows to pass all test case. (#192) ... * fix bugs on platform windows to pass all test case. * fix bugs on platform windows to pass all test case * clean up codes	7 years ago
Fabian Reinartz	d17104f1f0	Prefix all metrics with `prometheus_*`	7 years ago
Fabian Reinartz	fb9da52b11	Add more verbose error handling for closing, reduce locking ... This commit introduces error returns in various places and is explicit about closing persisted blocks. {Index,Chunk,Tombstone}Readers are more consistent about their Close() method. Whenever a reader is retrieved, the corresponding close method must eventually be called. We use this to track pending readers against persisted blocks. Querier's against the DB no longer hold a read lock for their entire lifecycle. This avoids long running queriers to starve new ones when we have to acquire a write lock when reloading blocks.	7 years ago
Goutham Veeramachaneni	da565f975e	Merge pull request #161 from prometheus/fileutil ... Remove dependency on etcd/pkg/fileutil	7 years ago
Fabian Reinartz	f04ec031eb	compact: sync temporary directory	7 years ago
Fabian Reinartz	bbe72dccb9	Remove dependency on etcd/pkg/fileutil	7 years ago
Goutham Veeramachaneni	c35d3a65bd	Add levels to all log lines. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Fabian Reinartz	6ee254e353	Ensure postings are always sorted ... IDs for new series are handed out before the postings are locked. Thus series are not indexed in order of their IDs, which could result in only partially sorted postings list. Iterating over those silently skipped elements as the sort invariant was violated.	7 years ago
Fabian Reinartz	f904cd385f	Do not build a superflous 'all' postings	7 years ago
Fabian Reinartz	c36d574290	Replace single head lock with granular locks ... This adds various new locks to replace the single big lock on the head. All parts now must be COW as they may be held by clients after initial retrieval. Series by ID and hashes are now held in a stripe lock to reduce contention and total holding time during GC. This should reduce starvation of readers.	7 years ago
Fabian Reinartz	1ddedf2b30	Change series ID from uint32 to uint64	7 years ago
Fabian Reinartz	9f41d9fd3c	Instrument chunks on level 1 compactions	7 years ago
Fabian Reinartz	4cc37eecab	Refactor and add tests for compactor	7 years ago
Fabian Reinartz	3901b6e70b	Remove multiple heads ... This changes the structure to a single WAL backed by a single head block. Parts of the head block can be compacted. This relieves us from any head amangement and greatly simplifies any consistency and isolation concerns by just having a single head.	7 years ago
Goutham Veeramachaneni	7438ed7035	Expose Intervals type for use by TombstoneReader. ... TombstoneReader is exposed but Intervals is not. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Goutham Veeramachaneni	178f840295	Fix panic caused by 0 division ... Introduced in #108 Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Fabian Reinartz	905af27cf9	Refactor compactor	7 years ago
Fabian Reinartz	66ff7b12e9	Pool Chunk objects during compaction	7 years ago
Fabian Reinartz	2644c8665c	Don't allocate ChunkMetas, reuse postings slices	7 years ago
Fabian Reinartz	96d7f540d4	Persist series without allocating the full set ... Change index persistence for series to not be accumulated in memory before being written as one large batch. `Labels` and `ChunkMeta` objects are reused. This cuts down memory spikes during compaction of multiple blocks significantly. As part of the the Index{Reader,Writer} now have an explicit notion of symbols and series must be inserted in order.	7 years ago
Fabian Reinartz	3951d8cc29	Fix selection of compactable blocks	7 years ago
Fabian Reinartz	5d7b5994d6	Fix compaction range selection	7 years ago
Goutham Veeramachaneni	401bdfd4a6	Make Chunks return the number of samples inside ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Goutham Veeramachaneni	1263a68875	Recompact blocks with large number of tombstones ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Goutham Veeramachaneni	9a2ab732b5	Choose ranges by retention and min-block-duration ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Goutham Veeramachaneni	ce23adb579	Initial compaction implementation for block-ranges ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Fabian Reinartz	03f95ee096	Fix directory file descriptor leak.	8 years ago
Fabian Reinartz	05e411a8eb	Improve heuristic to spread chunks across block	8 years ago
Fabian Reinartz	f006e2d1ab	Merge pull request #92 from prometheus/sources ... Add list of source head blocks to meta.json	8 years ago
Fabian Reinartz	683b4c8c2a	Add list of source head blocks to meta.json	8 years ago
Goutham Veeramachaneni	a1c8425357	Initial implementation of HeadBlock Snapshots ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago