49 Commits (643563068b778c498d369dd2fa00f6169e17890b)

Author	SHA1	Message	Date
Fabian Reinartz	e45bb1d328	Merge pull request #142 from krasi-georgiev/107-swap-cobra-with-kingpin ... replaced cobra with kingpin for the tsdb cli tool	7 years ago
Krasi Georgiev	92d0414993	replaced cobra with kingpin ... Signed-off-by: Krasi Georgiev <krasi.root@gmail.com>	7 years ago
Fabian Reinartz	6892fc6dcb	Finish old WAL segment async, default to no fsync ... We were still fsyncing while holding the write lock when we cut a new segment. Given we cannot do anything but logging errors, we might just as well complete segments asynchronously. There's not realistic use case where one would fsync after every WAL entry, thus make the default of a flush interval of 0 to never fsync which is a much more likely use case.	7 years ago
Fabian Reinartz	c36d574290	Replace single head lock with granular locks ... This adds various new locks to replace the single big lock on the head. All parts now must be COW as they may be held by clients after initial retrieval. Series by ID and hashes are now held in a stripe lock to reduce contention and total holding time during GC. This should reduce starvation of readers.	7 years ago
Fabian Reinartz	3951d8cc29	Fix selection of compactable blocks	7 years ago
Fabian Reinartz	9c4235532e	Fix compaction selection after creating new heads ... This fixes the case where between block creations no compaction plans are ran. We were not compacting anything in these cases since the on creation the most recent head block always had a high timestamp of 0.	7 years ago
Goutham Veeramachaneni	9a2ab732b5	Choose ranges by retention and min-block-duration ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Fabian Reinartz	05e411a8eb	Improve heuristic to spread chunks across block	8 years ago
Fabian Reinartz	39df7e2bba	Switch blocks to ULID directories, drop sequenc numbers	8 years ago
Fabian Reinartz	285bc07030	Switch append refs to string	8 years ago
Fabian Reinartz	c8438cfc81	Add mutex profiling to benchmark	8 years ago
Fabian Reinartz	778103b450	Add liecence file and headers	8 years ago
Fabian Reinartz	10c7c9acbe	Adjust import names to new repository organisation	8 years ago
Goutham Veeramachaneni	761e4768f3	Lint and Vet Fixes	8 years ago
Fabian Reinartz	87805fb83f	Remove Partitioned* code	8 years ago
Fabian Reinartz	cc0a7c8279	Create alloc and inuse space heap profile	8 years ago
Fabian Reinartz	ffb24a98f4	Add missing unlock, run debug endpoint in benchmark	8 years ago
Fabian Reinartz	db5c88ea9a	Misc compaction fixes	8 years ago
Fabian Reinartz	b281e4e39b	Accept prometheus.Registerer in constructor	8 years ago
Fabian Reinartz	a3b47c4929	Create default logger for DB	8 years ago
Fabian Reinartz	9c7a88223e	Add full encode/decode WAL cycle test	8 years ago
Fabian Reinartz	79944a5912	Break out WAL into segment files	8 years ago
Fabian Reinartz	9c76624df2	Add initial retention cutoff	8 years ago
Fabian Reinartz	012cf4ef25	Count writer references on head blocks	8 years ago
Fabian Reinartz	5a1c8eaa0e	Fix missing appends after reference lookups	8 years ago
Fabian Reinartz	30efe4a58c	Support writing to multiple head blocks ... This is an initial (and hacky) first pass on allowing appending to multiple blocks simultaniously to avoid dropping samples right after cutting a new head block. It's also required for cases like the PGW, where a scrape may contain varying timestamps.	8 years ago
Fabian Reinartz	c20cc44b06	Add docs, write sequence number to meta.json	8 years ago
Fabian Reinartz	5fb01d41aa	Use new Prometheus text format parser	8 years ago
Fabian Reinartz	fde69dab49	Use buffer pool for head appenders	8 years ago
Fabian Reinartz	a317f252b9	Expose series references to clients ... This exposes a reference number of a series represented by a label set to clients. Subsequent samples can be directly added via the reference rather than repeatedly passing in the full labels. This drasitcally speeds up the append process. The appender chain uses different sections of the reference number for assignment to child appenders and invalidating reference numbers as necessary. Clients can either pass out reference numbers themselves or have their own optimized lookup, i.e. by directly associating unparsed metric descriptors strings with reference numbers.	8 years ago
Fabian Reinartz	80affd98a8	Add barrier to benchmark writer ... This adds a barrier to avoid issues with unfair goroutine scheduling that causes some fake scrapers to run away from the other ones.	8 years ago
Fabian Reinartz	c32a94d409	Unexport HeadBlock, export Block interface	8 years ago
Fabian Reinartz	d86e8a63c7	Report correct number of appended samples	8 years ago
Fabian Reinartz	300f4e2abf	Use separate lock for series creation ... This uses the head block's own lock to only lock if new series were encountered. In the general append case we just need to hold a	8 years ago
Fabian Reinartz	c61b310210	Naive size-based compaction ... This adds naive compaction that tries to compact three blocks of roughly equal size. It decides based on samples present in a block and has no safety measures considering the actual file size.	8 years ago
Fabian Reinartz	3ed2c2a14b	Rename Partition to regular DB, DB to PartitionedDB	8 years ago
Fabian Reinartz	cabd7e4ebc	Add small testdata file	8 years ago
Fabian Reinartz	ede733ab6c	Extract labels package	8 years ago
Fabian Reinartz	ee217adc7e	Redfine append interface, remove old Prometheus storage from bench	8 years ago
Fabian Reinartz	e561c91d53	Implement proper buffered iterator ... This adds a proper duration based lookback buffer for series iterators to allow advancing sequentially while remaining able to calculate time aggregating functions such as `rate` backwards. It uses an array ring buffer to minimize heap allocations for potentially hundreds of thousands of series for a single query.	8 years ago
Fabian Reinartz	3a528c3078	Write plain postings list index	8 years ago
Fabian Reinartz	40a451694f	Refactor persistence into interfaces	8 years ago
Fabian Reinartz	74f8dfd95d	Persist blocks periodically	8 years ago
Fabian Reinartz	8aa99a3ebd	misc	8 years ago
Fabian Reinartz	63b887eb62	Add Makefile	8 years ago
Fabian Reinartz	b845f8d3a1	Reduce test data allocations	8 years ago
Fabian Reinartz	ce82bdb71a	Add write benchmark utility	8 years ago
Fabian Reinartz	ff29705571	Delete old benchmarking tool	8 years ago
Fabian Reinartz	40c27a1c2f	Add benchmark utility	8 years ago