87 Commits (9e999e8b0b2427946a0f37301a6872286b373f56)

Author	SHA1	Message	Date
Fabian Reinartz	04783831e2	Correctly close compacted blocks.	8 years ago
Fabian Reinartz	21b97d1e04	Fix compaction selection procedure	8 years ago
Fabian Reinartz	327e07e8d0	Properly sync moves and removes in compactor	8 years ago
Fabian Reinartz	92120448c2	Properly cleanup compacted dirs, fixes, docs	8 years ago
Fabian Reinartz	2c3e778d90	Compactor interface	8 years ago
Fabian Reinartz	2c3b56350a	Write meta.json file atomically	8 years ago
Fabian Reinartz	db5c88ea9a	Misc compaction fixes	8 years ago
Fabian Reinartz	306831f151	Add per-block state ULID	8 years ago
Fabian Reinartz	9a5dfadb09	Tweak IndexWriter interface, serialize directly into dir	8 years ago
Fabian Reinartz	78780cd2ba	Segment chunk file ... This adds write path support for segmented chunk data files. Files of 512MB are pre-allocated and written to. If the file size is exceeded, the next file is started. On completion, files are truncated to their final size.	8 years ago
Fabian Reinartz	a3b47c4929	Create default logger for DB	8 years ago
Fabian Reinartz	f734773214	Replace per-file locking with single PID lock file ... File locks have a multitude of problems that make them hard to use correctly. As they are just advisory, they are only meaningful to prevent accidents like running the same process twice. A simple PID file lock works reliably in those cases and is simpler.	8 years ago
Fabian Reinartz	c808928b90	SeriesWriter -> ChunkWriter ... This commit simplifies a SeriesWriter into a ChunkWriter and detaches it entirely from the notion of a series and the series index.	8 years ago
Fabian Reinartz	a61a31a5d7	compaction: add fast-path for compacting mem blocks	8 years ago
Fabian Reinartz	c20cc44b06	Add docs, write sequence number to meta.json	8 years ago
Fabian Reinartz	30d8866c13	Limit compaction range, make cut and compact concurrent	8 years ago
Fabian Reinartz	67d185ceb9	Compact based on compaction generation	8 years ago
Fabian Reinartz	d4779b374c	Properly track and write meta file	8 years ago
Fabian Reinartz	9ddbd64d00	Move stats into meta.json file, cleanup, docs	8 years ago
Fabian Reinartz	e006bc6dc6	Improve error messages, create regular dir for block	8 years ago
Fabian Reinartz	d2322f6095	Improve compaction processing	8 years ago
Fabian Reinartz	c32a94d409	Unexport HeadBlock, export Block interface	8 years ago
Fabian Reinartz	142c89b8b0	Fix/update metrics	8 years ago
Fabian Reinartz	1943f8d1bb	Fix head block stats races	8 years ago
Fabian Reinartz	c61b310210	Naive size-based compaction ... This adds naive compaction that tries to compact three blocks of roughly equal size. It decides based on samples present in a block and has no safety measures considering the actual file size.	8 years ago
Fabian Reinartz	96c2bd249f	Handle compaction trigger and reinitializing in DB	8 years ago
Fabian Reinartz	3ed2c2a14b	Rename Partition to regular DB, DB to PartitionedDB	8 years ago
Fabian Reinartz	4590b61343	Rename shard to partition	8 years ago
Fabian Reinartz	9790aa98ac	Add postings wrapper that emits head postings in label set order ... This adds a position mapper that takes series from a head block in the order they were appended and creates a mapping representing them in order of their label sets. Write-repair of the postings list would cause very expensive writing. Hence, we keep them as they are and only apply the postition mapping at the very end, after a postings list has been sufficienctly reduced through intersections etc.	8 years ago
Fabian Reinartz	5aa7f7cce8	Compact head block into persisted block	8 years ago
Fabian Reinartz	ac49f8c15e	Consolidate persistence and compaction	8 years ago
Fabian Reinartz	e7f04d14d5	Lock mmapped files	8 years ago
Fabian Reinartz	a648ef5252	Convert persister into function	8 years ago
Fabian Reinartz	dbd2b21d2e	Make persistence atomic	8 years ago
Fabian Reinartz	62b8ded0a5	Rename iterator value getters to At()	8 years ago
Fabian Reinartz	beb842a856	Change block interface ... This changes the block interface to directly expose index and series readers rather than the direct querier	8 years ago
Fabian Reinartz	5d75a3dc7b	Add basic compaction ... This adds a basic compactor that will merge two persisted blocks into one. It simply fully rewrites the index and concatenates the chunk lists. It just writes into the current working dir and doesn't properly handle which blocks to compact for now.	8 years ago