107 Commits (24a9f278d405201cb754c86721c2faa2a75327c5)

Author	SHA1	Message	Date
Goutham Veeramachaneni	3a5ae6b1a4	Merge pull request #82 from Gouthamve/deletes-1 ... Implement deletions	8 years ago
Goutham Veeramachaneni	44e9ae38b5	Incorporate PR feedback. ... * Expose Stone as it is used in an exported method. * Move from tombstoneReader to []Stone for the same reason as above. * Make WAL reading a little cleaner. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	b3b9245ad6	Add and fix metrics	8 years ago
Goutham Veeramachaneni	6febabeb28	Final delete fixes. ... * Make sure no reads happen on the block when delete is in progress. * Fix bugs in compaction. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	f29fb62fba	Make TombstoneReader a Getter. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	244b73fce1	Rename for clarity and consistency. ... Misc. changes for code cleanliness. Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	8434019ad9	Merge branch 'master' into deletes-1 ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	0b70333ef6	Add tests for tombstones. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	3dbb400bef	Initial implementation of Delete on DB. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	7e6961b4ac	Fix import and var name	8 years ago
Fabian Reinartz	d2673d8659	Completely drop empty blocks	8 years ago
Fabian Reinartz	39df7e2bba	Switch blocks to ULID directories, drop sequenc numbers	8 years ago
Goutham Veeramachaneni	22c1b5b492	Make SeriesSets use tombstones. ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Goutham Veeramachaneni	5579efbd5b	Initial implentation of Deletes on persistedBlock ... Very much a WIP Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	8 years ago
Fabian Reinartz	778103b450	Add liecence file and headers	8 years ago
Fabian Reinartz	10c7c9acbe	Adjust import names to new repository organisation	8 years ago
Fabian Reinartz	789e8224ff	Fix wrong comparison in head block resorting	8 years ago
Fabian Reinartz	9c93f8f2aa	Fix various races ... This fixes different race condition encoutnered when running Prometheus. It reduces the overall performance in the synthetic benchmark a fair bit but has no indiciations of impacting a real-world setup notably.	8 years ago
Fabian Reinartz	3635569257	Trigger reload correctly on interrupted compaction	8 years ago
Fabian Reinartz	a8e8903350	Use ChunkMeta references for clarity ... This has been a common source of hard to debug issues. Its a premature and unbenchmarked optimization and semantically, we want ChunkMetas to be references in all changed cases.	8 years ago
Fabian Reinartz	04783831e2	Correctly close compacted blocks.	8 years ago
Fabian Reinartz	21b97d1e04	Fix compaction selection procedure	8 years ago
Fabian Reinartz	327e07e8d0	Properly sync moves and removes in compactor	8 years ago
Fabian Reinartz	92120448c2	Properly cleanup compacted dirs, fixes, docs	8 years ago
Fabian Reinartz	2c3e778d90	Compactor interface	8 years ago
Fabian Reinartz	2c3b56350a	Write meta.json file atomically	8 years ago
Fabian Reinartz	db5c88ea9a	Misc compaction fixes	8 years ago
Fabian Reinartz	306831f151	Add per-block state ULID	8 years ago
Fabian Reinartz	9a5dfadb09	Tweak IndexWriter interface, serialize directly into dir	8 years ago
Fabian Reinartz	78780cd2ba	Segment chunk file ... This adds write path support for segmented chunk data files. Files of 512MB are pre-allocated and written to. If the file size is exceeded, the next file is started. On completion, files are truncated to their final size.	8 years ago
Fabian Reinartz	a3b47c4929	Create default logger for DB	8 years ago
Fabian Reinartz	f734773214	Replace per-file locking with single PID lock file ... File locks have a multitude of problems that make them hard to use correctly. As they are just advisory, they are only meaningful to prevent accidents like running the same process twice. A simple PID file lock works reliably in those cases and is simpler.	8 years ago
Fabian Reinartz	c808928b90	SeriesWriter -> ChunkWriter ... This commit simplifies a SeriesWriter into a ChunkWriter and detaches it entirely from the notion of a series and the series index.	8 years ago
Fabian Reinartz	a61a31a5d7	compaction: add fast-path for compacting mem blocks	8 years ago
Fabian Reinartz	c20cc44b06	Add docs, write sequence number to meta.json	8 years ago
Fabian Reinartz	30d8866c13	Limit compaction range, make cut and compact concurrent	8 years ago
Fabian Reinartz	67d185ceb9	Compact based on compaction generation	8 years ago
Fabian Reinartz	d4779b374c	Properly track and write meta file	8 years ago
Fabian Reinartz	9ddbd64d00	Move stats into meta.json file, cleanup, docs	8 years ago
Fabian Reinartz	e006bc6dc6	Improve error messages, create regular dir for block	8 years ago
Fabian Reinartz	d2322f6095	Improve compaction processing	8 years ago
Fabian Reinartz	c32a94d409	Unexport HeadBlock, export Block interface	8 years ago
Fabian Reinartz	142c89b8b0	Fix/update metrics	8 years ago
Fabian Reinartz	1943f8d1bb	Fix head block stats races	8 years ago
Fabian Reinartz	c61b310210	Naive size-based compaction ... This adds naive compaction that tries to compact three blocks of roughly equal size. It decides based on samples present in a block and has no safety measures considering the actual file size.	8 years ago
Fabian Reinartz	96c2bd249f	Handle compaction trigger and reinitializing in DB	8 years ago
Fabian Reinartz	3ed2c2a14b	Rename Partition to regular DB, DB to PartitionedDB	8 years ago
Fabian Reinartz	4590b61343	Rename shard to partition	8 years ago
Fabian Reinartz	9790aa98ac	Add postings wrapper that emits head postings in label set order ... This adds a position mapper that takes series from a head block in the order they were appended and creates a mapping representing them in order of their label sets. Write-repair of the postings list would cause very expensive writing. Hence, we keep them as they are and only apply the postition mapping at the very end, after a postings list has been sufficienctly reduced through intersections etc.	8 years ago
Fabian Reinartz	5aa7f7cce8	Compact head block into persisted block	8 years ago
Fabian Reinartz	ac49f8c15e	Consolidate persistence and compaction	8 years ago
Fabian Reinartz	e7f04d14d5	Lock mmapped files	8 years ago
Fabian Reinartz	a648ef5252	Convert persister into function	8 years ago
Fabian Reinartz	dbd2b21d2e	Make persistence atomic	8 years ago
Fabian Reinartz	62b8ded0a5	Rename iterator value getters to At()	8 years ago
Fabian Reinartz	beb842a856	Change block interface ... This changes the block interface to directly expose index and series readers rather than the direct querier	8 years ago
Fabian Reinartz	5d75a3dc7b	Add basic compaction ... This adds a basic compactor that will merge two persisted blocks into one. It simply fully rewrites the index and concatenates the chunk lists. It just writes into the current working dir and doesn't properly handle which blocks to compact for now.	8 years ago