158 Commits (472c618c394247a898be1874ba5244ac6fedc9f1)

 

All Branches   

Search

Author	SHA1	Message	Date
Fabian Reinartz	472c618c39	Drop out-of-bound samples	8 years ago
Fabian Reinartz	d4779b374c	Properly track and write meta file	8 years ago
Fabian Reinartz	9ddbd64d00	Move stats into meta.json file, cleanup, docs	8 years ago
Fabian Reinartz	2f02f86b62	Fix WAL tests	8 years ago
Fabian Reinartz	e006bc6dc6	Improve error messages, create regular dir for block	8 years ago
Fabian Reinartz	d2322f6095	Improve compaction processing	8 years ago
Fabian Reinartz	5ceca3c810	Write to WAL before appending to memory storage	8 years ago
Fabian Reinartz	343dd9d94c	Fix wrong byte size in WAL base ref	8 years ago
Fabian Reinartz	5fb01d41aa	Use new Prometheus text format parser	8 years ago
Fabian Reinartz	dd0b69fe1b	Export ErrNotFound	8 years ago
Fabian Reinartz	9cf49f68e9	wal: use larger buffer	8 years ago
Fabian Reinartz	1c80c33e72	Fix bug of unsorted postings lists being created ... The former approach created unordered postings list by either map iteration of new series being unsorted (fixable) or concurrent writers creating new series interleaved. We switch back to generating ephemeral references for a single batch. Newly created series have to be re-set upon the next insert.	8 years ago
Fabian Reinartz	c7f5590a71	Ensure order of postings when adding new series	8 years ago
Fabian Reinartz	d970f0256a	Add Rollback() and docs to Appender interface	8 years ago
Fabian Reinartz	22db9c3413	Remove old appendBatch methods	8 years ago
Fabian Reinartz	fde69dab49	Use buffer pool for head appenders	8 years ago
Fabian Reinartz	a317f252b9	Expose series references to clients ... This exposes a reference number of a series represented by a label set to clients. Subsequent samples can be directly added via the reference rather than repeatedly passing in the full labels. This drasitcally speeds up the append process. The appender chain uses different sections of the reference number for assignment to child appenders and invalidating reference numbers as necessary. Clients can either pass out reference numbers themselves or have their own optimized lookup, i.e. by directly associating unparsed metric descriptors strings with reference numbers.	8 years ago
Fabian Reinartz	5e028710d5	Add fast past to validation after lock switch	8 years ago
Fabian Reinartz	1b39887baa	Revalidate series existance after lock switch	8 years ago
Fabian Reinartz	ca5791efbc	Simplify creation of new series	8 years ago
Fabian Reinartz	0ca755b4ae	Replace single head chunk per series with memSeries ... This adds a memory series holding several chunk to replace the single head chunk per series so far. This is necessary for uniform maximum chunk sizes in cases where some series have higher frequency samples than others.	8 years ago
Fabian Reinartz	80affd98a8	Add barrier to benchmark writer ... This adds a barrier to avoid issues with unfair goroutine scheduling that causes some fake scrapers to run away from the other ones.	8 years ago
Fabian Reinartz	c32a94d409	Unexport HeadBlock, export Block interface	8 years ago
Fabian Reinartz	d86e8a63c7	Report correct number of appended samples	8 years ago
Fabian Reinartz	29883a18fc	Add own Appender() method for DB	8 years ago
Fabian Reinartz	4c4e0c614e	Simplify position mapper updating	8 years ago
Fabian Reinartz	142c89b8b0	Fix/update metrics	8 years ago
Fabian Reinartz	0dffd52238	Use page writer in compaction	8 years ago
Fabian Reinartz	89d8467f5c	Add missing lock	8 years ago
Fabian Reinartz	8c31c6e934	Make concurrent head chunk reads safe, fix misc races ... This adds a 4 sample buffer to every head chunk. The XOR compression scheme may edit bytes in place. The minimum size of a sample is 2 bits. So keeping the last 4 samples in an in-memory buffer makes it safe to query the preceeding ones while samples are added	8 years ago
Fabian Reinartz	1943f8d1bb	Fix head block stats races	8 years ago
Fabian Reinartz	6aa922c5a6	Fix races	8 years ago
Fabian Reinartz	54f5027406	Put WAL lock down into encoder	8 years ago
Fabian Reinartz	300f4e2abf	Use separate lock for series creation ... This uses the head block's own lock to only lock if new series were encountered. In the general append case we just need to hold a	8 years ago
Fabian Reinartz	63e12807da	Don't update head postings mapper on every append	8 years ago
Fabian Reinartz	71efd2e08d	Periodically fsync WAL, make head cut async	8 years ago
Fabian Reinartz	c61b310210	Naive size-based compaction ... This adds naive compaction that tries to compact three blocks of roughly equal size. It decides based on samples present in a block and has no safety measures considering the actual file size.	8 years ago
Fabian Reinartz	2eb544c98e	Change file names and maker parsing safer	8 years ago
Fabian Reinartz	96c2bd249f	Handle compaction trigger and reinitializing in DB	8 years ago
Fabian Reinartz	3ed2c2a14b	Rename Partition to regular DB, DB to PartitionedDB	8 years ago
Fabian Reinartz	937cdb579c	Switch to sequential block names ... This changes block directory names from the int64 timestamp to sequential numbering.	8 years ago
Fabian Reinartz	4590b61343	Rename shard to partition	8 years ago
Fabian Reinartz	9790aa98ac	Add postings wrapper that emits head postings in label set order ... This adds a position mapper that takes series from a head block in the order they were appended and creates a mapping representing them in order of their label sets. Write-repair of the postings list would cause very expensive writing. Hence, we keep them as they are and only apply the postition mapping at the very end, after a postings list has been sufficienctly reduced through intersections etc.	8 years ago
Fabian Reinartz	5aa7f7cce8	Compact head block into persisted block	8 years ago
Fabian Reinartz	3f72d5d027	Fix last timestamp initialization ... This initializes the chunkDesc's last timestamp to the minimum value so initial samples with a timestamp of 0 (e.g. in tests) are not accidentally dropped.	8 years ago
Fabian Reinartz	40cf215fba	Hotfix missing sorting of head block series index	8 years ago
Fabian Reinartz	ec99f99d3d	Fix and test bug in shardSeriesSet	8 years ago
Fabian Reinartz	ac49f8c15e	Consolidate persistence and compaction	8 years ago
Fabian Reinartz	e7f04d14d5	Lock mmapped files	8 years ago
Fabian Reinartz	91b65b55e7	Run persistence in separate goroutine	8 years ago