97 Commits (70909ca8ad875aa6f01e1801d185b3f3bab2fda3)

Author	SHA1	Message	Date
Fabian Reinartz	789e8224ff	Fix wrong comparison in head block resorting	8 years ago
Fabian Reinartz	55ee4b5b3b	Merge branch 'master' of github.com:fabxc/tsdb	8 years ago
Fabian Reinartz	c18e055d7c	Fix races and add comments on remaining ones	8 years ago
Fabian Reinartz	e837034360	Merge pull request #14 from Gouthamve/log-update ... Update kit/log To New API	8 years ago
Fabian Reinartz	9c93f8f2aa	Fix various races ... This fixes different race condition encoutnered when running Prometheus. It reduces the overall performance in the synthetic benchmark a fair bit but has no indiciations of impacting a real-world setup notably.	8 years ago
Fabian Reinartz	3635569257	Trigger reload correctly on interrupted compaction	8 years ago
Fabian Reinartz	2c999836fb	Add Queryable interface to Block ... This adds the Queryable interface to the Block interface. Head and persisted blocks now implement their own Querier() method and thus isolate customization (e.g. remapPostings) more cleanly.	8 years ago
Fabian Reinartz	11be2cc585	Add composed Block interfaces, remove head generation ... This adds more lower-leve interfaces which are used to compose to different Block interfaces. The DB only uses interfaces instead of explicit persistedBlock and headBlock. The headBlock generation property is dropped as the use-case can be implemented using block sequence numbers.	8 years ago
Goutham Veeramachaneni	df7db4ac07	Update kit/log To New API ... NewContext has been removed couple of weeks back. Ref: https://github.com/go-kit/kit/releases/tag/v0.4.0	8 years ago
Fabian Reinartz	65b846ae5b	Remove unreturned locks, detect writes on closed heads	8 years ago
Fabian Reinartz	e0b33a7a28	Remove leftover signaling channels from headBlock	8 years ago
Fabian Reinartz	34efe4e2c8	Drop position mapper from head block ... The position mapper was intended to pre-computed "expensive" ordering of label sets. It was expensive to update and caused a lot of trouble. Skipping this optimization entirely actually revelead it was pointless and even harmful from the e2e perspective.	8 years ago
Fabian Reinartz	ad5812d83a	Handle WAL corruption by truncating ... This adds handling for various corruption scenarios of the WAL. If corruption is encountered, we truncate the WAL after the last valid entry transparently and continue appending after the offset.	8 years ago
Fabian Reinartz	a8e8903350	Use ChunkMeta references for clarity ... This has been a common source of hard to debug issues. Its a premature and unbenchmarked optimization and semantically, we want ChunkMetas to be references in all changed cases.	8 years ago
Fabian Reinartz	e825a0b40c	Make mapper updates asynchronous	8 years ago
Fabian Reinartz	cb4dde7659	Fix WAL log recovery bug ... This fixes a bug where the last WAL file was closed after consuming it instead of being left open for further writes. Reloading of blocks on startup considers loading head blocks now.	8 years ago
Fabian Reinartz	87805fb83f	Remove Partitioned* code	8 years ago
Fabian Reinartz	50791a412e	Remove leaky Appender abstraction for hashedAppend	8 years ago
Fabian Reinartz	55a9b5428a	Add separate head mutex ... Introduce a seperate mutex for the head blocks to avoid a race where a post-compaction reload may run between switching the DB's base mutex to create a new head block in an appender.	8 years ago
Fabian Reinartz	92120448c2	Properly cleanup compacted dirs, fixes, docs	8 years ago
Fabian Reinartz	2c3e778d90	Compactor interface	8 years ago
Fabian Reinartz	306831f151	Add per-block state ULID	8 years ago
Fabian Reinartz	78780cd2ba	Segment chunk file ... This adds write path support for segmented chunk data files. Files of 512MB are pre-allocated and written to. If the file size is exceeded, the next file is started. On completion, files are truncated to their final size.	8 years ago
Fabian Reinartz	a3d042b54e	Support multiple chunk files in read path	8 years ago
Fabian Reinartz	9c7a88223e	Add full encode/decode WAL cycle test	8 years ago
Fabian Reinartz	f1435f2e2c	Track appended samples properly in metric	8 years ago
Fabian Reinartz	012cf4ef25	Count writer references on head blocks	8 years ago
Fabian Reinartz	5a1c8eaa0e	Fix missing appends after reference lookups	8 years ago
Fabian Reinartz	ac5229e1b4	Correctly write empty blocks and extend appenders by new blocks	8 years ago
Fabian Reinartz	30efe4a58c	Support writing to multiple head blocks ... This is an initial (and hacky) first pass on allowing appending to multiple blocks simultaniously to avoid dropping samples right after cutting a new head block. It's also required for cases like the PGW, where a scrape may contain varying timestamps.	8 years ago
Fabian Reinartz	c20cc44b06	Add docs, write sequence number to meta.json	8 years ago
Fabian Reinartz	472c618c39	Drop out-of-bound samples	8 years ago
Fabian Reinartz	d4779b374c	Properly track and write meta file	8 years ago
Fabian Reinartz	9ddbd64d00	Move stats into meta.json file, cleanup, docs	8 years ago
Fabian Reinartz	5ceca3c810	Write to WAL before appending to memory storage	8 years ago
Fabian Reinartz	343dd9d94c	Fix wrong byte size in WAL base ref	8 years ago
Fabian Reinartz	5fb01d41aa	Use new Prometheus text format parser	8 years ago
Fabian Reinartz	dd0b69fe1b	Export ErrNotFound	8 years ago
Fabian Reinartz	1c80c33e72	Fix bug of unsorted postings lists being created ... The former approach created unordered postings list by either map iteration of new series being unsorted (fixable) or concurrent writers creating new series interleaved. We switch back to generating ephemeral references for a single batch. Newly created series have to be re-set upon the next insert.	8 years ago
Fabian Reinartz	c7f5590a71	Ensure order of postings when adding new series	8 years ago
Fabian Reinartz	d970f0256a	Add Rollback() and docs to Appender interface	8 years ago
Fabian Reinartz	22db9c3413	Remove old appendBatch methods	8 years ago
Fabian Reinartz	fde69dab49	Use buffer pool for head appenders	8 years ago
Fabian Reinartz	a317f252b9	Expose series references to clients ... This exposes a reference number of a series represented by a label set to clients. Subsequent samples can be directly added via the reference rather than repeatedly passing in the full labels. This drasitcally speeds up the append process. The appender chain uses different sections of the reference number for assignment to child appenders and invalidating reference numbers as necessary. Clients can either pass out reference numbers themselves or have their own optimized lookup, i.e. by directly associating unparsed metric descriptors strings with reference numbers.	8 years ago
Fabian Reinartz	5e028710d5	Add fast past to validation after lock switch	8 years ago
Fabian Reinartz	1b39887baa	Revalidate series existance after lock switch	8 years ago
Fabian Reinartz	ca5791efbc	Simplify creation of new series	8 years ago
Fabian Reinartz	0ca755b4ae	Replace single head chunk per series with memSeries ... This adds a memory series holding several chunk to replace the single head chunk per series so far. This is necessary for uniform maximum chunk sizes in cases where some series have higher frequency samples than others.	8 years ago
Fabian Reinartz	c32a94d409	Unexport HeadBlock, export Block interface	8 years ago
Fabian Reinartz	d86e8a63c7	Report correct number of appended samples	8 years ago