29 Commits (6ca5e52b6927c1fb51426e894ca8264c0f1cce2c)

Author	SHA1	Message	Date
Fabian Reinartz	ea817e169b	Return nop iterator for invalid chunk references	7 years ago
Fabian Reinartz	905af27cf9	Refactor compactor	7 years ago
Fabian Reinartz	66ff7b12e9	Pool Chunk objects during compaction	7 years ago
Fabian Reinartz	96d7f540d4	Persist series without allocating the full set ... Change index persistence for series to not be accumulated in memory before being written as one large batch. `Labels` and `ChunkMeta` objects are reused. This cuts down memory spikes during compaction of multiple blocks significantly. As part of the the Index{Reader,Writer} now have an explicit notion of symbols and series must be inserted in order.	7 years ago
Goutham Veeramachaneni	401bdfd4a6	Make Chunks return the number of samples inside ... Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>	7 years ago
Julius Volz	0e2f8917ed	Also add original license info to bstream.go ... Plus, extend the messages a bit to mention the origin repo.	8 years ago
Fabian Reinartz	87676f4a26	Add dgryski/go-tsz LICENSE to header	8 years ago
Julius Volz	8d1fb4fa01	Minor comment fixes and additions.	8 years ago
Fabian Reinartz	778103b450	Add liecence file and headers	8 years ago
Goutham Veeramachaneni	761e4768f3	Lint and Vet Fixes	8 years ago
Fabian Reinartz	91b65b55e7	Run persistence in separate goroutine	8 years ago
Fabian Reinartz	62b8ded0a5	Rename iterator value getters to At()	8 years ago
Fabian Reinartz	5d75a3dc7b	Add basic compaction ... This adds a basic compactor that will merge two persisted blocks into one. It simply fully rewrites the index and concatenates the chunk lists. It just writes into the current working dir and doesn't properly handle which blocks to compact for now.	8 years ago
Fabian Reinartz	675f0886f0	Append to chunks cannot error	8 years ago
Fabian Reinartz	ce7f4106c2	Reda correct label number, fix buffered iterator panic	8 years ago
Fabian Reinartz	70a0224f19	Change chunk sample number to BigEndian	8 years ago
Fabian Reinartz	40a451694f	Refactor persistence into interfaces	8 years ago
Fabian Reinartz	b845f8d3a1	Reduce test data allocations	8 years ago
Fabian Reinartz	c5945177fb	chunks: helper for bit range	8 years ago
Fabian Reinartz	9b459458d0	Docs and interface definitions	8 years ago
Fabian Reinartz	0b6d621471	chunks: bring back lead/trail reuse, truncate incomplete sample	8 years ago
Fabian Reinartz	8c48dc2ca5	chunks: varint encoding in first full 64bit numbers ... This saves about 7 bytes per chunk	8 years ago
Fabian Reinartz	5e76fd3126	chunks: drop shift, remove branch ... This removes the need for the shift value and just calculates everything on the fly through count. Removes a branch condition.	8 years ago
Fabian Reinartz	c9ee572709	chunks: don't mutate in bstream iterator ... This replaces mutation of underlying bytes in the iterated slice with a shift counter, which is used when reading the head byte. This is avoids having to copy the entire slice for every new iterator.	8 years ago
Fabian Reinartz	f392c01c12	chunks: add randomized test	8 years ago
Fabian Reinartz	fa181a34c1	chunks: cleanup anything but xor encoding ... xor encoding is fast enough for our purposes and provides very good compression. We remove all other ones that partially don't support floats for the sake of simplicity.	8 years ago
Fabian Reinartz	e67cf768dc	chunks: remove intermeidate copy from xor chunk	8 years ago
Fabian Reinartz	7874d28f32	chunks: implement xor encoding	8 years ago
Fabian Reinartz	ae7b18ae34	Add chunk package	8 years ago