Commit Graph

216 Commits (4792d2bbd1d9113a5b653799b8e37ae949797dd6)

Author SHA1 Message Date
Goutham Veeramachaneni ce23adb579 Initial compaction implementation for block-ranges
7 years ago
Fabian Reinartz 1e74c155eb Return empty string to signal non-caching
8 years ago
Fabian Reinartz 3410559c1b Compact head block early
8 years ago
Fabian Reinartz 03f95ee096 Fix directory file descriptor leak.
8 years ago
Fabian Reinartz d4cb579443 Add DB.Dir method
8 years ago
Goutham Veeramachaneni ff4ccb6eb0
Remove unnecessary error from ToggleCompaction fns
8 years ago
Goutham Veeramachaneni 261cd9f393
Incorporate feedback.
8 years ago
Goutham Veeramachaneni a110a64abd
Add full Snapshot support
8 years ago
Goutham Veeramachaneni a1c8425357
Initial implementation of HeadBlock Snapshots
8 years ago
Goutham Veeramachaneni 3a5ae6b1a4 Merge pull request #82 from Gouthamve/deletes-1
8 years ago
Fabian Reinartz b3b9245ad6 Add and fix metrics
8 years ago
Goutham Veeramachaneni 6febabeb28
Final delete fixes.
8 years ago
Goutham Veeramachaneni 9bf7aa9af1
Misc. fixes incorporating feedback.
8 years ago
Goutham Veeramachaneni 8434019ad9
Merge branch 'master' into deletes-1
8 years ago
Goutham Veeramachaneni 0b70333ef6
Add tests for tombstones.
8 years ago
Goutham Veeramachaneni d32eb25662
Synchronise deletes and compactions.
8 years ago
Goutham Veeramachaneni 3dbb400bef
Initial implementation of Delete on DB.
8 years ago
Fabian Reinartz debfe9b1e5 Simplify AddFast and avoid errgroup Commits in general
8 years ago
Fabian Reinartz fb5c5535fc Misc cleanup
8 years ago
Fabian Reinartz 39df7e2bba Switch blocks to ULID directories, drop sequenc numbers
8 years ago
Fabian Reinartz 285bc07030 Switch append refs to string
8 years ago
Fabian Reinartz 8b51b7e2be Make WAL for HeadBlock composeable.
8 years ago
Fabian Reinartz 5534e6c53c Make HeadBlock impl public, make interface private
8 years ago
Fabian Reinartz 44769c1654 Allow disabling lock file
8 years ago
Fabian Reinartz 35b62f001e Change offset table layout, add TOC, ...
8 years ago
Fabian Reinartz 54a7b98cff Fix and test ref handling in DB appender
8 years ago
Brian Brazil d04bd947ea Merge pull request #51 from prometheus/rollback
8 years ago
Brian Brazil dba222b53c Make rollback actually rollback.
8 years ago
Fabian Reinartz 46c947d94f Merge pull request #45 from mattbostock/document_appender_not_goroutine_safe
8 years ago
Matt Bostock 4d5ca4b9c1 db: Fix typo: reference
8 years ago
Matt Bostock 3dd5a4ee09 db: Add comment: Appender not goroutine safe
8 years ago
Fabian Reinartz 778103b450 Add liecence file and headers
8 years ago
Fabian Reinartz 10c7c9acbe Adjust import names to new repository organisation
8 years ago
Fabian Reinartz 767b88a3a5 Parallelize commits to prevent deadlocks
8 years ago
Fabian Reinartz a52980e0a8 Add workaround for deadlocks
8 years ago
Fabian Reinartz e478d0e3bc Actually close olds blocks in reloadBlocks
8 years ago
Fabian Reinartz 70909ca8ad Ensure GC runs after each compactor call
8 years ago
Fabian Reinartz 55ee4b5b3b Merge branch 'master' of github.com:fabxc/tsdb
8 years ago
Fabian Reinartz c18e055d7c Fix races and add comments on remaining ones
8 years ago
Fabian Reinartz e837034360 Merge pull request #14 from Gouthamve/log-update
8 years ago
Fabian Reinartz 9c93f8f2aa Fix various races
8 years ago
Fabian Reinartz 3635569257 Trigger reload correctly on interrupted compaction
8 years ago
Fabian Reinartz 2c999836fb Add Queryable interface to Block
8 years ago
Fabian Reinartz 11be2cc585 Add composed Block interfaces, remove head generation
8 years ago
Goutham Veeramachaneni df7db4ac07
Update kit/log To New API
8 years ago
Fabian Reinartz 303a4ec3bc Sync directory on retention delation
8 years ago
Fabian Reinartz 863d38dfee Fix unreturned lock
8 years ago
Fabian Reinartz d0770302ed Add retention deletion
8 years ago
Fabian Reinartz 4962175218 Fix deadlock between heads and headmtx
8 years ago
Fabian Reinartz 65b846ae5b Remove unreturned locks, detect writes on closed heads
8 years ago
Fabian Reinartz 32c32013a6 Fix loading of persisted blocks
8 years ago
Fabian Reinartz cb4dde7659 Fix WAL log recovery bug
8 years ago
Fabian Reinartz 3910b913bd Revert interval overlap comparison changes
8 years ago
Fabian Reinartz 87805fb83f Remove Partitioned* code
8 years ago
Fabian Reinartz eedbebe1d7 Misc cleanups
8 years ago
Fabian Reinartz 50791a412e Remove leaky Appender abstraction for hashedAppend
8 years ago
Fabian Reinartz 87d270fe11 Fix interval check, make DB shutdown concurrent
8 years ago
Fabian Reinartz 04783831e2 Correctly close compacted blocks.
8 years ago
Fabian Reinartz 55a9b5428a Add separate head mutex
8 years ago
Fabian Reinartz 3e569bc964 Optimize memory allocations in writer
8 years ago
Fabian Reinartz ffb24a98f4 Add missing unlock, run debug endpoint in benchmark
8 years ago
Fabian Reinartz 92120448c2 Properly cleanup compacted dirs, fixes, docs
8 years ago
Fabian Reinartz 2c3e778d90 Compactor interface
8 years ago
Fabian Reinartz 2c3b56350a Write meta.json file atomically
8 years ago
Fabian Reinartz 6c4217276f Periodically trigger compaction
8 years ago
Fabian Reinartz db5c88ea9a Misc compaction fixes
8 years ago
Fabian Reinartz b281e4e39b Accept prometheus.Registerer in constructor
8 years ago
Fabian Reinartz 306831f151 Add per-block state ULID
8 years ago
Fabian Reinartz 78780cd2ba Segment chunk file
8 years ago
Fabian Reinartz a3b47c4929 Create default logger for DB
8 years ago
Fabian Reinartz f734773214 Replace per-file locking with single PID lock file
8 years ago
Fabian Reinartz 79944a5912 Break out WAL into segment files
8 years ago
Fabian Reinartz 987a90d149 Don't delete files if retention duration is 0
8 years ago
Fabian Reinartz 9c76624df2 Add initial retention cutoff
8 years ago
Fabian Reinartz f1435f2e2c Track appended samples properly in metric
8 years ago
Fabian Reinartz 012cf4ef25 Count writer references on head blocks
8 years ago
Fabian Reinartz 5a1c8eaa0e Fix missing appends after reference lookups
8 years ago
Fabian Reinartz f556036037 Close blocks before overwriting with compacted one
8 years ago
Fabian Reinartz ac5229e1b4 Correctly write empty blocks and extend appenders by new blocks
8 years ago
Fabian Reinartz 42fa342229 Improve multi-head handling
8 years ago
Fabian Reinartz 30efe4a58c Support writing to multiple head blocks
8 years ago
Fabian Reinartz a61a31a5d7 compaction: add fast-path for compacting mem blocks
8 years ago
Fabian Reinartz c20cc44b06 Add docs, write sequence number to meta.json
8 years ago
Fabian Reinartz 30d8866c13 Limit compaction range, make cut and compact concurrent
8 years ago
Fabian Reinartz 67d185ceb9 Compact based on compaction generation
8 years ago
Fabian Reinartz d4779b374c Properly track and write meta file
8 years ago
Fabian Reinartz 9ddbd64d00 Move stats into meta.json file, cleanup, docs
8 years ago
Fabian Reinartz e006bc6dc6 Improve error messages, create regular dir for block
8 years ago
Fabian Reinartz d2322f6095 Improve compaction processing
8 years ago
Fabian Reinartz 343dd9d94c Fix wrong byte size in WAL base ref
8 years ago
Fabian Reinartz dd0b69fe1b Export ErrNotFound
8 years ago
Fabian Reinartz 1c80c33e72 Fix bug of unsorted postings lists being created
8 years ago
Fabian Reinartz c7f5590a71 Ensure order of postings when adding new series
8 years ago
Fabian Reinartz d970f0256a Add Rollback() and docs to Appender interface
8 years ago
Fabian Reinartz 22db9c3413 Remove old appendBatch methods
8 years ago
Fabian Reinartz a317f252b9 Expose series references to clients
8 years ago
Fabian Reinartz c32a94d409 Unexport HeadBlock, export Block interface
8 years ago
Fabian Reinartz 29883a18fc Add own Appender() method for DB
8 years ago
Fabian Reinartz 142c89b8b0 Fix/update metrics
8 years ago
Fabian Reinartz 8c31c6e934 Make concurrent head chunk reads safe, fix misc races
8 years ago