Commit Graph

916 Commits (8e659a51099fae08be3fb62f39fcef68ec6edec7)

Author SHA1 Message Date
Julius Volz f7e8348a88 Re-add contexts to storage.Storage.Querier() (#3230)
7 years ago
Fabian Reinartz 7b02bfee0a web: start web handler while TSDB is starting up
7 years ago
Fabian Reinartz d21f149745 *: migrate to go-kit/log
7 years ago
Fabian Reinartz 0efecea6d4 Adapt storage APIs to uint64 references
7 years ago
Fabian Reinartz 0c81d5f719 storage: instantiate correct block ranges
7 years ago
Fabian Reinartz 2037778d14 vendor: update TSDB
7 years ago
Tom Wilkie b11bc8ae24 Fix some comments.
7 years ago
Tom Wilkie ec999ff397 Prevent number of remote write shards from going negative.
7 years ago
Tom Wilkie a09acdcc5b Make concreteSeriersIterator behave.
7 years ago
Tom Wilkie 994a7f27d6 Propagate errors through mergeSeriesSet correctly.
7 years ago
Tom Wilkie 2e0d8487e3 Return zeros if At() is called after Next() returns false.
7 years ago
Tom Wilkie 014bd31a86 Remove unnecessary whitespace changes, add comment.
7 years ago
Tom Wilkie 98ac07f86a Add unit test for the merging on the read path.
7 years ago
Tom Wilkie b568ace7ce Move protos to ./prompb
7 years ago
Tom Wilkie 96e25adc8d Introduce 'primary' storage in fanout, and have Add return the ref from the primary.
7 years ago
Tom Wilkie db8128ceeb Add label set as first parameter to AddFast, ingored by TSDB adapter.
7 years ago
Tom Wilkie 2dda5775e3 Initial port of remote storage to v2.
7 years ago
Fabian Reinartz 16464c3a33 Merge pull request #2910 from prometheus/adminapi
7 years ago
Fabian Reinartz ccf9e62972 *: add admin grpc API
7 years ago
Goutham Veeramachaneni 243419c007 Return tsdb.ErrOutOfBounds as storage.ErrOutOfBounds
7 years ago
Goutham Veeramachaneni 3069bd3996 Handle scrapes with OutOfBounds metrics better
8 years ago
Goutham Veeramachaneni d407bd150c Consolidate the duration params in CLI
8 years ago
Goutham Veeramachaneni baf5b0f0fc Fix error where we look into the future. (#2829)
8 years ago
Brian Brazil c02c25d5ba Allow peeking back further in buffer.
8 years ago
Fabian Reinartz d289dc55c3 storage: update TSDB
8 years ago
Fabian Reinartz 9b175d48cb Add flag to disable TSDB lock file
8 years ago
Fabian Reinartz 0f3110487d Merge remote-tracking branch 'origin/dev-2.0' into dev-2.0
8 years ago
Fabian Reinartz 37deb21c45 vendor: remove unused dependency and last ref to fabxc/tsdb
8 years ago
Brian Brazil 5c9a6ce747 Add license to files.
8 years ago
Fabian Reinartz 8ffc851147 Merge branch 'master' into dev-2.0
8 years ago
Fabian Reinartz cfb2a7f1d5 vendor: sync organisation migration of tsdb
8 years ago
Fabian Reinartz bbcf20ba01 web: deduplicate series in federation
8 years ago
Fabian Reinartz 4e41987bcb storage: add deduplication function
8 years ago
Björn Rabenstein 50e4f49b7e Merge pull request #2561 from prometheus/beorn7/storage2
8 years ago
beorn7 08fc6cbd39 storage: Evict unused chunk.Descs in crash recovery
8 years ago
Björn Rabenstein 1c6240fc40 Merge pull request #2559 from prometheus/beorn7/storage
8 years ago
beorn7 d284ffab03 storage: Replace fpIter by sortedFPs
8 years ago
Tobias Schmidt eac36d123e Fix unstable fanin test (#2558)
8 years ago
Julius Volz 5a896033e3 Add remote read external label handling (#2555)
8 years ago
Björn Rabenstein e63d079b59 Merge pull request #2527 from prometheus/beorn7/storage
8 years ago
Julius Volz b5b0e00923 Merge pull request #2499 from prometheus/remote-read
8 years ago
beorn7 434ab2a6a3 storage: Evict chunks and calculate persistence pressure based on target heap size
8 years ago
beorn7 96a303b348 storage: Use staleness delta as head chunk timeout
8 years ago
Julius Volz 3f23aa2cc7 Add headers to indicate remote read/write version
8 years ago
Julius Volz 8fda83ea12 Make rules only read local data
8 years ago
Julius Volz 94acd3f1d8 Add fanin tests and fix uncovered bugs
8 years ago
Julius Volz 9b33cfc457 Fix/unify context-based remote storage timeouts
8 years ago
Julius Volz 815762a4ad Move retrieval.NewHTTPClient -> httputil.NewClientFromConfig
8 years ago
Fabian Reinartz 397f001ac5 Merge branch 'master' into dev-2.0
8 years ago
Julius Volz eb14678a25 Make remote read/write use config.HTTPClientConfig
8 years ago
Julius Volz 406b65d0dc Rename remote.Storage to remote.Writer
8 years ago
Julius Volz 02395a224d [WIP] Remote Read
8 years ago
Julius Volz 40e41a4776 Merge pull request #2494 from tomwilkie/remote-write-sharding
8 years ago
Fabian Reinartz b586781283 *: update tsdb vendoring and add retention flag
8 years ago
beorn7 48d221c11e storage: Fix typo in comment
8 years ago
Fabian Reinartz 0ecd205794 promql: Use buffer pool for matrix allocations
8 years ago
Tom Wilkie 75bb0f3253 Review feedback
8 years ago
Tom Wilkie 77cce900b8 Fix tests
8 years ago
Tom Wilkie b48799a01e Add license stanza
8 years ago
Tom Wilkie 9d22f030cf Dynamically reshard the QueueManager based on observed load.
8 years ago
Fabian Reinartz 8a8eb12985 storage/tsdb: don't use partitioned DB.
8 years ago
Fabian Reinartz 9eb1d6c927 remote: take code from master
8 years ago
Fabian Reinartz 9304179ef7 Merge branch 'master' into dev-2.0
8 years ago
Fabian Reinartz 4397b4d508 *: pass Prometheus registry into storage
8 years ago
Tom Wilkie 1ab893c6ec Limit 'discarding sample' logs to 1 every 10s (#2446)
8 years ago
Julius Volz 2f39dbc8b3 Rename StorageQueueManager -> QueueManager
8 years ago
Julius Volz e9476b35d5 Re-add multiple remote writers
8 years ago
Björn Rabenstein 089dc1076b Merge pull request #2435 from jmeulemans/open-chunks-gauge
8 years ago
Jeremy Meulemans 025c828976 Changed to open_head_chunks to address review.
8 years ago
Jeremy Meulemans 074050b8c0 Updating for failed codeclimate check.
8 years ago
Jeremy Meulemans f70b52d0b6 Adding gauge for number of open head chunks.
8 years ago
Julius Volz beb3c4b389 Remove legacy remote storage implementations
8 years ago
beorn7 d771185a43 storage: Fix chunkIndexToStartSeek calculation
8 years ago
beorn7 73bd5e4dff Merge branch 'beorn7/storage' into beorn7/storage3
8 years ago
beorn7 46a0837816 storage: Fix offset returned by dropAndPersistChunks
8 years ago
beorn7 9d12204da5 Merge branch 'release-1.5'
8 years ago
beorn7 bed4934224 storage: One more persist error code path discovered
8 years ago
beorn7 242d8edcb5 Merge branch 'release-1.5'
8 years ago
beorn7 8c8baaa558 storage: writeMemorySeries needs to return true for quarantined series
8 years ago
Mitsuhiro Tanda be8b1eb656 storage: optimize dropping chunks by using minShrinkRatio (#2397)
8 years ago
beorn7 2363a90adc storage: Do not throw away fully persisted memory series in checkpointing
8 years ago
Fabian Reinartz ea3ba338dd main: add flags for new storage
8 years ago
beorn7 244a65fb29 storage: Increase persist watermark before calling append
8 years ago
beorn7 75282b27ba storage: Added checks for invariants
8 years ago
beorn7 31e9db7f0c storage: Simplify evictChunkDesc method
8 years ago
Fabian Reinartz 5772f1a7ba retrieval/storage: adapt to new interface
8 years ago
beorn7 65dc8f44d3 storage: Test for errors returned by MaybePopulateLastTime
8 years ago
beorn7 752fac60ae storage: Remove race condition from TestLoop
8 years ago
beorn7 4ccfc93dcf storage: Set shrink ratio in the constructor.
8 years ago
beorn7 b2f086c6c4 storage: Expose bug of not setting the shrink ratio in the contstructor
8 years ago
Brian Brazil c1b547a90e Only checkpoint chunkdescs and series that need persisting. (#2340)
8 years ago
Fabian Reinartz c691895a0f retrieval: cache series references, use pkg/textparse
8 years ago
Brian Brazil f64c231dad Allow checkpoints and maintenance to happen concurrently. (#2321)
8 years ago
Fabian Reinartz ad9bc62e4c storage: extend appender and adapt it
8 years ago
Brian Brazil 1dcb7637f5 Add various persistence related metrics (#2333)
8 years ago
Fabian Reinartz 304cae9928 tsdb: Use PartitionedDB constructor
8 years ago
Brian Brazil f9e581907a Make index queue bigger. (#2322)
8 years ago
Fabian Reinartz bc20d93f0a storage: rename iterator value getters to At()
8 years ago
Fabian Reinartz 7322c46b8e storage: add mock iterator for test
8 years ago
Fabian Reinartz f8fc1f5bb2 *: migrate ingestion to new batch Appender
8 years ago
Fabian Reinartz 71fe0c58a8 promql: misc fixes
8 years ago
Mitsuhiro Tanda 7e369b9318 expose max memory chunks metrics (#2303)
8 years ago
Fabian Reinartz fecf9532b9 *: fix misc compile errors
8 years ago
Fabian Reinartz 622ece6273 *: fix recording tests, migrate matcher types
8 years ago
Fabian Reinartz 0492ddbd4d *: fully decouple tsdb, add new storage interfaces
8 years ago
Fabian Reinartz d17b5be48a storage/metric: remove package
8 years ago
Fabian Reinartz 8b84ee5ee6 storage: remove old storage
8 years ago
Fabian Reinartz 11a731ba82 remote: remove hard-coded remote storages
8 years ago
Brian Brazil 93b70ee4ea Evict chunk descs of all unloaded chunks during maintenance. (#2297)
8 years ago
Brian Brazil 1b8a474612 Don't clone the metric if there's no remote writes.
8 years ago
Tristan Colgate 30be8e0b8a ignore dotfiles in data directory
8 years ago
Björn Rabenstein 45570e5972 Merge pull request #2277 from prometheus/beorn7/storage2
8 years ago
beorn7 253be23c00 storage: Sanity-check number of loaded chunk descs
8 years ago
Björn Rabenstein 5f0c0e43cf Merge pull request #2276 from prometheus/beorn7/storage
8 years ago
beorn7 837c029b16 storage: Fix linter issue
8 years ago
beorn7 4719482f5f storage: Make tests go-vet and golint clean
8 years ago
beorn7 485ac8dff7 storage: Verify validity of byte length when unmarshalling (double)delta chunks
8 years ago
tattsun e714079cf2 storage: fix error message (#2270)
8 years ago
Christopher M. Luciano 148b006e25 Clarify error message when Prometheus data dir finds unexpected files
8 years ago
Julius Volz 127332c56f Merge pull request #2168 from tomwilkie/chunk-len
8 years ago
Tom Wilkie 585878cdb2 Add call to estimate number of samples in a chunk to the API
8 years ago
Björn Rabenstein 036715370f Merge pull request #2184 from huydx/master
8 years ago
huydx c999902761 Fix possible memory leak by defer inside loop
8 years ago
Fabian Reinartz 856de30c09 Check error before defer closing
8 years ago
Fabian Reinartz 6703404cb4 Merge remote-tracking branch 'origin/release-1.2'
8 years ago
beorn7 c5bd178b93 Protect exported Querier interface method against negative time ranges
8 years ago
beorn7 5b16d6bd6e Merge branch 'release-1.2'
8 years ago
beorn7 876e5da4f8 Add guard against non-monotonic samples in series
8 years ago
Dominik Schulz 182e17958a Trivial spelling corrections and a small comment.
8 years ago
Fabian Reinartz 8fa18d564a storage: enhance Querier interface usage
8 years ago
beorn7 719508752b Re-add counting of evict chunk ops and decrementing NumMemChunks
8 years ago
Julius Volz cb02f017ee Clean up some doc comments
8 years ago
Julius Volz c212ef0326 Add Chunk.Utilization() methods
8 years ago
Julius Volz c7932aa009 Remove gRPC leftovers in protobuf definitions
8 years ago
Björn Rabenstein 1e2f03f668 Merge pull request #2005 from redbaron/microoptimise-matching
8 years ago
Maxim Ivanov e6db9f8159 New fpsForLabelMatchers and seriesForLabelMatchers methods
8 years ago
Brian Brazil 6e8f87a37f Merge pull request #2047 from prometheus/write-relabel
8 years ago
Brian Brazil 77605649a9 Add support for remote write relabelling.
8 years ago
Julius Volz c9d4526428 Unpublish accidentally published series methods
8 years ago
Maxim Ivanov 4978a65495 Extract initial FP candidate build logic into candidateFPsForLabelMatchers method
8 years ago
Maxim Ivanov c048a0cde8 Add metrics to result after checking all matchers
8 years ago
Maxim Ivanov bedc0eda1f Added BenchmarkQueryRange
8 years ago
Julius Volz c25f0de5ae Remove local.ZeroSample{,Pair}, use model definitions
8 years ago
Julius Volz 044ebce779 Review fixups.
8 years ago
Julius Volz d30a3c7c0f Fix accidental publishing of memorySeries.firstTime()
8 years ago
Julius Volz ab80ced756 storage: separate chunk package, publish more names
8 years ago
Julius Volz 42c05dd3a2 Merge pull request #2011 from mattkanwisher/chuck-public
8 years ago
beorn7 ca98382943 Avoid `defer` in seriesMap.get
8 years ago
Matthew Campbell 67d76e3a5d timeseries: store varbit encoded data into cassandra
8 years ago
Tom Wilkie 4520e12440 Add HTTP Basic Auth & TLS support to the generic write path. (#1957)
8 years ago