Ganesh Vernekar
7469719dc8
cut 0.10.0
...
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
5 years ago
Krasi Georgiev
6f9bbc7253
Open db in Read only mode ( #588 )
...
* Added db read only open mode and use it for the tsdb cli.
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
5 years ago
Frederic Branczyk
aea611afed
*: Cut v2.11.1
...
Signed-off-by: Frederic Branczyk <fbranczyk@gmail.com>
5 years ago
Ganesh Vernekar
b1cd829030
Reuse Chunk Iterator ( #642 )
...
* Reset method for chunkenc.Iterator
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Reset method only for XORIterator
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Use Reset(...) in querier.go
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Reuse deletedIterator
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Another way of reusing chunk iterators
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Unexport xorIterator
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix memSeries.iterator(...)
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Add some comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
5 years ago
Frederic Branczyk
2c1a58ee13
*: cut v2.11.0
...
Signed-off-by: Frederic Branczyk <fbranczyk@gmail.com>
5 years ago
Frederic Branczyk
dc37d3d729
Cut v2.11.0-rc.0
...
Signed-off-by: Frederic Branczyk <fbranczyk@gmail.com>
5 years ago
Frederic Branczyk
078895bf56
wal: Inject LiveReader metrics rather than registry
...
LiveReaders are instantiated `number of remote write queues * segments`
times, which would cause double registration of the metrics. Instead
this should be orchestrated by the layer above, instantiating the live
reader.
Signed-off-by: Frederic Branczyk <fbranczyk@gmail.com>
5 years ago
Bartek Płotka
7ef10186b4
Added missing entries to CHANGELOG for 0.9.0 ( #648 )
...
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
5 years ago
Bartek Płotka
a272e7ec60
Cut TSDB release 0.9.0 ( #647 )
...
Added newline as it is requires for some markdown renderers.
Signed-off-by: Bartek Plotka <bwplotka@gmail.com>
5 years ago
Krasi Georgiev
31f7990d1d
Re-encode chunks that are still being appended to when snapshoti… ( #641 )
...
* re encode all head chunks outside the time range.
Signed-off-by: Krasi Georgiev <8903888+krasi-georgiev@users.noreply.github.com>
5 years ago
Krasi Georgiev
8d86e921cf
refactor block size calculation ( #637 )
...
* refactor block size calculation
The block size is kept in memory and not in the meta file anymore.
It now includes the size of the meta file itself for a more
correct block size.
It fixes a bug where the size didn't change when calling `block.Delete()`.
Adds a dedicated test to ensure correct block sizes.
This allows opening a db in a read only mode as it doesn't write to the meta file anymore.
Signed-off-by: Krasi Georgiev <8903888+krasi-georgiev@users.noreply.github.com>
5 years ago
Chris Marchbanks
b40cc43958
Provide option to compress WAL records ( #609 )
...
In running Prometheus instances, compressing the records was shown to
reduce disk usage by half while incurring a negligible CPU cost.
Signed-off-by: Chris Marchbanks <csmarchbanks@gmail.com>
6 years ago
beorn7
2a5b7f9156
Promote rc.0 to final v2.10.0
...
Signed-off-by: beorn7 <bjoern@rabenste.in>
6 years ago
beorn7
2f0a929126
Cut v2.10.0-rc.0
...
Signed-off-by: beorn7 <bjoern@rabenste.in>
6 years ago
Krasi Georgiev
d48a5e2d5c
Release 0.8.0 ( #607 )
...
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Goutham Veeramachaneni
2ae028114c
Add FromData function (again)! ( #600 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Krasi Georgiev
5512826f13
make Close methods for the querier safe to call more than once. ( #581 )
...
* make Close methods for the querier safe to call more than once.
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Brian Brazil
cdc2ad05ef
Cut 2.9.2
...
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
6 years ago
Brian Brazil
c20450564c
Release 0.7.1 ( #587 )
...
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
6 years ago
Brian Brazil
a9309a2e1e
Prepare 2.9.1
...
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
6 years ago
Brian Brazil
1a9cdbd024
Release 2.9.0 ( #5458 )
...
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
6 years ago
Julius Volz
bc1c7f1809
Fix scalar-vector comparisons ( #5454 )
...
* Fix scalar-vector comparisons
Fixes https://github.com/prometheus/prometheus/issues/5452
Signed-off-by: Julius Volz <julius.volz@gmail.com>
6 years ago
Brian Brazil
46660a0745
Prepare 2.9.0-rc.0 release ( #5450 )
...
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
6 years ago
Krasi Georgiev
4b3a5ac5d3
release 0.7.0 ( #580 )
...
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Brian Brazil
259847a6b1
Be smarter in how we look at matchers. ( #572 )
...
* Add unittests for PostingsForMatcher.
* Selector methods are all stateless, don't need a reference.
* Be smarter in how we look at matchers.
Look at all matchers to see if a label can be empty.
Optimise Not handling, so i!="2" is a simple lookup
rather than an inverse postings list.
All all the Withouts together, rather than
having to subtract each from all postings.
Change the pre-expand the postings logic to always do it before doing a
Without only. Don't do that if it's already a list.
The initial goal here was that the oft-seen pattern
i=~"something.+",i!="foo",i!="bar" becomes more efficient.
benchmark old ns/op new ns/op delta
BenchmarkHeadPostingForMatchers/n="1"-4 5888 6160 +4.62%
BenchmarkHeadPostingForMatchers/n="1",j="foo"-4 7190 6640 -7.65%
BenchmarkHeadPostingForMatchers/j="foo",n="1"-4 6038 5923 -1.90%
BenchmarkHeadPostingForMatchers/n="1",j!="foo"-4 6030884 4850525 -19.57%
BenchmarkHeadPostingForMatchers/i=~".*"-4 887377940 230329137 -74.04%
BenchmarkHeadPostingForMatchers/i=~".+"-4 490316101 319931758 -34.75%
BenchmarkHeadPostingForMatchers/i=~""-4 594961991 130279313 -78.10%
BenchmarkHeadPostingForMatchers/i!=""-4 537542388 318751015 -40.70%
BenchmarkHeadPostingForMatchers/n="1",i=~".*",j="foo"-4 10460243 8565195 -18.12%
BenchmarkHeadPostingForMatchers/n="1",i=~".*",i!="2",j="foo"-4 44964267 8561546 -80.96%
BenchmarkHeadPostingForMatchers/n="1",i!="",j="foo"-4 42244885 29137737 -31.03%
BenchmarkHeadPostingForMatchers/n="1",i=~".+",j="foo"-4 35285834 32774584 -7.12%
BenchmarkHeadPostingForMatchers/n="1",i=~"1.+",j="foo"-4 8951047 8379024 -6.39%
BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!="2",j="foo"-4 63813335 30672688 -51.93%
BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!~"2.*",j="foo"-4 45381112 44924397 -1.01%
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
6 years ago
naivewong
7ab060c864
selectOverlappingDirs selects wrong dirs where there are 2 disjoint sets of overlapping dirs
...
Signed-off-by: naivewong <867245430@qq.com>
6 years ago
Pavel Borzenkov
520b1d858f
index: add a test to trigger fd leak on corrupted index ( #576 )
...
The test is designed to fail for windows when the function leaves open files.
6 years ago
Krasi Georgiev
8eeb70fee1
remove Fsync workaround for macos. ( #574 )
...
since golang 1.12 no special handling is required for file.Sync()
@pborzenkov thanks for the pointer.
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Pavel Borzenkov
4f204dcbc1
chunks: close all opened MmapFiles on NewDirReader error path ( #575 )
...
Signed-off-by: Pavel Borzenkov <pavel.borzenkov@gmail.com>
6 years ago
Krasi Georgiev
e46ec89de6
use fsync to force persisting the meta file. ( #573 )
...
* use fsync to force persisting the meta file.
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Tariq Ibrahim
1ef6aaee24
Update CHANGELOG.md
...
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
Co-Authored-By: codesome <cs15btech11018@iith.ac.in>
6 years ago
Ganesh Vernekar
031ee49674
*: cut 2.8.1
...
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Vishnunarayan K I
7757fe6f21
Added ability to create db with NopWal ( #519 )
...
Signed-off-by: Vishnunarayan K I <appukuttancr@gmail.com>
6 years ago
Mario Trangoni
5354ffff99
Fix some spelling issues ( #5361 )
...
See,
$ codespell -S './vendor/*,./.git*,./web/ui/static/vendor*' --ignore-words-list="uint,dur,ue,iff,te,wan"
Signed-off-by: Mario Trangoni <mjtrangoni@gmail.com>
6 years ago
zhulongcheng
b7cac504c9
Remove unused NewReader function ( #547 )
...
The `NewReader` function is not used anywhere.
6 years ago
Ganesh Vernekar
7c8f0b0864
Update CHANGELOG ( #5341 )
...
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Ganesh Vernekar
594626e8b5
Update CHANGELOG
...
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Ganesh Vernekar
6043e0e715
*: cut 2.8.0
...
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Ganesh Vernekar
d390497280
*: cut 2.8.0-rc.0 ( #5287 )
...
* Release 2.8.0-rc.0
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Mark tsdb/370 experimental and update flag.
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* 5290 as BUGFIX
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix review comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
zhulongcheng
719b57db44
Remove obsolete FromData function ( #540 )
...
Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>
6 years ago
Ganesh Vernekar
fcfe312d99
Update CHANGELOG for v0.6.1
...
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Alec
0861a9b14f
[bugfix] update 'last' variable in chunks.MergeOverlappingChunks() ( #539 )
...
* update
Signed-off-by: naivewong <867245430@qq.com>
* update comment
Signed-off-by: naivewong <867245430@qq.com>
* Update failing test.
Signed-off-by: naivewong <867245430@qq.com>
* Update comment
Signed-off-by: naivewong <867245430@qq.com>
* Add changelog entry.
Signed-off-by: naivewong <867245430@qq.com>
* Update CHANGELOG.md
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Goutham Veeramachaneni
535e631621
*: cut 2.7.2
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Krasi Georgiev
ab8476dd06
Release 0.6.0 ( #537 )
6 years ago
Krasi Georgiev
e78fedf054
release 0.5.0 ( #536 )
...
* release 0.5.0
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Krasi Georgiev
df06f9ebc2
update the CHANGELOG with some missing changes. ( #535 )
...
missed to add these with some merged PRs
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Nguyen Hai Truong
5fbda4c9d7
Secure http links ( #5244 )
...
Fix http link to https link for secure, modify http to https
in the links of project. Have some http links doesn't
redirect into https.
Co-Authored-By: Nguyen Van Trung trungnv@vn.fujitsu.com
Signed-off-by: Nguyen Hai Truong <truongnh@vn.fujitsu.com>
6 years ago
Ganesh Vernekar
c59ed492b2
Vertical query merging and compaction ( #370 )
...
* Vertical series iterator
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Select overlapped blocks first in compactor Plan()
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Added vertical compaction
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Code cleanup and comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix review comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix tests
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Add benchmark for compaction
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Perform vertical compaction only when blocks are overlapping.
Actions for vertical compaction:
* Sorting chunk metas
* Calling chunks.MergeOverlappingChunks on the chunks
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Benchmark for vertical compaction
* BenchmarkNormalCompaction => BenchmarkCompaction
* Moved the benchmark from db_test.go to compact_test.go
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Benchmark for query iterator and seek for non overlapping blocks
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Vertical query merge only for overlapping blocks
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Simplify logging in Compact(...)
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Updated CHANGELOG.md
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Calculate overlapping inside populateBlock
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* MinTime and MaxTime for BlockReader.
Using this to find overlapping blocks in populateBlock()
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Sort blocks w.r.t. MinTime in reload()
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Log about overlapping in LeveledCompactor.write() instead of returning bool
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Log about overlapping inside LeveledCompactor.populateBlock()
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix review comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Refactor createBlock to take optional []Series
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* review1
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
* Updated CHANGELOG and minor nits
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* nits
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Updated CHANGELOG
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Refactor iterator and seek benchmarks for Querier.
Also has as overlapping blocks.
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Additional test case
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* genSeries takes optional labels. Updated BenchmarkQueryIterator and BenchmarkQuerySeek.
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Split genSeries into genSeries and populateSeries
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Check error in benchmark
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix review comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Warn about overlapping blocks in reload()
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Krasi Georgiev
2ae0620205
rename some vars and use Gauge instead of Counter for metrics
...
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Simon Pasquier
a60431f3cd
Merge v2.7.1 into master ( #5170 )
...
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
6 years ago