Ganesh Vernekar
d390497280
*: cut 2.8.0-rc.0 ( #5287 )
...
* Release 2.8.0-rc.0
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Mark tsdb/370 experimental and update flag.
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* 5290 as BUGFIX
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix review comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
zhulongcheng
719b57db44
Remove obsolete FromData function ( #540 )
...
Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>
6 years ago
Ganesh Vernekar
fcfe312d99
Update CHANGELOG for v0.6.1
...
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Alec
0861a9b14f
[bugfix] update 'last' variable in chunks.MergeOverlappingChunks() ( #539 )
...
* update
Signed-off-by: naivewong <867245430@qq.com>
* update comment
Signed-off-by: naivewong <867245430@qq.com>
* Update failing test.
Signed-off-by: naivewong <867245430@qq.com>
* Update comment
Signed-off-by: naivewong <867245430@qq.com>
* Add changelog entry.
Signed-off-by: naivewong <867245430@qq.com>
* Update CHANGELOG.md
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Goutham Veeramachaneni
535e631621
*: cut 2.7.2
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Krasi Georgiev
ab8476dd06
Release 0.6.0 ( #537 )
6 years ago
Krasi Georgiev
e78fedf054
release 0.5.0 ( #536 )
...
* release 0.5.0
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Krasi Georgiev
df06f9ebc2
update the CHANGELOG with some missing changes. ( #535 )
...
missed to add these with some merged PRs
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Nguyen Hai Truong
5fbda4c9d7
Secure http links ( #5244 )
...
Fix http link to https link for secure, modify http to https
in the links of project. Have some http links doesn't
redirect into https.
Co-Authored-By: Nguyen Van Trung trungnv@vn.fujitsu.com
Signed-off-by: Nguyen Hai Truong <truongnh@vn.fujitsu.com>
6 years ago
Ganesh Vernekar
c59ed492b2
Vertical query merging and compaction ( #370 )
...
* Vertical series iterator
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Select overlapped blocks first in compactor Plan()
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Added vertical compaction
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Code cleanup and comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix review comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix tests
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Add benchmark for compaction
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Perform vertical compaction only when blocks are overlapping.
Actions for vertical compaction:
* Sorting chunk metas
* Calling chunks.MergeOverlappingChunks on the chunks
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Benchmark for vertical compaction
* BenchmarkNormalCompaction => BenchmarkCompaction
* Moved the benchmark from db_test.go to compact_test.go
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Benchmark for query iterator and seek for non overlapping blocks
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Vertical query merge only for overlapping blocks
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Simplify logging in Compact(...)
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Updated CHANGELOG.md
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Calculate overlapping inside populateBlock
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* MinTime and MaxTime for BlockReader.
Using this to find overlapping blocks in populateBlock()
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Sort blocks w.r.t. MinTime in reload()
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Log about overlapping in LeveledCompactor.write() instead of returning bool
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Log about overlapping inside LeveledCompactor.populateBlock()
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix review comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Refactor createBlock to take optional []Series
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* review1
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
* Updated CHANGELOG and minor nits
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* nits
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Updated CHANGELOG
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Refactor iterator and seek benchmarks for Querier.
Also has as overlapping blocks.
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Additional test case
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* genSeries takes optional labels. Updated BenchmarkQueryIterator and BenchmarkQuerySeek.
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Split genSeries into genSeries and populateSeries
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Check error in benchmark
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Fix review comments
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
* Warn about overlapping blocks in reload()
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Krasi Georgiev
2ae0620205
rename some vars and use Gauge instead of Counter for metrics
...
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Simon Pasquier
a60431f3cd
Merge v2.7.1 into master ( #5170 )
...
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
6 years ago
Goutham Veeramachaneni
62e591f928
*: cut 2.7.1 ( #5164 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Goutham Veeramachaneni
410ee9e04a
*: cut 2.7.0 ( #5141 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Goutham Veeramachaneni
7f7b211047
*: cut 2.7.0-rc.2 ( #5134 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Krasi Georgiev
a44d15798e
remove a changelog double entry ( #507 )
...
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Brian Brazil
5db162568b
Remove _total from prometheus_tsdb_storage_blocks_bytes ( #506 )
...
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
6 years ago
Goutham Veeramachaneni
b454ed3ec2
*: cut 2.7.0-rc.1 ( #5123 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Goutham Veeramachaneni
24f19f03db
*: cut 2.7.0-rc.0 ( #5114 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Krasi Georgiev
10ba228e6b
release 0.4.0 ( #501 )
...
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Ganesh Vernekar
1a9d08adc5
Don't write empty blocks ( #374 )
...
* Dont write empty blocks when a compaction results in a block with no samples.
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
6 years ago
Callum Styan
3929359302
add live reader for WAL ( #481 )
...
* add live reader for WAL
Signed-off-by: Callum Styan <callumstyan@gmail.com>
6 years ago
mknapphrt
ebf5d74325
Added storage size based retention method and new metrics ( #343 )
...
Added methods needed to retain data based on a byte limitation rather than time. Limitation is only applied if the flag is set (defaults to 0). Both blocks that are older than the retention period and the blocks that make the size of the storage too large are removed.
2 new metrics for keeping track of the size of the local storage folder and the amount of times data has been deleted because the size restriction was exceeded.
Signed-off-by: Mark Knapp <mknapp@hudson-trading.com>
6 years ago
Simon Pasquier
b639fe140c
*: cut v2.6.1 ( #5098 )
...
* *: cut v2.6.1
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
* Move container change first.
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
* Update VERSION
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
6 years ago
Krasi Georgiev
090b6852e1
remove unused `PrefixMatcher` ( #474 )
...
* remove unused `PrefixMatcher`
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Krasi Georgiev
2e0571caba
remove unused WALFlushInterval option and NopWAL struct ( #468 )
...
The WALFlushInterval is not used anywhere in the code base.
The WAL is not an interface anymore to save some lookup time so can't use NopWAL in the tests. Instead can just pass nil as the code checks for that and it is essentially a noop.
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Brian Brazil
915d7cf937
Add a tsdbutil command to analyse churn etc. ( #478 )
...
This reports the cardinality of each label,
the total number of label pairs,
and how much series worth of time is "uncovered"
by series data. Which is basically how much churn there is.
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
6 years ago
glutamatt
22e3aeb107
Add WALSegmentSize as an option of tsdb creation ( #450 )
...
Expose `WALSegmentSize` option to allow overriding the `DefaultOptions.WALSegmentSize`.
6 years ago
Simon Pasquier
dbd1d58c89
*: cut v2.6.0 ( #5008 )
...
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
6 years ago
Simon Pasquier
3fe4f3e700
*: cut v2.6.0-rc.1 ( #5000 )
...
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
6 years ago
Krasi Georgiev
79aa611d56
release 0.3.1 ( #477 )
...
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Krasi Georgiev
db127a60e0
changelog
...
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Krasi Georgiev
bd5ccee5c1
use context to cancel compactions
...
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Simon Pasquier
40f0b4a9f6
*: cut v2.6.0-rc.0 ( #4958 )
...
* *: cut v2.6.0-rc.0
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
* Add #4926
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
* Address Brian's comments
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
* Address Goutham's comments
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
6 years ago
Krasi Georgiev
b4a2103a12
Release v0.3.0 ( #464 )
6 years ago
Krasi Georgiev
bac9cbed2e
no overlapping on compaction when an existing block is not within default boundaries. ( #461 )
...
closes https://github.com/prometheus/prometheus/issues/4643
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Krasi Georgiev
48efdf8b81
refactor NewSegmentsRangeReader to take multi WAL ranges ( #449 )
...
* refactor NewSegmentsRangeReader to take multi WAL ranges
In case of an error when checkpointing the WAL the error doesn't show
the exact WAL index that is corrupter. this is because it uses
MultiReader to read multiply WAL files.
This refactoring allows the NewSegmentsRangeReader to take more than a
single WAL range and it reads all of the ranges by iterating each one.
this changes the logs from
create checkpoint: read segments: corruption after 4841144384 bytes:...
to
create checkpoint: read segments: corruption in segment
data/wal/00017351 at 123142208: ...
Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>
6 years ago
Ben Kochie
c6399296dc
Fix spelling/typos ( #4921 )
...
* Fix spelling/typos
Fix spelling/typos reported by codespell/misspell.
* UK -> US spelling changes.
Signed-off-by: Ben Kochie <superq@gmail.com>
6 years ago
Frederic Branczyk
98e4d8f6e4
*: Cut v2.5.0
...
Signed-off-by: Frederic Branczyk <fbranczyk@gmail.com>
6 years ago
Frederic Branczyk
b76dd3513b
*: Cut v2.5.0-rc.2
...
Signed-off-by: Frederic Branczyk <fbranczyk@gmail.com>
6 years ago
Frederic Branczyk
d04148ab86
*: Cut v2.5.0-rc.1
...
Signed-off-by: Frederic Branczyk <fbranczyk@gmail.com>
6 years ago
Frederic Branczyk
4fc98efcde
CHANGELOG.md: Add entry for 2.5.0-rc.0
...
Signed-off-by: Frederic Branczyk <fbranczyk@gmail.com>
6 years ago
Goutham Veeramachaneni
1625c9c6e4
Format changelog properly ( #4721 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Goutham Veeramachaneni
167a4b4e73
*: release 2.4.3 ( #4694 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Goutham Veeramachaneni
c305ffaa09
release 2.4.2 ( #4636 )
...
* vendor: Update prometheus/tsdb
This time, properly
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
* release 2.4.2
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Goutham Veeramachaneni
ce6716fe90
release 2.4.1 ( #4632 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Goutham Veeramachaneni
16532a7111
changelog: /s/backward compatible/forward compatible/ ( #4600 )
...
Fixes #4597
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Goutham Veeramachaneni
068eaa5dbf
Release 2.4.0 ( #4592 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Goutham Veeramachaneni
d075d78bfd
release 2.4.0-rc.0 ( #4576 )
...
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
6 years ago
Brian Brazil
ebe107b71b
Release 2.3.2
...
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
6 years ago