prometheus

Commit Graph

Author	SHA1	Message	Date
Frederic Branczyk	e708ba1d14	wal: Add `_total` suffix as metric is a counter Signed-off-by: Frederic Branczyk <fbranczyk@gmail.com>	6 years ago
mrasu	3db36f021b	Fix `make bench` (#610 ) Remove flag -log.level Signed-off-by: mrasu <m.rasu.hitsuji@gmail.com>	6 years ago
Frederic Branczyk	b800a89ae3	Merge pull request #619 from prometheus/remove-promauto wal: Replace promauto with injected registry	6 years ago
Frederic Branczyk	abd15845e2	wal: Replace promauto with injected registry Signed-off-by: Frederic Branczyk <fbranczyk@gmail.com>	6 years ago
Krasi Georgiev	882162d5b9	fix the "failed compaction" metric. (#613 ) Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	6 years ago
naivewong	13c80a5979	Optimize queries using regex matchers for set lookups (#602 ) * Original version of the set optimization Signed-off-by: naivewong <867245430@qq.com> * simple set matcher Signed-off-by: naivewong <867245430@qq.com> * simple set matcher Signed-off-by: naivewong <867245430@qq.com> * update Signed-off-by: naivewong <867245430@qq.com> * update Signed-off-by: naivewong <867245430@qq.com> * add benchmark Signed-off-by: naivewong <867245430@qq.com> * update Signed-off-by: naivewong <867245430@qq.com> * update Signed-off-by: naivewong <867245430@qq.com> * update benchmark Signed-off-by: naivewong <867245430@qq.com> * update Signed-off-by: naivewong <867245430@qq.com> * update benchmark Signed-off-by: naivewong <867245430@qq.com> * update benchmark Signed-off-by: naivewong <867245430@qq.com> * update benchmark Signed-off-by: naivewong <867245430@qq.com> * update Signed-off-by: naivewong <867245430@qq.com> * update Signed-off-by: naivewong <867245430@qq.com> * update Signed-off-by: naivewong <867245430@qq.com> * update Signed-off-by: naivewong <867245430@qq.com> * use genSeries from #467 Signed-off-by: naivewong <867245430@qq.com> * update Signed-off-by: naivewong <867245430@qq.com>	6 years ago
Callum Styan	562e93e8e6	Always create a new clean segment when starting the WAL. (#608 ) * Always create a new clean segment when starting the WAL. * Ensure we flush the last page after repairing and before recreating the new segment in Repair. Signed-off-by: Callum Styan <callumstyan@gmail.com>	6 years ago
Krasi Georgiev	d48a5e2d5c	Release 0.8.0 (#607 ) Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	6 years ago
Callum Styan	bce663e1d9	Export the current segment index as a metic. (#601 ) * Export the current segment index as a metic. Signed-off-by: Callum Styan <callumstyan@gmail.com>	6 years ago
Krasi Georgiev	96a87845cc	fix wal panic when page flush fails. (#582 ) * fix wal panic when page flush fails. New records should be added to the page only when the last flush succeeded. Otherwise the page would be full and panics when trying to add a new record. Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	6 years ago
Brian Brazil	30d0ea59d7	Don't crash on an unknown tombstone ref. (#604 ) Fixes https://github.com/prometheus/prometheus/issues/5562 Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>	6 years ago
PrometheusBot	63d9c2ab18	makefile: update Makefile.common with newer version (#603 ) Signed-off-by: prombot <prometheus-team@googlegroups.com>	6 years ago
Brian Brazil	89a90fe96c	Simplify mergedPostings.Seek (#595 ) The current implementation leads to very slow behaviour when there's many lists, this no worse than n log k, where k is the number of posting lists. Adjust benchmark to catch this. Remove flattening of without lists, not needed anymore. Benchmark versus 0.4.0 (used in Prometheus 2.7): ``` benchmark old ns/op new ns/op delta BenchmarkHeadPostingForMatchers/n="1"-8 189907976 188863880 -0.55% BenchmarkHeadPostingForMatchers/n="1",j="foo"-8 113950106 110791414 -2.77% BenchmarkHeadPostingForMatchers/j="foo",n="1"-8 104965646 102388760 -2.45% BenchmarkHeadPostingForMatchers/n="1",j!="foo"-8 138743592 104424250 -24.74% BenchmarkHeadPostingForMatchers/i=~"."-8 5279594954 5206096267 -1.39% BenchmarkHeadPostingForMatchers/i=~".+"-8 8004610589 6184527719 -22.74% BenchmarkHeadPostingForMatchers/i=~""-8 2476042646 1003920432 -59.45% BenchmarkHeadPostingForMatchers/i!=""-8 7178244655 6059725323 -15.58% BenchmarkHeadPostingForMatchers/n="1",i=~".",j="foo"-8 199342649 166642946 -16.40% BenchmarkHeadPostingForMatchers/n="1",i=~".",i!="2",j="foo"-8 215774683 167515095 -22.37% BenchmarkHeadPostingForMatchers/n="1",i!=""-8 2214714769 392943663 -82.26% BenchmarkHeadPostingForMatchers/n="1",i!="",j="foo"-8 2148727410 322289262 -85.00% BenchmarkHeadPostingForMatchers/n="1",i=~".+",j="foo"-8 2170658009 338458171 -84.41% BenchmarkHeadPostingForMatchers/n="1",i=~"1.+",j="foo"-8 235720135 70597905 -70.05% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!="2",j="foo"-8 2190570590 343034307 -84.34% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!~"2.",j="foo"-8 2373784439 387297908 -83.68% benchmark old allocs new allocs delta BenchmarkHeadPostingForMatchers/n="1"-8 33 33 +0.00% BenchmarkHeadPostingForMatchers/n="1",j="foo"-8 33 33 +0.00% BenchmarkHeadPostingForMatchers/j="foo",n="1"-8 33 33 +0.00% BenchmarkHeadPostingForMatchers/n="1",j!="foo"-8 41 39 -4.88% BenchmarkHeadPostingForMatchers/i=~"."-8 56 56 +0.00% BenchmarkHeadPostingForMatchers/i=~".+"-8 251577 100115 -60.21% BenchmarkHeadPostingForMatchers/i=~""-8 251123 100077 -60.15% BenchmarkHeadPostingForMatchers/i!=""-8 251525 100112 -60.20% BenchmarkHeadPostingForMatchers/n="1",i=~".",j="foo"-8 42 39 -7.14% BenchmarkHeadPostingForMatchers/n="1",i=~".",i!="2",j="foo"-8 52 42 -19.23% BenchmarkHeadPostingForMatchers/n="1",i!=""-8 251069 100101 -60.13% BenchmarkHeadPostingForMatchers/n="1",i!="",j="foo"-8 251473 100101 -60.19% BenchmarkHeadPostingForMatchers/n="1",i=~".+",j="foo"-8 250914 100102 -60.11% BenchmarkHeadPostingForMatchers/n="1",i=~"1.+",j="foo"-8 30038 11181 -62.78% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!="2",j="foo"-8 250813 100105 -60.09% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!~"2.",j="foo"-8 281503 111260 -60.48% benchmark old bytes new bytes delta BenchmarkHeadPostingForMatchers/n="1"-8 10887600 10887600 +0.00% BenchmarkHeadPostingForMatchers/n="1",j="foo"-8 5456416 5456416 +0.00% BenchmarkHeadPostingForMatchers/j="foo",n="1"-8 5456416 5456416 +0.00% BenchmarkHeadPostingForMatchers/n="1",j!="foo"-8 5456640 5456544 -0.00% BenchmarkHeadPostingForMatchers/i=~"."-8 258254504 258254472 -0.00% BenchmarkHeadPostingForMatchers/i=~".+"-8 520126192 281554792 -45.87% BenchmarkHeadPostingForMatchers/i=~""-8 263446640 24908456 -90.55% BenchmarkHeadPostingForMatchers/i!=""-8 520121144 281553664 -45.87% BenchmarkHeadPostingForMatchers/n="1",i=~".",j="foo"-8 7062448 7062272 -0.00% BenchmarkHeadPostingForMatchers/n="1",i=~".",i!="2",j="foo"-8 7063473 7062384 -0.02% BenchmarkHeadPostingForMatchers/n="1",i!=""-8 274325656 35793776 -86.95% BenchmarkHeadPostingForMatchers/n="1",i!="",j="foo"-8 268926824 30362624 -88.71% BenchmarkHeadPostingForMatchers/n="1",i=~".+",j="foo"-8 268882992 30363000 -88.71% BenchmarkHeadPostingForMatchers/n="1",i=~"1.+",j="foo"-8 33193401 4269304 -87.14% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!="2",j="foo"-8 268875024 30363096 -88.71% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!~"2.",j="foo"-8 300589656 33099784 -88.99% ``` Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>	6 years ago
Brian Brazil	6ac81cc7a9	Correctly handle empty labels. (#594 ) Currently a time series with empty labels is not treated the same as one with missing labels. Currently this can only come from ALERTS&ALERT_FOR_STATE so it's unlikely anyone has actually hit it. Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>	6 years ago
Goutham Veeramachaneni	2ae028114c	Add FromData function (again)! (#600 ) Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>	6 years ago
PrometheusBot	4da65c46c9	makefile: update Makefile.common with newer version (#597 ) Signed-off-by: prombot <prometheus-team@googlegroups.com>	6 years ago
zhulongcheng	3ccab17f5d	docs: add label offset table and postings offset table (#593 ) Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago
Krasi Georgiev	5512826f13	make Close methods for the querier safe to call more than once. (#581 ) * make Close methods for the querier safe to call more than once. Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	6 years ago
zhulongcheng	19d402d154	cleanup tmp files (#570 ) Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago
Krasi Georgiev	288f67efbf	fix some unchecked errors and remove unused vars. (#592 ) Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	6 years ago
PrometheusBot	a10c001689	Synchronize Makefile.common from prometheus/prometheus (#591 ) * makefile: update Makefile.common with newer version Signed-off-by: prombot <prometheus-team@googlegroups.com> * Add .golangci.yml Signed-off-by: Simon Pasquier <spasquie@redhat.com>	6 years ago
Brian Brazil	c20450564c	Release 0.7.1 (#587 ) Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>	6 years ago
Brian Brazil	f9bc0817a1	Avoid allocation in mergedPostings.Seek. (#586 ) See https://github.com/prometheus/prometheus/issues/5424#issuecomment-485199651 benchmark old ns/op new ns/op delta BenchmarkHeadPostingForMatchers/n="1"-4 5266 5267 +0.02% BenchmarkHeadPostingForMatchers/n="1",j="foo"-4 6469 7801 +20.59% BenchmarkHeadPostingForMatchers/j="foo",n="1"-4 4984 4963 -0.42% BenchmarkHeadPostingForMatchers/n="1",j!="foo"-4 7137 7527 +5.46% BenchmarkHeadPostingForMatchers/i=~"."-4 8055830839 8117651746 +0.77% BenchmarkHeadPostingForMatchers/i=~".+"-4 9369298293 9742710251 +3.99% BenchmarkHeadPostingForMatchers/i=~""-4 2363120708 2507789029 +6.12% BenchmarkHeadPostingForMatchers/i!=""-4 9387069195 11740628557 +25.07% BenchmarkHeadPostingForMatchers/n="1",i=~".",j="foo"-4 109668312 107644136 -1.85% BenchmarkHeadPostingForMatchers/n="1",i=~".",i!="2",j="foo"-4 106022679 105759760 -0.25% BenchmarkHeadPostingForMatchers/n="1",i!="",j="foo"-4 330201810 266421024 -19.32% BenchmarkHeadPostingForMatchers/n="1",i=~".+",j="foo"-4 355627801 292774913 -17.67% BenchmarkHeadPostingForMatchers/n="1",i=~"1.+",j="foo"-4 108132305 106697690 -1.33% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!="2",j="foo"-4 358836972 362579998 +1.04% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!~"2.",j="foo"-4 555879392 575858378 +3.59% benchmark old allocs new allocs delta BenchmarkHeadPostingForMatchers/n="1"-4 8 8 +0.00% BenchmarkHeadPostingForMatchers/n="1",j="foo"-4 11 11 +0.00% BenchmarkHeadPostingForMatchers/j="foo",n="1"-4 11 11 +0.00% BenchmarkHeadPostingForMatchers/n="1",j!="foo"-4 17 17 +0.00% BenchmarkHeadPostingForMatchers/i=~"."-4 58 58 +0.00% BenchmarkHeadPostingForMatchers/i=~".+"-4 100115 100115 +0.00% BenchmarkHeadPostingForMatchers/i=~""-4 100125 100125 +0.00% BenchmarkHeadPostingForMatchers/i!=""-4 100112 100112 +0.00% BenchmarkHeadPostingForMatchers/n="1",i=~".",j="foo"-4 19 19 +0.00% BenchmarkHeadPostingForMatchers/n="1",i=~".",i!="2",j="foo"-4 22 22 +0.00% BenchmarkHeadPostingForMatchers/n="1",i!="",j="foo"-4 100109 100079 -0.03% BenchmarkHeadPostingForMatchers/n="1",i=~".+",j="foo"-4 100110 100079 -0.03% BenchmarkHeadPostingForMatchers/n="1",i=~"1.+",j="foo"-4 11176 11167 -0.08% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!="2",j="foo"-4 100112 100082 -0.03% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!~"2.",j="foo"-4 111307 111277 -0.03% benchmark old bytes new bytes delta BenchmarkHeadPostingForMatchers/n="1"-4 1360 1360 +0.00% BenchmarkHeadPostingForMatchers/n="1",j="foo"-4 1392 1392 +0.00% BenchmarkHeadPostingForMatchers/j="foo",n="1"-4 1392 1392 +0.00% BenchmarkHeadPostingForMatchers/n="1",j!="foo"-4 1520 1520 +0.00% BenchmarkHeadPostingForMatchers/i=~"."-4 258254040 258254040 +0.00% BenchmarkHeadPostingForMatchers/i=~".+"-4 281554280 281554280 +0.00% BenchmarkHeadPostingForMatchers/i=~""-4 241554888 241554888 +0.00% BenchmarkHeadPostingForMatchers/i!=""-4 281553664 281553664 +0.00% BenchmarkHeadPostingForMatchers/n="1",i=~".",j="foo"-4 1607277 1607277 +0.00% BenchmarkHeadPostingForMatchers/n="1",i=~".",i!="2",j="foo"-4 1607389 1607389 +0.00% BenchmarkHeadPostingForMatchers/n="1",i!="",j="foo"-4 73076560 24907600 -65.92% BenchmarkHeadPostingForMatchers/n="1",i=~".+",j="foo"-4 73076765 24907723 -65.92% BenchmarkHeadPostingForMatchers/n="1",i=~"1.+",j="foo"-4 5416925 3794909 -29.94% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!="2",j="foo"-4 73076779 24907819 -65.92% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!~"2.",j="foo"-4 99874860 51705900 -48.23% Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>	6 years ago
naivewong	7a12d4588a	Avoid potential collision of createIdxChkReaders in querier_test.go (#585 ) * Make chink ref monotonically increasing number in the `createIdxChkReaders` test func. Signed-off-by: naivewong <867245430@qq.com>	6 years ago
PrometheusBot	e2c6eb2c60	Synchronize Makefile.common from prometheus/prometheus (#584 ) Propagating changes from master Makefile.common located in prometheus/prometheus.	6 years ago
Krasi Georgiev	4b3a5ac5d3	release 0.7.0 (#580 ) Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	6 years ago
Brian Brazil	dfed85e4a4	Keep series that are still in WAL in checkpoints (#577 ) If all the samples are deleted for a series, we should still keep the series in the WAL as anything else reading the WAL will still care about it in order to understand the samples. Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>	6 years ago
Brian Brazil	259847a6b1	Be smarter in how we look at matchers. (#572 ) * Add unittests for PostingsForMatcher. * Selector methods are all stateless, don't need a reference. * Be smarter in how we look at matchers. Look at all matchers to see if a label can be empty. Optimise Not handling, so i!="2" is a simple lookup rather than an inverse postings list. All all the Withouts together, rather than having to subtract each from all postings. Change the pre-expand the postings logic to always do it before doing a Without only. Don't do that if it's already a list. The initial goal here was that the oft-seen pattern i=~"something.+",i!="foo",i!="bar" becomes more efficient. benchmark old ns/op new ns/op delta BenchmarkHeadPostingForMatchers/n="1"-4 5888 6160 +4.62% BenchmarkHeadPostingForMatchers/n="1",j="foo"-4 7190 6640 -7.65% BenchmarkHeadPostingForMatchers/j="foo",n="1"-4 6038 5923 -1.90% BenchmarkHeadPostingForMatchers/n="1",j!="foo"-4 6030884 4850525 -19.57% BenchmarkHeadPostingForMatchers/i=~"."-4 887377940 230329137 -74.04% BenchmarkHeadPostingForMatchers/i=~".+"-4 490316101 319931758 -34.75% BenchmarkHeadPostingForMatchers/i=~""-4 594961991 130279313 -78.10% BenchmarkHeadPostingForMatchers/i!=""-4 537542388 318751015 -40.70% BenchmarkHeadPostingForMatchers/n="1",i=~".",j="foo"-4 10460243 8565195 -18.12% BenchmarkHeadPostingForMatchers/n="1",i=~".",i!="2",j="foo"-4 44964267 8561546 -80.96% BenchmarkHeadPostingForMatchers/n="1",i!="",j="foo"-4 42244885 29137737 -31.03% BenchmarkHeadPostingForMatchers/n="1",i=~".+",j="foo"-4 35285834 32774584 -7.12% BenchmarkHeadPostingForMatchers/n="1",i=~"1.+",j="foo"-4 8951047 8379024 -6.39% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!="2",j="foo"-4 63813335 30672688 -51.93% BenchmarkHeadPostingForMatchers/n="1",i=~".+",i!~"2.",j="foo"-4 45381112 44924397 -1.01% Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>	6 years ago
naivewong	7ab060c864	selectOverlappingDirs selects wrong dirs where there are 2 disjoint sets of overlapping dirs Signed-off-by: naivewong <867245430@qq.com>	6 years ago
zhulongcheng	8b33ee9e2b	force persisting the tombstone file (#578 ) Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago
Pavel Borzenkov	520b1d858f	index: add a test to trigger fd leak on corrupted index (#576 ) The test is designed to fail for windows when the function leaves open files.	6 years ago
Krasi Georgiev	8eeb70fee1	remove Fsync workaround for macos. (#574 ) since golang 1.12 no special handling is required for file.Sync() @pborzenkov thanks for the pointer. Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	6 years ago
Pavel Borzenkov	4f204dcbc1	chunks: close all opened MmapFiles on NewDirReader error path (#575 ) Signed-off-by: Pavel Borzenkov <pavel.borzenkov@gmail.com>	6 years ago
Krasi Georgiev	e46ec89de6	use fsync to force persisting the meta file. (#573 ) * use fsync to force persisting the meta file. Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	6 years ago
zhulongcheng	aed16621c0	Add Head.compactable method (#542 ) * Add Head.compactable method Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago
Vladimir Masarik	fd188be052	Fixed default benchmark test path (#571 ) Signed-off-by: Vladimir Masarik <vmasarik@redhat.com>	6 years ago
Vishnunarayan K I	7757fe6f21	Added ability to create db with NopWal (#519 ) Signed-off-by: Vishnunarayan K I <appukuttancr@gmail.com>	6 years ago
zhulongcheng	db9177de0c	docs: add multi chunks layout in chunks readme file (#567 )	6 years ago
zhulongcheng	e11e01f68d	Fix exported function comments (#566 ) Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago
zhulongcheng	4d03c70800	Verify chunk format version (#544 ) Verify chunk format version.	6 years ago
Bartek Płotka	3ab5f4e579	index: reduce empty postings trees (#509 ) Improved Merge when all is empty. Signed-off-by: Bartek Plotka <bwplotka@gmail.com>	6 years ago
naivewong	1c392d0057	Update wal.md that the first wal entry includes only base id and timestamp without a value (#562 ) Signed-off-by: naivewong <867245430@qq.com>	6 years ago
zhulongcheng	837ae9aaa0	Update comment for ErrOutOfOrderSample (#563 ) Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago
zhulongcheng	62cfe4446f	Make Head.symbols map with size hint (#552 ) To reduce the number of times the map is resized Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago
zhulongcheng	921da4dced	Remove unused statement from index test (#558 ) Remove unused `i++` statement from index test.	6 years ago
Krasi Georgiev	c3ffdf1a99	Test createBlock and check all os.RemoveAll in the tests for errors. (#549 ) Testing that createBlock creates blocks that can be opened. and checking the os.RemoveAll for errors will catch errors for un-closed files under windows. Many missing .Close() calls were added for fixing failing os.RemoveAll Signed-off-by: Krasi Georgiev <kgeorgie@redhat.com>	6 years ago
naivewong	dd0d3c6f02	Several small fixes (#550 ) `if ds[i].meta.MinTime < t0 \|\| ds[i].meta.MaxTime > t0+tr `, ds[i].meta.MinTime is always larger or equal to t0, so no need for this check. `ulid.Parse` only checks if the length is 26. So changed to using `ulid.ParseStrict` to also check the validity of ulid.	6 years ago
zhulongcheng	99703b3269	README: move the build badge to the badge list (#555 ) Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago
zhulongcheng	95648b33c4	Fix a typo in head.go (#553 ) Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago
zhulongcheng	8feb67e630	Update Appender.AddFast method comment (#551 ) Signed-off-by: zhulongcheng <zhulongcheng.me@gmail.com>	6 years ago

1 2 3 4 5 ...

1042 Commits (e708ba1d14850379145a289bda553fc246219f5d) All Branches Search

1042 Commits (e708ba1d14850379145a289bda553fc246219f5d)

All Branches