199 Commits (8066de91ca26bbf268e28283aef1e6cf78eb5c17)

Author	SHA1	Message	Date
Brian Brazil	0303ccc6a7	Add quantile aggregator.	8 years ago
Brian Brazil	15f9fe0a45	Factor out quantile fucntion.	8 years ago
Brian Brazil	b0342ba9ec	Add quantile_over_time function	8 years ago
beorn7	fc6737b7fb	storage: improve index lookups ... tl;dr: This is not a fundamental solution to the indexing problem (like tindex is) but it at least avoids utilizing the intersection problem to the greatest possible amount. In more detail: Imagine the following query: nicely:aggregating:rule{job="foo",env="prod"} While it uses a nicely aggregating recording rule (which might have a very low cardinality), Prometheus still intersects the low number of fingerprints for `{__name__="nicely:aggregating:rule"}` with the many thousands of fingerprints matching `{job="foo"}` and with the millions of fingerprints matching `{env="prod"}`. This totally innocuous query is dead slow if the Prometheus server has a lot of time series with the `{env="prod"}` label. Ironically, if you make the query more complicated, it becomes blazingly fast: nicely:aggregating:rule{job=~"foo",env=~"prod"} Why so? Because Prometheus only intersects with non-Equal matchers if there are no Equal matchers. That's good in this case because it retrieves the few fingerprints for `{__name__="nicely:aggregating:rule"}` and then starts right ahead to retrieve the metric for those FPs and checking individually if they match the other matchers. This change is generalizing the idea of when to stop intersecting FPs and go into "retrieve metrics and check them individually against remaining matchers" mode: - First, sort all matchers by "expected cardinality". Matchers matching the empty string are always worst (and never used for intersections). Equal matchers are in general consider best, but by using some crude heuristics, we declare some better than others (instance labels or anything that looks like a recording rule). - Then go through the matchers until we hit a threshold of remaining FPs in the intersection. This threshold is higher if we are already in the non-Equal matcher area as intersection is even more expensive here. - Once the threshold has been reached (or we have run out of matchers that do not match the empty string), start with "retrieve metrics and check them individually against remaining matchers". A beefy server at SoundCloud was spending 67% of its CPU time in index lookups (fingerprintsForLabelPairs), serving mostly a dashboard that is exclusively built with recording rules. With this change, it spends only 35% in fingerprintsForLabelPairs. The CPU usage dropped from 26 cores to 18 cores. The median latency for query_range dropped from 14s to 50ms(!). As expected, higher percentile latency didn't improve that much because the new approach is _occasionally_ running into the worst case while the old one was _systematically_ doing so. The 99th percentile latency is now about as high as the median before (14s) while it was almost twice as high before (26s).	8 years ago
Brian Brazil	40f8da699e	Merge pull request #1815 from prometheus/stddev ... Add stddev_over_time and stdvar_over_time.	8 years ago
Brian Brazil	1edd6875f5	Add stddev_over_time and stdvar_over_time.	8 years ago
Fabian Reinartz	f8bb0ee91f	Merge pull request #1793 from prometheus/count_values ... Add count_values() aggregator.	9 years ago
Brian Brazil	875818d060	Clean out old keywords	9 years ago
Brian Brazil	16690736ab	Add count_values() aggregator. ... This is useful for counting how many instances of a job are running a particular version/build. Fixes #622	9 years ago
Brian Brazil	7f23a4a099	Add type check on topk/bottomk parameter.	9 years ago
Brian Brazil	fa9cc15573	Add topk/bottomk tests for multiple buckets.	9 years ago
Brian Brazil	3b0c182eee	Move topk/bottomk unittests over to aggregators.	9 years ago
Brian Brazil	3e5136e36d	Make topk/bottomk aggregators.	9 years ago
Fabian Reinartz	4d1985e405	Merge pull request #1778 from mattbostock/fix_annotations ... promql: Fix annotations conflated with labels	9 years ago
Matt Bostock	cc98e164d3	promql: Fix annotations conflated with labels ... When converting `AlertStmt` to a string, the alert rule labels were printed as `ANNOTATIONS` instead of the annotations themselves. Fix and add a test to catch future regressions.	9 years ago
Brian Brazil	3b89616d82	Allow on, ignoring, by and without wit empty laberls. ... This offers new semantics in allowing on() for matching two single-element vectors with no known common labels. Previosuly this was often done using on(dummy). This also allows making it explict that you meant to do an aggregation without labels via by(). Fixes #1597.	9 years ago
Brian Brazil	246a817300	Flip vector matching to be ignoring by default. ... This is a noop semantically.	9 years ago
Julius Volz	b7b6717438	Separate query interface out of local.Storage. ... PromQL only requires a much narrower interface than local.Storage in order to run queries. Narrower interfaces are easier to replace and test, too. We could also change the web interface to use local.Querier, except that we'll probably use appending functions from there in the future.	9 years ago
Fabian Reinartz	0e281f5500	Merge pull request #1687 from royels/issue-1629 ... Added power binop	9 years ago
royels	2fdc5717a3	promql: add power binary operation	9 years ago
Fatih Arslan	362e44501a	promql: fix printing annotations of an *AlertStmt ... Currently the printer doesn't print the annotations of an `*AlertStmt` declaration. I've added a test case as well, which fails for the current master.	9 years ago
beorn7	e3ec8fa83b	Merge branch 'release-0.19'	9 years ago
beorn7	5408666387	Correctly stringify GROUP_x modifiers without labels ... Since rule evaluations work via String(), this fixes evaluation of rules containing GROUP_x modifiers without labels. This change is the minimal bugfix (so that we can release a fixed version without risk). It does not intend to implement any additional features (like allowing `GROUP_LEFT()` or `ON()` or even `ON` - see discussion in https://github.com/prometheus/prometheus/issues/1597 ).	9 years ago
Ali Reza	e7eba75690	remove keeping_extra because it's replaced with keep_common ... change all keepExtra label into keepCommon, and move action into removed list change incorrect token list	9 years ago
Brian Brazil	74094947ea	effect -> affect	9 years ago
Brian Brazil	68aaea618a	Merge pull request #1624 from dmitris/golint ... (trivial) fix several minor golint style issues	9 years ago
Fabian Reinartz	bbc4f11bcc	Merge pull request #945 from msiebuhr/fuzz ... Fuzz parsers	9 years ago
Dmitry Savintsev	7fdb62c253	fix several minor golint style issues	9 years ago
Morten Siebuhr	ffc8cab39a	Updates fuzzers to discard less interesting data	9 years ago
Brian Brazil	ef55fd6176	Add unittest for using a metric for thresholds with group_left.	9 years ago
Morten Siebuhr	981b636004	Bring fuzzer error handling in line.	9 years ago
Morten Siebuhr	9eb2e98509	Fix up documentation + go fmt.	9 years ago
Morten Siebuhr	7371dcc787	Fuzzing corpus for ParseMetric.	9 years ago
Morten Siebuhr	5fec020b27	Initial fuzzing corpus for ParseExpr.	9 years ago
Morten Siebuhr	0ebcca5eb7	Add basic fuzzer of the parser.	9 years ago
Brian Brazil	68e70d992a	Clarify error message around on(x) group_left(x)	9 years ago
Brian Brazil	7201c010c4	Rename On to MatchingLabels	9 years ago
Brian Brazil	d991f0cf47	For many-to-one matches, always copy label from one side. ... This is a breaking change for everyone using the machine roles labeling approach.	9 years ago
Brian Brazil	768d09fd2a	Change on+group_* to take copy from the one side. ... If the label doesn't exist on the one side, it's not copied. All labels on the many inside are included, this is a breaking change but likely low impact.	9 years ago
Brian Brazil	d1edfb25b3	Add support for OneToMany with IGNORING. ... The labels listed in the group_ modifier will be copied from the one side to the many side. It will be valid to specify no labels. This is intended to replace the existing ON/GROUP_* support.,	9 years ago
Brian Brazil	1d08c4fef0	Add 'ignoring' as modifier for binops. ... Where 'on' uses the given labels to match, 'ignoring' uses all other labels to match. group_left/right is not supported yet.	9 years ago
Brian Brazil	f5084ab1c5	Add tests for group_left/group_right	9 years ago
Fabian Reinartz	fceedfa807	Add error message if old alert rule tokens are read	9 years ago
Julius Volz	6ac39700ea	Fix missing printed keep_common without grouping.	9 years ago
Jonathan Boulle	38098f8c95	Add missing license headers ... Prometheus is Apache 2 licensed, and most source files have the appropriate copyright license header, but some were missing it without apparent reason. Correct that by adding it.	9 years ago
Fabian Reinartz	9ee91062c4	Merge pull request #1522 from prometheus/unless-operator ... Implement relative complement set operator "unless"	9 years ago
Tobias Schmidt	8cc86f25c0	Implement relative complement set operator "unless" ... The `unless` set operator can be used to return all vector elements from the LHS which do not match the elements on the RHS. A use case is to return all metrics for nodes which do not have a specific role: node_load1 unless on(instance) chef_role{role="app"}	9 years ago
Tobias Schmidt	e82ef154ee	Remove unused code leftovers	9 years ago
Tobias Schmidt	4c3dc25e35	Fix whitespace in promql test data	9 years ago
Fabian Reinartz	235e6c554b	Use ContainsRune	9 years ago