422 Commits (268b4c29e101706cbff0f90f0882bf05608fc56c)

Author	SHA1	Message	Date
Bjoern Rabenstein	fd63500ed3	Make rules/ast golint clean. ... Mostly, that means adding compliant doc strings to exported items. Also, remove 'go vet' warnings where possible. (Some are unfortunately not to avoid, arguably bugs in 'go vet'.) Change-Id: I2827b6dd317492864c1383c3de1ea9eac5a219bb	11 years ago
Björn Rabenstein	59febe771a	Merge "Minor code cleanups."	11 years ago
Julius Volz	c4adfc4f25	Minor code cleanups. ... Change-Id: Ib3729cf38b107b7f2186ccf410a745e0472e3630	11 years ago
Julius Volz	7e9ecaac3a	Add count_scalar() function. ... Change-Id: I63f09dd0479d0a6b016f5f857dd39dcbda56c7f9	11 years ago
Julius Volz	0378c2ca1f	Nonexistent labels in BY-clauses shouldn't propagate to result. ... This fixes bug 2. of https://github.com/prometheus/prometheus/issues/374 Change-Id: Ia4a13153616bafce5bf10597966b071434422d09	11 years ago
Julius Volz	6dc36d0c3e	Don't keep extra labels in aggregations by default. ... MIN/MAX/SUM/AVG/COUNT aggregations will now by default drop all labels that are not specifically part of a BY-clause, even if a label value is the same within all timeseries of an aggregation group. The old behavior of keeping extra labels may still be switched on by adding KEEPING_EXTRA to the end of an aggregation statement: sum(http_requests) by (job, method) keeping_extra I'm open to better syntax/naming suggestions. Change-Id: I21d3fe7af9e98552ce3dffa3ce7c0a4ba4c0b4a4	11 years ago
Julius Volz	20bfaf80ab	Merge "Display filename when encountering bad rule file."	11 years ago
Julius Volz	3bf3a555b2	Merge "add evalDuration histogram and ruleCount counter for rules"	11 years ago
Stuart Nelson	b75adfebad	add evalDuration histogram and ruleCount counter for rules ... Change-Id: I3508fe72526348d96b8158828388c3ac8d7c3fa9	11 years ago
Julius Volz	77a79d1fc0	Display filename when encountering bad rule file. ... Change-Id: I4729371be92c5659a6938145c5fde66771d7be22	11 years ago
Julius Volz	fb44580110	Cleanup/fix program termination sequence. ... Change-Id: I2bc58a2583fb079c9ef383cfc7a5e0fbe613f1cd	11 years ago
Julius Volz	740d448983	Use custom timestamp type for sample timestamps and related code. ... So far we've been using Go's native time.Time for anything related to sample timestamps. Since the range of time.Time is much bigger than what we need, this has created two problems: - there could be time.Time values which were out of the range/precision of the time type that we persist to disk, therefore causing incorrectly ordered keys. One bug caused by this was: https://github.com/prometheus/prometheus/issues/367 It would be good to use a timestamp type that's more closely aligned with what the underlying storage supports. - sizeof(time.Time) is 192, while Prometheus should be ok with a single 64-bit Unix timestamp (possibly even a 32-bit one). Since we store samples in large numbers, this seriously affects memory usage. Furthermore, copying/working with the data will be faster if it's smaller. *MEMORY USAGE RESULTS* Initial memory usage comparisons for a running Prometheus with 1 timeseries and 100,000 samples show roughly a 13% decrease in total (VIRT) memory usage. In my tests, this advantage for some reason decreased a bit the more samples the timeseries had (to 5-7% for millions of samples). This I can't fully explain, but perhaps garbage collection issues were involved. *WHEN TO USE THE NEW TIMESTAMP TYPE* The new clientmodel.Timestamp type should be used whenever time calculations are either directly or indirectly related to sample timestamps. For example: - the timestamp of a sample itself - all kinds of watermarks - anything that may become or is compared to a sample timestamp (like the timestamp passed into Target.Scrape()). When to still use time.Time: - for measuring durations/times not related to sample timestamps, like duration telemetry exporting, timers that indicate how frequently to execute some action, etc. *NOTE ON OPERATOR OPTIMIZATION TESTS* We don't use operator optimization code anymore, but it still lives in the code as dead code. It still has tests, but I couldn't get all of them to pass with the new timestamp format. I commented out the failing cases for now, but we should probably remove the dead code soon. I just didn't want to do that in the same change as this. Change-Id: I821787414b0debe85c9fffaeb57abd453727af0f	11 years ago
Julius Volz	c7daedc840	Merge "Add scalar() function."	11 years ago
Julius Volz	be8024e18c	Add scalar() function. ... Change-Id: I1d1183e926a18fc98c9e94bbb9a808a3fb313102	11 years ago
Julius Volz	93a8d03221	Merge "Add alert-expression console links to notifications."	11 years ago
Julius Volz	1eb1ceac8c	Add alert-expression console links to notifications. ... The ConsoleLinkForExpression() function now escapes console URLs in such a way that works both in emails and in HTML. Change-Id: I917bae0b526cbbac28ccd2a4ec3c5ac03ee4c647	11 years ago
Matt T. Proud	7db518d3a0	Abstract high watermark cache into standard LRU. ... Conflicts: storage/metric/memory.go storage/metric/tiered.go storage/metric/watermark.go Change-Id: Iab2aedbd8f83dc4ce633421bd4a55990fa026b85	11 years ago
Julius Volz	0003027dce	Add needed trailing spaces in logs.	11 years ago
Julius Volz	aa5d251f8d	Use github.com/golang/glog for all logging.	11 years ago
Julius Volz	3b970c5133	Add variable interpolation to notification messages. ... This includes required refactorings to enable replacing the http client (for testing) and moving the NotificationReq type definitions to the "notifications" package, so that this package doesn't need to depend on "rules" anymore and that it can instead use a representation of the required data which only includes the necessary fields.	11 years ago
Julius Volz	35ee2cd3cb	Add alertmanager notification support to Prometheus. ... Alert definitions now also have mandatory SUMMARY and DESCRIPTION fields that get sent along a firing alert to the alert manager.	11 years ago
Julius Volz	81f0b85013	Return [] instead of null for empty result vectors.	12 years ago
Julius Volz	64b0ade171	Swap rules lexer for much faster one. ... This swaps github.com/kivikakk/golex for github.com/cznic/golex. The old lexer would have taken 3.5 years to load a set of 5000 test rules (quadratic time complexity for input length), whereas this one takes only 32ms. Furthermore, since the new lexer is embedded differently, this gets rid of the global parser variables and makes the rule loader fully reentrant without a lock.	12 years ago
Julius Volz	d2da21121c	Implement getValueRangeAtIntervalOp for faster range queries. ... This also short-circuits optimize() for now, since it is complex to implement for the new operator, and ops generated by the query layer already fulfill the needed invariants. We should still investigate later whether to completely delete operator optimization code or extend it to support getValueRangeAtIntervalOp operators.	12 years ago
Matt T. Proud	30b1cf80b5	WIP - Snapshot of Moving to Client Model.	12 years ago
Julius Volz	8ee7947b1e	Ensure metric name is dropped correctly from alert labels in UI.	12 years ago
Julius Volz	0226d1ac7a	Implement alerts dashboard and expression console links.	12 years ago
Julius Volz	ba29d07901	Show loaded rules in Status dashboard.	12 years ago
Julius Volz	fc97e688c6	Improve printing of rules and expressions.	12 years ago
Julius Volz	74cb676537	Implement Stringer interface for rules and all their children.	12 years ago
Matt T. Proud	2c3df44af6	Ensure database access waits until it is started. ... This commit introduces a channel message to ensure serving state has been reached with the storage stack before anything attempts to use it.	12 years ago
Julius Volz	51689d965d	Add debug timers to instant and range queries. ... This adds timers around several query-relevant code blocks. For now, the query timer stats are only logged for queries initiated through the UI. In other cases (rule evaluations), the stats are simply thrown away. My hope is that this helps us understand where queries spend time, especially in cases where they sometimes hang for unusual amounts of time.	12 years ago
Julius Volz	adb87816f4	Put RuleManager concurrency in hands of caller, fix races.	12 years ago
Julius Volz	138334fb31	Fix handling of negative deltas for non-counter values.	12 years ago
Julius Volz	66d4620061	Don't assume delta has at least one sample per vector element.	12 years ago
Julius Volz	21c3be0814	Skip any empty range/boundary elements, not only nil ones.	12 years ago
Matt T. Proud	c10780c966	Introduce telemetry for rule evaluator durations. ... This commit adds telemetry for the Prometheus expression rule evaluator, which will enable meta-Prometheus monitoring of customers to ensure that no instance is falling behind in answering routine queries. A few other sundry simplifications are introduced, too.	12 years ago
Julius Volz	750f862d9a	Use GetBoundaryValues() for non-counter deltas.	12 years ago
Julius Volz	5b105c77fc	Repointerize fingerprints.	12 years ago
Matt T. Proud	8f4c7ece92	Destroy naked returns in half of corpus. ... The use of naked return values is frowned upon. This is the first of two bulk updates to remove them.	12 years ago
juliusv	516101f015	Merge pull request #250 from prometheus/refactor/drop-unused-storage-setting ... Drop unused writeMemoryInterval	12 years ago
juliusv	9ff00b651d	Merge pull request #251 from prometheus/fix/memory-metric-mutability ... Fix GetMetricForFingerprint() metric mutability.	12 years ago
Bernerd Schaefer	63d9988b9c	Drop unused writeMemoryInterval	12 years ago
Bernerd Schaefer	aa96c7d141	Fix rules_test.go ... This is smelly, but for now we copy a helper method from the metric tests into rules.	12 years ago
Julius Volz	83c60ad43a	Fix GetMetricForFingerprint() metric mutability. ... Some users of GetMetricForFingerprint() end up modifying the returned metric labelset. Since the memory storage's implementation of GetMetricForFingerprint() returned a pointer to the metric (and maps are reference types anyways), the external mutation propagated back into the memory storage. The fix is to make a copy of the metric before returning it.	12 years ago
Bernerd Schaefer	428d91c86f	Rename test helper files to helpers_test.go ... This ensures that these files are properly included only in testing.	12 years ago
Matt T. Proud	244a4a9cdb	Update to go1.1. ... This commit updates the documentation, Makefiles, formatting, and code semantics to support the 1.1. runtime, which includes ... 1. ``make advice``, 2. ``make format``, and 3. ``go fix`` on various targets.	12 years ago
Matt T. Proud	161c8fbf9b	Include deletion processor for long-tail values. ... This commit extracts the model.Values truncation behavior into the actual tiered storage, which uses it and behaves in a peculiar way—notably the retention of previous elements if the chunk were to ever go empty. This is done to enable interpolation between sparse sample values in the evaluation cycle. Nothing necessarily new here—just an extraction. Now, the model.Values TruncateBefore functionality would do what a user would expect without any surprises, which is required for the DeletionProcessor, which may decide to split a large chunk in two if it determines that the chunk contains the cut-off time.	12 years ago
Julius Volz	0877680761	Implement a COUNT ... BY aggregation operator. ... This also removes the now obsolete scalar count() function and corrects the expressions test naming (broken in 2202cd71c9 (L6R59)) so that the expression tests will actually run.	12 years ago
Julius Volz	56324d8ce2	Make AST query storage non-global.	12 years ago
Matt T. Proud	ce45787dbf	Storage interface to TieredStorage. ... This commit drops the Storage interface and just replaces it with a publicized TieredStorage type. Storage had been anticipated to be used as a wrapper for testability but just was not used due to practicality. Merely overengineered. My bad. Anyway, we will eventually instantiate the TieredStorage dependencies in main.go and pass them in for more intelligent lifecycle management. These changes will pave the way for managing the curators without Law of Demeter violations.	12 years ago
Julius Volz	9cea5d9df8	Convert the Prometheus configuration to protocol buffers.	12 years ago
Julius Volz	d8110fcd9c	Send sample arrays instead of single samples over channels.	12 years ago
Julius Volz	dcf2e82752	Cleanup and idiomaticize rule/expression dot graph output.	12 years ago
Matt T. Proud	b3e34c6658	Implement batch database sample curator. ... This commit introduces to Prometheus a batch database sample curator, which corroborates the high watermarks for sample series against the curation watermark table to see whether a curator of a given type needs to be run. The curator is an abstract executor, which runs various curation strategies across the database. It remarks the progress for each type of curation processor that runs for a given sample series. A curation procesor is responsible for effectuating the underlying batch changes that are request. In this commit, we introduce the CompactionProcessor, which takes several bits of runtime metadata and combine sparse sample entries in the database together to form larger groups. For instance, for a given series it would be possible to have the curator effectuate the following grouping: - Samples Older than Two Weeks: Grouped into Bunches of 10000 - Samples Older than One Week: Grouped into Bunches of 1000 - Samples Older than One Day: Grouped into Bunches of 100 - Samples Older than One Hour: Grouped into Bunches of 10 The benefits hereof of such a compaction are 1. a smaller search space in the database keyspace, 2. better employment of compression for repetious values, and 3. reduced seek times.	12 years ago
Julius Volz	2202cd71c9	Track alerts over time and write out alert timeseries.	12 years ago
Julius Volz	c0601abf46	Implement initial no-op alert parsing and rule parsing tests.	12 years ago
Matt T. Proud	f9e99bd08a	Refresh SampleValue to 64-bit floating point. ... We always knew that this needed to be fixed.	12 years ago
Julius Volz	99dcbe0f94	Integrate memory and disk layers in view rendering.	12 years ago
Julius Volz	63625bd244	Make view use memory persistence, remove obsolete code. ... This makes the memory persistence the backing store for views and adjusts the MetricPersistence interface accordingly. It also removes unused Get* method implementations from the LevelDB persistence so they don't need to be adapted to the new interface. In the future, we should rethink these interfaces. All staleness and interpolation handling is now removed from the storage layer and will be handled only by the query layer in the future.	12 years ago
Julius Volz	1eb586db7d	Fix rule evaluation closure.	12 years ago
Julius Volz	5f5ea03105	Run "make format".	12 years ago
Julius Volz	1cff4f3d91	Fix rate() per-second adjustment. ... This got broken during the depointerization of the Vector type.	12 years ago
juliusv	62f33f1fc2	Merge pull request #138 from prometheus/julius-fix-aliasing ... Correct delta()/rate() intervals and temporal aliasing.	12 years ago
Matt T. Proud	167504efd6	Merge pull request #142 from prometheus/julius-lowercase-by ... Allow lower-case BY operator.	12 years ago
Julius Volz	d53b8cf956	Correct delta()/rate() intervals and temporal aliasing.	12 years ago
Julius Volz	000f6a2e23	Allow lower-case BY operator.	12 years ago
Julius Volz	a0d311c9e6	Constantize job name label.	12 years ago
Julius Volz	1bc83e1b65	Also allow lower-cased aggregation ops.	12 years ago
juliusv	f9c291120f	Merge pull request #123 from prometheus/julius-propagate-rule-errors ... Propagate more errors during rule evaluation.	12 years ago
Julius Volz	9a81b9838f	Make expression parser goroutine-safe. ... See https://github.com/prometheus/prometheus/issues/127	12 years ago
Julius Volz	6cb3c51d24	Add sort() and sort_desc() expression language functions.	12 years ago
Julius Volz	c4d0969c00	Propagate more errors during rule evaluation.	12 years ago
Julius Volz	e31591e6fe	Allow single-letter identifiers (metric and label names).	12 years ago
Julius Volz	ec413459fa	Depointerize Matrix/Vector types as well as time.Time arguments.	12 years ago
Julius Volz	676845afaf	Implement sample interpolation in query layer.	12 years ago
Matt T. Proud	c53a72a894	Test data for the curator.	12 years ago
Julius Volz	b836066c71	Eliminate need to get fingerprints during query execution time.	12 years ago
Julius Volz	55ca65aa6e	More userfriendly output when we fail to create the tiered storage.	12 years ago
Matt T. Proud	c4e971d7d9	Merge pull request #101 from prometheus/refactor/test/directory-extraction ... Create temporary directory handler.	12 years ago
Matt T. Proud	b86b0ea41a	Create temporary directory handler.	12 years ago
Julius Volz	2b8f0b2cc7	Constantize metric name label name.	12 years ago
Julius Volz	3880a86c9c	In case of empty query results, return an empty matrix.	12 years ago
Julius Volz	8e4c5b0cea	Use AST query analyzer and views with tiered storage.	12 years ago
Julius Volz	2f814d0e6d	AST persistence adapter simplifications after storage changes.	12 years ago
Julius Volz	6001d22f87	Change Get* methods to receive fingerprints instead of metrics.	12 years ago
Matt T. Proud	5959cd9e53	Include Julius' feedback.	12 years ago
Matt T. Proud	a70ee43ad3	Niladic ``ToString()`` to idiomatic ``String()``.	12 years ago
Matt T. Proud	41068c2e84	Checkpoint.	12 years ago
Matt T. Proud	13ae29b304	Initial in-memory arena implementation. ... It is unbounded, and nothing uses it except for a gating flag in main.	12 years ago
Julius Volz	c3d31febd6	Move durationToString to common place and cleanup error handling.	12 years ago
Matt T. Proud	efbe0e8a12	Interface simplification. ... GetMetricForFingerprint(model.Fingerprint) (*Metric, error) -> GetMetricForFingerprint(model.Fingerprint) (Metric, error)	12 years ago
Matt T. Proud	e8a733b525	Interface simplifications. ... GetFingerprintsForLabelSet ([]*Fingerprint, error) -> GetFingerprintsForLabelSet ([]Fingerprint, error)	12 years ago
Matt T. Proud	f03091b139	Interface simplifications: GetRangeValues ... From pointers to copies.	12 years ago
Matt T. Proud	56f069b3ec	Interface simplifications: GetValueAtTime(). ... Pointer arguments to copies.	12 years ago
Matt T. Proud	900bb988c1	Simplifications of GetFingerprintsForLabelSet. ... ``MetricPersistence.GetFingerprintsForLabelSet(s *model.LabelSet)`` -> ``MetricPersistence.GetFingerprintsForLabelSet(s model.LabelSet)``.	12 years ago
Matt T. Proud	4fbcea73f5	MetricPersistence.AppendSample signature changes. ... ``MetricPersistence.AppendSample(*model.Sample)`` -> ``MetricPersistence.AppendSample(model.Sample)``.	12 years ago
Julius Volz	06ace4941d	Remove/replace last references to github.com/matttproud/...	12 years ago
Julius Volz	16d9dcd6a8	Add copyright notices to all remaining files.	12 years ago
Julius Volz	d67e4b9131	Address outstanding comments from PR/47 and other cleanups.	12 years ago
Matt T. Proud	ea54751431	Update import paths to new location. ... This repository moved from matttproud/prometheus to prometheus/prometheus, and all import paths need to be updated.	12 years ago
Julius Volz	c049ae39af	Cleanups to rules/persistence adapter code.	12 years ago
juliusv	619aa97025	Only close rule file if it could be opened.	12 years ago
Julius Volz	a85204a0a4	Add support for matrix duration strings without quotes.	12 years ago
Julius Volz	1760d927c8	Add error propagation to web UI via special JSON error type.	12 years ago
Julius Volz	49c87348b5	Implement per-second rate behavior for rate().	12 years ago
Julius Volz	93670aa129	Return API errors in JSON format.	12 years ago
Julius Volz	a20bf35997	Fix whitespace with "make format".	12 years ago
Julius Volz	c21450a089	Use correct label name for metric name in rule.	12 years ago
Julius Volz	6929c10acf	Add case-statement for OR, which still needs to be implemented.	12 years ago
Julius Volz	a555ded2b3	Add "w" (weeks) as a valid timeunit.	12 years ago
Julius Volz	2c8595f96e	First graphing support.	12 years ago
Matt T. Proud	efe61c18fa	Refactor target scheduling to separate facility. ... ``Target`` will be refactored down the road to support various nuanced endpoint types. Thusly incorporating the scheduling behavior within it will be problematic. To that end, the scheduling behavior has been moved into a separate assistance type to improve conciseness and testability. ``make format`` was also run.	12 years ago
Julius Volz	cb6eb30182	Fix state cleanup bug between rule/config parser runs. ... This fixes a bug that has been annoying me minorly for some time now: sometimes, after parse errors, a subsequent parser run would fail. The reason is that yylex() modifies some global variables (yytext, yydata) during its run to keep state. To make subsequent parser runs correct, these have to be reset before each run. Also, close files after reading them.	12 years ago
Julius Volz	17a4a442b3	Add REST API, expression browser, and text/JSON output formats.	12 years ago
Julius Volz	06162180ad	Implement matrix range and boundary fetching from metrics store.	12 years ago
Julius Volz	483bd81a44	Allow grammar to parse both rules and single expressions.	12 years ago
Julius Volz	c52b959fda	Fix matrix interval time calculation.	12 years ago
Julius Volz	fdf9a3aab7	Fix node type checks in arithmetic expressions.	12 years ago
Julius Volz	c4a2358551	Set correct interval in MatrixLiteral.Eval().	12 years ago
Julius Volz	429b66019c	Exclude metric name in vector arithmetric label matching.	12 years ago
Julius Volz	56384bf42a	Add initial config and rule language implementation.	12 years ago