188 Commits (5859b74f1bb19cd3121e766f06ed762509571232)

Author	SHA1	Message	Date
Julius Volz	01f652cb4c	Separate storage implementation from interfaces. ... This was initially motivated by wanting to distribute the rule checker tool under `tools/rule_checker`. However, this was not possible without also distributing the LevelDB dynamic libraries because the tool transitively depended on Levigo: rule checker -> query layer -> tiered storage layer -> leveldb This change separates external storage interfaces from the implementation (tiered storage, leveldb storage, memory storage) by putting them into separate packages: - storage/metric: public, implementation-agnostic interfaces - storage/metric/tiered: tiered storage implementation, including memory and LevelDB storage. I initially also considered splitting up the implementation into separate packages for tiered storage, memory storage, and LevelDB storage, but these are currently so intertwined that it would be another major project in itself. The query layers and most other parts of Prometheus now have notion of the storage implementation anymore and just use whatever implementation they get passed in via interfaces. The rule_checker is now a static binary :) Change-Id: I793bbf631a8648ca31790e7e772ecf9c2b92f7a0	11 years ago
Matt T. Proud	2064f32662	Clean up quitting behavior and add quit trigger. ... The closing of Prometheus now using a sync.Once wrapper to prevent any accidental multiple invocations of it, which could trigger corruption or a race condition. The shutdown process is made more verbose through logging. A not-enabled by default web handler has been provided to trigger a remote shutdown if requested for debugging purposes. Change-Id: If4fee75196bbff1fb1e4a4ef7e1cfa53fef88f2e	11 years ago
Julius Volz	cc04238a85	Switch to new "__name__" metric name label. ... This also fixes the compaction test, which before worked only because the input sample sorting was accidentally equal to the resulting on-disk sample sorting. Change-Id: I2a21c4b46ba562424b27058fc02eba84fa6a6006	11 years ago
Julius Volz	740d448983	Use custom timestamp type for sample timestamps and related code. ... So far we've been using Go's native time.Time for anything related to sample timestamps. Since the range of time.Time is much bigger than what we need, this has created two problems: - there could be time.Time values which were out of the range/precision of the time type that we persist to disk, therefore causing incorrectly ordered keys. One bug caused by this was: https://github.com/prometheus/prometheus/issues/367 It would be good to use a timestamp type that's more closely aligned with what the underlying storage supports. - sizeof(time.Time) is 192, while Prometheus should be ok with a single 64-bit Unix timestamp (possibly even a 32-bit one). Since we store samples in large numbers, this seriously affects memory usage. Furthermore, copying/working with the data will be faster if it's smaller. *MEMORY USAGE RESULTS* Initial memory usage comparisons for a running Prometheus with 1 timeseries and 100,000 samples show roughly a 13% decrease in total (VIRT) memory usage. In my tests, this advantage for some reason decreased a bit the more samples the timeseries had (to 5-7% for millions of samples). This I can't fully explain, but perhaps garbage collection issues were involved. *WHEN TO USE THE NEW TIMESTAMP TYPE* The new clientmodel.Timestamp type should be used whenever time calculations are either directly or indirectly related to sample timestamps. For example: - the timestamp of a sample itself - all kinds of watermarks - anything that may become or is compared to a sample timestamp (like the timestamp passed into Target.Scrape()). When to still use time.Time: - for measuring durations/times not related to sample timestamps, like duration telemetry exporting, timers that indicate how frequently to execute some action, etc. *NOTE ON OPERATOR OPTIMIZATION TESTS* We don't use operator optimization code anymore, but it still lives in the code as dead code. It still has tests, but I couldn't get all of them to pass with the new timestamp format. I commented out the failing cases for now, but we should probably remove the dead code soon. I just didn't want to do that in the same change as this. Change-Id: I821787414b0debe85c9fffaeb57abd453727af0f	11 years ago
Conor Hennessy	eba01d1119	Remove usage of gorest. ... Due to on going issues, we've decided to remove gorest. It started with gorest not being thread-safe (it does introspection to create a new handler which is an easy process to mess up with multiple threads of execution): https://code.google.com/p/gorest/issues/detail?id=15 While the issue has been marked fixed, it looks like the patch has introduced more problems than the original issue and simply doesn't work properly. I'm not sure the behaviour was thought through properly. If a new instance is needed every request then a handler-factory is needed or the library needs to set expectations about how the new objects should interact with their constructor state. While it was tempting to try out another routing library, I think for now it's better to use dumb vanilla Go routing. At least until we decide which URL format we intend to standardize on. Change-Id: Ica3da135d05f8ab8fc206f51eeca4f684f8efa0e	11 years ago
Julius Volz	a50ee8df30	Always set CORS headers at beginning of API handler. ... Change-Id: Icde9a74260c4bb919f09c3e10c6dd5f372ccdaec	11 years ago
Matt T. Proud	4a87c002e8	Update low-level i'faces to reflect wireformats. ... This commit fixes a critique of the old storage API design, whereby the input parameters were always as raw bytes and never Protocol Buffer messages that encapsulated the data, meaning every place a read or mutation was conducted needed to manually perform said translations on its own. This is taxing. Change-Id: I4786938d0d207cefb7782bd2bd96a517eead186f	11 years ago
Julius Volz	788587426b	Make scrape timeouts configurable per job. ... Change-Id: I77a7514ad9e7969771f873d63d6353ec50082a62	11 years ago
Matt T. Proud	972e856d9b	Kill the curation state channel. ... The use of the channels for curation state were always unidiomatic. Change-Id: I1cb1d7175ebfb4faf28dff84201066278d6a0d92	11 years ago
Julius Volz	0003027dce	Add needed trailing spaces in logs.	11 years ago
Julius Volz	aa5d251f8d	Use github.com/golang/glog for all logging.	11 years ago
Julius Volz	ecf0ee8f39	Transfer alerting rule and Prometheus URL to alertmanager.	11 years ago
Matt T. Proud	07ac921aec	Code Review: First pass.	11 years ago
Matt T. Proud	d8792cfd86	Extract HighWatermarking. ... Clean up the rest.	11 years ago
Julius Volz	fcf784c13c	Fix query error notification in tabular view. ... Instead of "Unsupported value type" when type="error", the delivered error message should be shown.	11 years ago
Julius Volz	35ee2cd3cb	Add alertmanager notification support to Prometheus. ... Alert definitions now also have mandatory SUMMARY and DESCRIPTION fields that get sent along a firing alert to the alert manager.	11 years ago
Julius Volz	4e941255d8	Add caching to static assets when served from blob handler.	12 years ago
Julius Volz	1b9cbaf842	Bootstrappify remaining status pages.	12 years ago
Julius Volz	481ee4096b	Add no-op silencing links.	12 years ago
Julius Volz	d9f403ab7d	Prettify/Bootstrapify alert tables.	12 years ago
Julius Volz	f665534b61	Make quote and semicolon usage consistent in graph.js	12 years ago
Julius Volz	c91c100102	Fix graph resize bug when no graph exists.	12 years ago
Julius Volz	9f07f8677a	Generate tabular console view from JSON data.	12 years ago
Sabra Melamed	22ab2366c1	Replacing interface components with Bootstrap. ... This commit includes Bootstrap 2.3.2 and swaps a multitude of graph, status, and other components to Bootstrap-based widgets.	12 years ago
Matt T. Proud	f7704af4f8	Code Review: Formatting comments.	12 years ago
Matt T. Proud	06b4a40661	Represent targets in a tabular interface. ... This commit represents a target group's endpoints in a tabular fashion for better differentiation of their state in a concise manner.	12 years ago
Julius Volz	f42adc1cc0	Display Y-axis outside of graph.	12 years ago
Julius Volz	1aa8f071b9	Add content compression support to API HTTP responses.	12 years ago
Matt T. Proud	30b1cf80b5	WIP - Snapshot of Moving to Client Model.	12 years ago
Julius Volz	0226d1ac7a	Implement alerts dashboard and expression console links.	12 years ago
Johannes 'fish' Ziemke	005d65868a	Merge pull request #294 from prometheus/remove-gvm ... Remove gvm	12 years ago
Johannes 'fish' Ziemke	56249320e3	Remove gvm on travis.	12 years ago
Julius Volz	1fe3d3b06b	Remove obsolete argument from target handling code.	12 years ago
Julius Volz	ba29d07901	Show loaded rules in Status dashboard.	12 years ago
Matt T. Proud	a73f061d3c	Persist solely Protocol Buffers. ... An design question was open for me in the beginning was whether to serialize other types to disk, but Protocol Buffers quickly won out, which allows us to drop support for other types. This is a good start to cleaning up a lot of cruft in the storage stack and can let us eventually decouple the various moving parts into separate subsystems for easier reasoning. This commit is not strictly required, but it is a start to making the rest a lot more enjoyable to interact with.	12 years ago
Bernerd Schaefer	f7a2436665	Include link to user dashboard when provided	12 years ago
Bernerd Schaefer	1d794896ac	Support user-provided static asset directory ... [fix #159]	12 years ago
Julius Volz	51689d965d	Add debug timers to instant and range queries. ... This adds timers around several query-relevant code blocks. For now, the query timer stats are only logged for queries initiated through the UI. In other cases (rule evaluations), the stats are simply thrown away. My hope is that this helps us understand where queries spend time, especially in cases where they sometimes hang for unusual amounts of time.	12 years ago
Matt T. Proud	0d2d6e9a27	Include uptime in the status console. ... In order to help corroborate whether a Prometheus instance has flapped until meta-monitoring is in-place, we ought to provide the instance's start time in the console to aid in diagnostics.	12 years ago
Julius Volz	8586c7520c	Support negative graph values. ... Currently graph Y-Axes were hardcoded to start at 0. Choose the Y-scale automatically based on the graph data instead.	12 years ago
Julius Volz	081191afb8	Remember and display last scrape errors in web UI.	12 years ago
Matt T. Proud	1a95406b81	Include forgotten databases.html.	12 years ago
Matt T. Proud	b224251981	Simplify compaction and expose database sizes. ... This commit simplifies the way that compactions across a database's keyspace occur due to reading the LevelDB internals. Secondarily it introduces the database size estimation mechanisms. Include database health and help interfaces. Add database statistics; remove status goroutines. This commit kills the use of Go routines to expose status throughout the web components of Prometheus. It also dumps raw LevelDB status on a separate /databases endpoint.	12 years ago
Bernerd Schaefer	cdde766f39	Embed mutex on web status handler	12 years ago
Bernerd Schaefer	7740167654	Add comments about potential race conditions	12 years ago
Bernerd Schaefer	9183302b1f	Web handler returns 404 for favicon requests	12 years ago
Matt Proud	7f0d816574	Schedule the background compactors to run. ... This commit introduces three background compactors, which compact sparse samples together. 1. Older than five minutes is grouped together into chunks of 50 every 30 minutes. 2. Older than 60 minutes is grouped together into chunks of 250 every 50 minutes. 3. Older than one day is grouped together into chunks of 5000 every 70 minutes.	12 years ago
Julius Volz	af7920126c	Fix build errors and add default build step to "make".	12 years ago
Julius Volz	56324d8ce2	Make AST query storage non-global.	12 years ago
Matt T. Proud	3b9b1c6ab4	Define dependencies for web. stack concretely. ... This commit destroys the use of AppState, which makes passing concrete state along to various serving components onerous.	12 years ago
juliusv	cfc3b1053d	Merge pull request #212 from prometheus/ui/smaller-navigation-links ... Restyle navigation a bit, align content elements with it	12 years ago
juliusv	2935476818	Merge pull request #211 from prometheus/feature/reorder-hud-elements ... Move build info to the top of the status HUD.	12 years ago
Julius Volz	04e661c28f	Move build info to the top of the status HUD.	12 years ago
Julius Volz	f3cf8eae7e	Restyle navigation a bit, align content elements with it.	12 years ago
Johannes 'fish' Ziemke	c5e507cd9c	Never submit empty queries.	12 years ago
juliusv	2b9ba56d61	Merge pull request #208 from prometheus/feature/toggle-console ... Add the console to the main/graph ui.	12 years ago
Johannes 'fish' Ziemke	ba289ef7cd	Add the console to the main/graph ui.	12 years ago
Julius Volz	9cea5d9df8	Convert the Prometheus configuration to protocol buffers.	12 years ago
Matt T. Proud	3362bf36e2	Include curator status in web heads-up-display.	12 years ago
Matt T. Proud	a48ab34dd0	Refresh Prometheus client API usage. ... The client API has been updated per https://github.com/prometheus/client_golang/pull/9.	12 years ago
juliusv	169a7dc26c	Merge pull request #189 from prometheus/feature/build-info-and-startup-friendliness ... Build info and startup friendliness	12 years ago
Bernerd Schaefer	19fc094362	Merge pull request #191 from prometheus/update-gitignore-files ... Ignore web/static/generated and build/root/share	12 years ago
Bernerd Schaefer	169ed9d297	Ignore web/static/generated and build/root/share	12 years ago
Matt T. Proud	961ff26874	Fix positional flags for ``cp`` on Darwin. ... Unfortunately ``cp`` on Darwin regards some flags as positional and requires them to be in a specific place. The new Protocol Buffer descriptor bundling fails on Mac OS.	12 years ago
Bernerd Schaefer	45243ac2da	Print flags on status page.	12 years ago
Bernerd Schaefer	862054e88b	web.StartServing prints listening address	12 years ago
Bernerd Schaefer	a2a4f94aae	StatusHandler renders build info	12 years ago
Johannes 'fish' Ziemke	1f96d4c822	Move protobuf descriptor and add content-type. ... - move to static/generated - set content-type based on extension '.description'	12 years ago
Matt T. Proud	9e02c2393a	Include generated Protocol Buffer descriptor. ... The Protocol Buffer compiler supports generating a machine-readable descriptor file encoded as a provided Protocol Buffer message type, which can be used to decode messages that have been encoded with it after-the-fact. The generated descriptor also bundles in dependent message types. We can use this to perform forensics on old Prometheus clients, if necessary.	12 years ago
Matt T. Proud	e86f4d9dfd	Convert time readers to represent time in UTC. ... Go's time.Time represents time as UTC in its fundamental data type. That said, when using ``time.Unix(...)``, it sets the zone for the time representation to the local. Unfortunately with diagnosis and our tests, it is a PITA to jump between various zones, even though the serialized version remains the same. To keep things easy, all places where times are generated or read are converted into UTC. These conversions are cheap, for ``Time.In`` merely changes a pointer reference in the struct, nothing more. This enables me to diagnose test failures with fixture data very easily.	12 years ago
Johannes 'fish' Ziemke	955708e8db	Merge pull request #158 from prometheus/feature/auto-refresh ... Add per graph auto-refresh option to web UI.	12 years ago
Julius Volz	a2623efcdf	Register pprof /debug endpoints with custom HTTP mux.	12 years ago
Johannes 'fish' Ziemke	712bf5e2f9	Add per graph auto-refresh option to web UI. ... This adds a drop-down menu to select/disable a auto-refresh interval.	12 years ago
Julius Volz	a0d311c9e6	Constantize job name label.	12 years ago
juliusv	f21b5ad12b	Merge pull request #133 from bernerdschaefer/graph-display-tweaks ... Graph display tweaks	12 years ago
Bernerd Schaefer	72bd585485	Revert style change to legend items	12 years ago
juliusv	f817106d6a	Merge pull request #134 from prometheus/fix/set-job-label-from-targets-api ... Set job label for targets registered through the API	12 years ago
juliusv	f89d4c2cac	Merge pull request #128 from prometheus/feature/convert-host-relative-links ... Convert addresses pointing to localhost in status.	12 years ago
Johannes 'fish' Ziemke	14407a076a	Convert addresses pointing to localhost in status. ... Until now, targets pointing to localhost in the status view are linked to localhost, so you can't follow those links by clicking on them. This change converts the links to point to the hostname of the prometheus server. Before: <a href="http://localhost:9090/metrics.json">http://localhost:9090/metrics.json</a> After: <a href="http://hostname-of-prometheus-server:9090/metrics.json">http://localhost:9090/metrics.json</a>	12 years ago
Bernerd Schaefer	8af0bbb3a0	Set job label for targets registered through the API ... This is set when jobs are statically registered (see retrieval/targetmanager.go#L92), and should be set here, too.	12 years ago
Bernerd Schaefer	442a6d2b11	Use $ instead of jQuery	12 years ago
Bernerd Schaefer	953334a4f7	Reformat and add semicolons to graph.js	12 years ago
Bernerd Schaefer	43dc377bee	Flip x_label when it would render off-page	12 years ago
Bernerd Schaefer	461e02d2b8	Flip hover detail to prevent going off the screen	12 years ago
Bernerd Schaefer	8c9597cb39	Render legend in a similar style to labels	12 years ago
Bernerd Schaefer	a7ec43189a	Hovering over legend items highlights series in graph	12 years ago
Bernerd Schaefer	564633ecbc	Render graph labels vertically ... This helps to make the timeseries with many labels fit on the screen.	12 years ago
Bernerd Schaefer	5e9447996b	Set CORS Headers on API requests ... By setting Access-Control headers, the Prometheus metrics API can be accessed by cross-origin javascript applications (e.g., an external dashboard pulling Prometheus metrics).	12 years ago
Johannes 'fish' Ziemke	8fba639706	Fix path to expression browser js.	12 years ago
Johannes 'fish' Ziemke	adeabca230	Minor UI fixes. ... - Fix path to spinner - Fix color for unvisited links - Include necessary jqueryui images	12 years ago
Johannes 'fish' Ziemke	e43d7d5771	Make Prometheus self-contained. ... This includes all external resources instead of hotlinking them.	12 years ago
Johannes 'fish' Ziemke	17f622bd6e	Take Path fragment from URL instead of whole URL. ... This also makes better error handling in case a asset couldn't be found in the files map.	12 years ago
Johannes 'fish' Ziemke	bf197baaf9	Depend on all static and template files.	12 years ago
Johannes 'fish' Ziemke	c108a9978d	Merge branch 'master' of github.com:prometheus/prometheus into feature/navigation ... Conflicts: web/web.go	12 years ago
Johannes 'fish' Ziemke	0f775a4178	Use Sprintf instead of string concatenation.	12 years ago
Johannes 'fish' Ziemke	1c091a9723	Use client_golang.exp for automatic telemetry.	12 years ago
Johannes 'fish' Ziemke	3aead8468c	Fix typo.	12 years ago
Johannes 'fish' Ziemke	84d17b4d97	Replace YieldExporter() with Handler()	12 years ago
Johannes 'fish' Ziemke	1cb4c819e1	Remove cruft.	12 years ago
Johannes 'fish' Ziemke	1a3fb459e0	Add navigation menu to all pages + change routes. ... To achieve that, this PR - converts static/index.html ("console") and graph to templates - moved the handlebars template to separated file to avoid escaping issues Route changes: /status -> / /static -> /console /static/graph.html -> /graph	12 years ago