prometheus

Commit Graph

Author	SHA1	Message	Date
Fabian Reinartz	74c448386c	Merge pull request #1665 from prometheus/fabxc-retrpanic Fix kubernetes SD crash	9 years ago
Fabian Reinartz	12b03db373	retrieval: handle nil target groups from updates	9 years ago
Fabian Reinartz	ea36efbbd1	retrieval: document panic behavior	9 years ago
Fabian Reinartz	a5ba166935	retrieval: don't panic on non-HTTP scheme	9 years ago
stuart nelson	d02591814b	discovery/dns: move dns to own package	9 years ago
Fabian Reinartz	f94fc76608	Merge pull request #1592 from prometheus/fabxc-consul-ref discovery: sanitize Consul service discovery	9 years ago
Fabian Reinartz	9f8feb9ff6	discovery: consolidate Marathon SD files	9 years ago
Fabian Reinartz	5837e6a97f	discovery: move consul SD into own package	9 years ago
Seth Miller	0988e3b937	Add support for Azure discovery This change adds the ability to do target discovery with Microsoft's Azure platform.	9 years ago
Fabian Reinartz	769389e559	Fix potential race in ctx intialization	9 years ago
Fabian Reinartz	f2e359962c	Sort exported targets	9 years ago
Fabian Reinartz	56fc9bdff3	Handle closed target provider channel This fixes the case where a target provider closes the update channel and exits before the context is canceled. This should only be true for the static provider but it's safer to generally handle this case.	9 years ago
Fabian Reinartz	2060a0a15b	Turn target group members into plain lists. As the scrape pool deduplicates targets now, it is no longer necessary to store a hash map for members of each group.	9 years ago
Fabian Reinartz	0d7105abee	Remove scrape config from Target. This commit removes the scrapeConfig entirely from Target. All identity defining parameters are thus immutable now and the mutex can be removed.. Target identity is now correctly defined by the labels and the full URL. This in particular includes URL parameters that are not specified in the label set. Fingerprint is also removed from hash to remove an unnecessary tight coupling to the common/model package.	9 years ago
Fabian Reinartz	75681b691a	Extract HTTP client from Target. The HTTP client is the same across all targets with the same scrape configuration. Thus, this commit moves it into the scrape pool.	9 years ago
Fabian Reinartz	76a8c6160d	Deduplicate targets in scrape pool. With this commit the scrape pool deduplicates incoming targets before scraping them. This way multiple target providers can produce the same target but it will be scraped only once.	9 years ago
Fabian Reinartz	84f74b9a84	Apply new scrape config on reload. This commit updates a target set's scrape configuration on reload. This will cause all running scrape loops to be stopped and started again with new parameters.	9 years ago
Fabian Reinartz	775316f8d2	Move appender construction from Target to scrapePool	9 years ago
Fabian Reinartz	05de8b7f8d	Extract target scraping into scrape loop. This commit factors out the scrape loop handling into its own data structure. For the transition it will be directly attached to the target.	9 years ago
Fabian Reinartz	cebba3efbb	Simplify and fix TargetManager reloading	9 years ago
Fabian Reinartz	d15adfc917	Preserve target state across reloads. This commit moves Scraper handling into a separate scrapePool type. TargetSets only manage TargetProvider lifecycles and sync the retrieved updates to the scrapePool. TargetProviders are now expected to send a full initial target set within 5 seconds. The scrapePools preserve target state across reloads and only drop targets after the initial set was synced.	9 years ago
Fabian Reinartz	5b30bdb610	Change TargetProvider interface. This commit changes the TargetProvider interface to use a context.Context and send lists of TargetGroups, rather than single ones.	9 years ago
Fabian Reinartz	5bfa4cdd46	Simplify target update handling. We group providers by their scrape configuration. Each provider produces target groups with an unique identifier. On stopping a set of target providers we cancel the target providers, stop scraping the targets and wait for the scrapers to finish. On configuration reload all provider sets are stopped and new ones are created. This will make targets disappear briefly on configuration reload. Potentially scrapes are missed but due to the consistent scrape intervals implemented recently, the impact is minor.	9 years ago
Fabian Reinartz	6df1f49c13	Remove fullLabels method and fix target updating With recent changes to a Target's internal data representation updating by fullLabels() assigns the additional default instance label. This breaks target identity comparison and causes identical targets from service discovery to be constantly swapped.	9 years ago
Fabian Reinartz	825831e98f	Use fingerprint for target identity comparison So far we were using the InstanceIdentifier to compare equality of targets. This is not always accurate, for example for the blackbox exporter where the actual target is in the parameter.	9 years ago
Fabian Reinartz	a06bc75519	Remove occurrences of 'base' labels	9 years ago
Julius Volz	3728b5872f	Fix target update error handling. Fixes https://github.com/prometheus/prometheus/issues/1378	9 years ago
beorn7	ec08c9a391	Rework the way to communicate backpressure (AKA suspended ingestion) This gives up on the idea to communicate throuh the Append() call (by either not returning as it is now or returning an error as suggested/explored elsewhere). Here I have added a Throttled() call, which has the advantage that it can be called before a whole _batch_ of Append()'s. Scrapes will happen completely or not at all. Same for rule group evaluations. That's a highly desired behavior (as discussed elsewhere). The code is even simpler now as the whole ingestion buffer could be removed. Logging of throttled mode has been streamlined and will create at most one message per minute.	9 years ago
Julien Dehee	061fe2f364	Support AirBnB's Smartstack Nerve client for SD nerve's registration format differs from serverset. With this commit there is now a dedicated treecache file in util, and two separate files for serverset and nerve. Reference: https://github.com/airbnb/nerve	9 years ago
Fabian Reinartz	29a69eecb8	Do not panic in Consul SD creation	9 years ago
Brian Brazil	427bf29db1	Add in default port after relabelling. For the SNMP and blackbox exporters where the ports tends to not be 80/443 and indeed there may not be a port this makes the relabelling a bit simpler as you don't have to figure out this logic exists and strip off the :80. This is a breaking change for the example configs of those exporters.	9 years ago
Brian Brazil	fd2bd81cd8	Allow all instance labels in target groups With the blackbox exporter, the instance label will commonly be used for things other than hostnames so remove this restriction. https://example.com or https://example.com/probe/me are some examples. To prevent user error, check that urls aren't provided as targets when there's no relabelling that could potentically fix them.	9 years ago
Julius Volz	d88aea7e6f	Fix SD mechanism source prefix handling. The prefixed target provider changed a pointerized target group that was reused in the wrapped target provider, causing an ever-increasing chain of source prefixes in target groups from the Consul target provider. We now make this bug generally impossible by switching the target group channel from pointer to value type and thus ensuring that target groups are copied before being passed on to other parts of the system. I tried to not let the depointerization leak too far outside of the channel handling (both upstream and downstream) because I tried that initially and caused some nasty bugs, which I want to minimize. Fixes https://github.com/prometheus/prometheus/issues/1083	9 years ago
Matt Jibson	dcb4856d72	Add SD for Amazon EC2 instances	9 years ago
Fabian Reinartz	e3b6ec9784	Switch to common/log	9 years ago
Julius Volz	99e8fff872	Fix target manager CPU busyloop caused by bad done-channel handling. Unfortunately this isn't nicely testable, as it's timing-dependent and one would have to detect a stray goroutine doing a CPU busyloop... Fixes https://github.com/prometheus/prometheus/issues/1114	9 years ago
Fabian Reinartz	cc1a2a2061	Remove attachment of global labels upon ingestion	9 years ago
Fabian Reinartz	ebf417a282	Fix map initialization	9 years ago
Julius Volz	995d3b831d	Fix most golint warnings. This is with `golint -min_confidence=0.5`. I left several lint warnings untouched because they were either incorrect or I felt it was better not to change them at the moment.	9 years ago
Julius Volz	d36a7f4e6f	Fix busylooping in case of no target providers. merge() closes the channel that handleUpdates() reads from when there are zero configured target providers in the configuration. In that case, the for-select loop in handleUpdates() entered a busy loop. It should exit when the upstream channel is closed.	9 years ago
Fabian Reinartz	438e232c9b	Fix grouping of import blocks	9 years ago
Fabian Reinartz	306e8468a0	Switch from client_golang/model to common/model	9 years ago
Fabian Reinartz	f592740bac	Only exit static target provider on done	9 years ago
Fabian Reinartz	4e84b86510	Improve target discovery pipeline Replace the TargetProvider Stop method with done channels that ensure properly broadcasted shutdown of the whole pipeline.	9 years ago
Fabian Reinartz	625374ee36	Clarify docs of TargetProvider	9 years ago
Jimmi Dyson	923f8111d4	Initial Kubernetes discovery Fixes #904	9 years ago
Fabian Reinartz	0138d37458	Improve unique target group sources. Include position of same SD mechanisms within the same scrape configuration. Move unique prefixing out of SD implementations and target manager into its own interface.	9 years ago
Fabian Reinartz	54202bc5a8	Merge pull request #902 from xperimental/feature/marathon-discovery retrieval/discovery: Service discovery using marathon API	9 years ago
Robert Jacob	4d0f974c42	Add service discovery using Marathon API.	9 years ago
Jimmi Dyson	da4c50a6cf	Make scheme relabelable via discovery	9 years ago

1 2

96 Commits (f24b8b6c1bb9b77df626af79c7af823a9dd44628)