Krasi Georgiev
587dec9eb9
rebased and resolved conflicts with the new Discovery GUI page
...
Signed-off-by: Krasi Georgiev <krasi.root@gmail.com>
7 years ago
Krasi Georgiev
60ef2016d5
add a cancel func to the scrape pool as it is needed in the scrape loop select block
7 years ago
Krasi Georgiev
1ec76d1950
rearange the contexts variables and logic
...
split the groupsMerge function to set and get
other small nits
7 years ago
Krasi Georgiev
6ff1d5c51e
add the scrape manager config reloader
...
handle errors with invalid scrape config
7 years ago
Krasi Georgiev
9c61f0e8a0
scrape pool doesn't rely on context as Stop() needs to be blocking to prevent Scrape loops trying to write to a closed TSDB storage.
7 years ago
Krasi Georgiev
e405e2f1ea
refactored discovery
7 years ago
conorbroderick
8b6f3a1bd3
Added service discovery view showing labels before and after relabelling
7 years ago
Krasi Georgiev
08a012ccd7
Fix for #3312 sigpanic in TargetManager ( #3420 )
7 years ago
Julius Volz
099df0c5f0
Migrate "golang.org/x/net/context" -> "context" ( #3333 )
...
In some places, where ctxhttp or gRPC are concerned, we still need to use the
old contexts.
7 years ago
Krasi Georgiev
55a1311f6a
fix golint nits ( #3291 )
7 years ago
Brian Brazil
1545842704
TrimPrefix removes a prefix, TrimLeft removes chars
7 years ago
Marc Sluiter
6a633eece1
Added go-conntrack for monitoring http connections ( #3241 )
...
Added metrics for in- and outgoing traffic with go-conntrack.
7 years ago
Tobias Schmidt
40c278ee2d
Send a HTTP Accept header when scraping
7 years ago
Fabian Reinartz
7b02bfee0a
web: start web handler while TSDB is starting up
7 years ago
Fabian Reinartz
437f51a85f
Fix cache maintenance on changing metric representations
...
We were not properly maintaining the scrape cache when the same metric
was exposed with a different string representation.
This overall reduces the scraping cache's complexity, which fixes the
issue and saves about 10% of memory in a scraping-only Prometheus
instance.
7 years ago
Fabian Reinartz
1121b9f7d4
retrieval: cache dropped series, mutate labels in place
7 years ago
Fabian Reinartz
d21f149745
*: migrate to go-kit/log
7 years ago
Fabian Reinartz
5bed8af4cb
retrieval: pool scrape buffers
...
This adds a bucketed buffer pool to the scrapers so we don't have to
allocate a new buffer on each scrape or hold it fixed to the scrape
loop.
The latter can consume significant amounts of unused memory, e.g. 4GB
when scraping 2MB /metrics from 2000 targets.
7 years ago
Fabian Reinartz
0efecea6d4
Adapt storage APIs to uint64 references
7 years ago
Krasi Georgiev
153cb0cbe3
scraping errors will show in the log when debug mode is enabled ( #3135 )
...
Signed-off-by: Krasi Georgiev <krasi.root@gmail.com>
7 years ago
Ben Kochie
59aca4138b
Fix staticcheck issues.
7 years ago
Fabian Reinartz
9516d04472
util: Add idle timeout for scrape connections
7 years ago
Edward Marshall
c490725ac9
Additional targetScrapeSample metrics ( #3018 )
7 years ago
Tom Wilkie
1f3b59ccf5
s/met/lset/
7 years ago
Tom Wilkie
014bd31a86
Remove unnecessary whitespace changes, add comment.
7 years ago
Tom Wilkie
2ac1809a5b
Get label set from cache in addReportSample.
7 years ago
Tom Wilkie
240feb313b
Don't regenerate label set for cached values.
7 years ago
Tom Wilkie
db8128ceeb
Add label set as first parameter to AddFast, ingored by TSDB adapter.
7 years ago
Goutham Veeramachaneni
243419c007
Return tsdb.ErrOutOfBounds as storage.ErrOutOfBounds
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
7 years ago
Goutham Veeramachaneni
a607873ad2
Log the stopping of TargetManager in Info
...
Fixes #2715
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
7 years ago
Goutham Veeramachaneni
643c5837a0
Stop metrics that are 10mins ahead from now
...
Fixes #2893
Signed-off-by: Goutham Veeramachaneni <goutham@boomerangcommerce.com>
7 years ago
Goutham Veeramachaneni
3069bd3996
Handle scrapes with OutOfBounds metrics better
...
fixes #2894
Signed-off-by: Goutham Veeramachaneni <goutham@boomerangcommerce.com>
7 years ago
Fabian Reinartz
9ea748e745
Don't reallocate label set if still known
...
If the storage deprecates a ref, we have to re-insert with the full
label set. Typically that doesn't correlate with a new series being
created.
We can still use the allocated label set from before.
8 years ago
Fabian Reinartz
2368d2c45b
retrieval: fix memory leak in scrape cache
8 years ago
Brian Brazil
a6ca391e6e
Reject scrapes with invalid utf-8 label values.
8 years ago
Goutham Veeramachaneni
507790a357
Rework logging to use explicitly passed logger
...
Mostly cleaned up the global logger use. Still some uses in discovery
package.
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
8 years ago
Julius Volz
6f66125809
retrieval: Fix "up" reporting for failed scrapes
8 years ago
Brian Brazil
d8b4995ddd
Check target labels are valid. Check for address after relabelling.
...
Fixes #2822
Fixes #2819
8 years ago
Chris Goller
42de0ae013
Use log.Logger interface for all discovery services
8 years ago
Brian Brazil
37bc607e96
Rework sample limit to work for 2.0
...
Correctly update reported series.
Increment prometheus_target_scrapes_exceeded_sample_limit_total.
Add back unittests.
Ignore stale markers when calculating sample limit.
Fixes #2770
8 years ago
Fabian Reinartz
bc7aff8cef
retrieval: extract scrape cache
8 years ago
Brian Brazil
72a276e7ed
Pass through storage errors in limitAppender.
8 years ago
Fabian Reinartz
a83014f53c
retrieval: fix memory leak and consumption for caches
8 years ago
Fabian Reinartz
3d8661b8d5
Add comment
8 years ago
Fabian Reinartz
43ca652217
retrieval: Don't allocate map on every scrape
8 years ago
Fabian Reinartz
d289dc55c3
storage: update TSDB
8 years ago
Brian Brazil
0920972f79
Initilise scraped sample map, and rename to series map.
8 years ago
Brian Brazil
bf38963118
Plumb through logger with target field to scrape loop.
8 years ago
Brian Brazil
d657d722dc
Log count of dupliates/out of order samples as warnings.
...
Keep log of each sample as debug log.
8 years ago
Brian Brazil
8b9d3e7547
Put end of run staleness handler in seperate function.
...
Improve log message.
8 years ago