prometheus

Commit Graph

Author	SHA1	Message	Date
Chris Marchbanks	b40cc43958	Provide option to compress WAL records (#609 ) In running Prometheus instances, compressing the records was shown to reduce disk usage by half while incurring a negligible CPU cost. Signed-off-by: Chris Marchbanks <csmarchbanks@gmail.com>	2019-06-19 16:46:24 +03:00
Tom Wilkie	77d5a7d47a	LiveReader can get into an infinite loop on corrupt WALs. (#524 ) Make WAL live tailer return EOF when the there is a half-written record at the end of the file. Previously, this would cause an infinite loop as we ignored EOFs when filling the buffer. We now differentiate between EOFs that read >0 bytes, and EOFs that didn't. Add some more unit tests for tailing a corrupt WAL, and unify interfaces Reader and LiveReader for the purposes of testing. Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>	2019-02-19 14:33:57 +00:00

Author

SHA1

Message

Date

Chris Marchbanks

b40cc43958

Provide option to compress WAL records (#609 )

In running Prometheus instances, compressing the records was shown to
reduce disk usage by half while incurring a negligible CPU cost.

Signed-off-by: Chris Marchbanks <csmarchbanks@gmail.com>

2019-06-19 16:46:24 +03:00

Tom Wilkie

77d5a7d47a

LiveReader can get into an infinite loop on corrupt WALs. (#524 )

Make WAL live tailer return EOF when the there is a half-written record at the end of the file.

Previously, this would cause an infinite loop as we ignored EOFs when filling the buffer.  We now differentiate between EOFs that read >0 bytes, and EOFs that didn't.

Add some more unit tests for tailing a corrupt WAL, and unify interfaces Reader and LiveReader for the purposes of testing.

Signed-off-by: Tom Wilkie <tom.wilkie@gmail.com>

2019-02-19 14:33:57 +00:00

2 Commits (b5f9f9f0b4a77e1152e30bf4ee5190f65ad29fa1)