1000 Commits (8cf054849f6adc3718c8081ad0ffd91d1cfac023)

Author	SHA1	Message	Date
Matt T. Proud	b2e4c88b80	Wrap LevelDB iterator operations behind interface. ... The LevelDB storage types return an interface type now that wraps around the underlying iterator. This both enhances testability but improves upon, in my opinion, the interface design for the LevelDB iterator. Secondarily, the resource reaping behaviors for the LevelDB iterators have been improved by dropping the externalized io.Closer object. Finally, the iterator provisioning methods provide the option for indicating whether one wants a snapshotted iterator or not.	12 years ago
Matt T. Proud	f2a30cf20c	Several important cleanups and deprecations. ... EachFunc is deprecated. Remove deprecated ``Pair`` and ``GetAll``. These were originally used for forensic and the old gorest impl. Nothing today in the user-facing path nor the tests uses them, especially since the advent of the ForEach protocol in the interface.	12 years ago
Matt T. Proud	70448711ec	Merge pull request #95 from prometheus/feature/persistence/batching ... Several interface cleanups.	12 years ago
Matt T. Proud	8f6b55be71	Several interface cleanups. ... - Kill Close in Persistent and document interface. - Extract batching behavior into interface. - Kill IteratorManager, which was used for unknown reasons.	12 years ago
Julius Volz	a33d2726bc	Mark range op as consumed if it receives no data points in range.	12 years ago
Julius Volz	3c9d6cb66c	Add several needed persistence proxy methods to tiered storage.	12 years ago
Julius Volz	081d250929	Fix view's GetRangeValues() reverse iteration behavior.	12 years ago
Julius Volz	0be0aa59c2	Wait until storage is drained before closing the underlying leveldb.	12 years ago
Julius Volz	becc278eb6	Fix two bugs in range op time advancement.	12 years ago
Matt T. Proud	ceb6611957	Fix regression in subsequent range op. compactions. ... We have an anomaly whereby subsequent range operations fail to be compacted into one single range operation. This fixes such behavior.	12 years ago
Matt T. Proud	669abdfefe	``make format`` invocation.	12 years ago
Julius Volz	bdb067b47f	Implement remaining View Get* methods.	12 years ago
Julius Volz	1f42364733	Fix typo in comment.	12 years ago
Matt T. Proud	758a3f0764	Add documentation and cull junk.	12 years ago
Matt T. Proud	bd8bb0edfd	One additional reduction.	12 years ago
Matt T. Proud	73b463e814	Additional simplifications.	12 years ago
Matt T. Proud	fd47ac570f	Implied simplifications.	12 years ago
Matt T. Proud	51a0f21cf8	Interim documentation	12 years ago
Matt T. Proud	b470f925b7	Extract rewriting of interval queries.	12 years ago
Matt T. Proud	eb721fd220	Include note about greediest range.	12 years ago
Julius Volz	e50de005f9	Populate metric in SampleSet returned from GetRangeValues()	12 years ago
Julius Volz	6001d22f87	Change Get* methods to receive fingerprints instead of metrics.	12 years ago
Julius Volz	95f8885c8a	Adopt new ops sorting interface in view rendering.	12 years ago
Julius Volz	4d79dc3602	Replace renderView() by cleaner and more correct reimplementation.	12 years ago
Julius Volz	e0dbc8c561	Fix edge cases in data extraction for point and interval ops.	12 years ago
Julius Volz	a4361e4116	Rename extractSampleValue -> extractSampleValues.	12 years ago
Julius Volz	4e7db57e76	Fix iterator behavior in view.GetSampleAtTime()	12 years ago
Julius Volz	bb9c5ed7aa	Fix nil pointer exception in frontier building.	12 years ago
Matt T. Proud	896e172463	Extract time group optimizations.	12 years ago
Matt T. Proud	5a71814778	Additional greediness.	12 years ago
Matt T. Proud	b00ca7e422	Refactor some greediness computations.	12 years ago
Matt T. Proud	978acd4e96	Simplify time group optimizations. ... The old code performed well according to the benchmarks, but the new code shaves 1/6th of the time off the original and with less code.	12 years ago
Matt T. Proud	d7b534e624	Update documentation.	12 years ago
Matt T. Proud	1f7ed52b46	Start writing high watermarks.	12 years ago
Julius Volz	a224dda9f0	Fix diskFrontier.ContainsFingerprint() return value.	12 years ago
Matt T. Proud	47ce7ad302	Extract appending from goroutine.	12 years ago
Matt T. Proud	187cd4cdbc	Extract indexing of Fingerprint to Metrics.	12 years ago
Matt T. Proud	532589f728	Extract Label Pair to Fingerprint indexing.	12 years ago
Matt T. Proud	84acfed061	Extract finding unindexed metrics.	12 years ago
Matt T. Proud	67300af137	Extract indexing to separate routine.	12 years ago
Matt T. Proud	582354f6de	Fix remaining ``make advice`` issues.	12 years ago
Matt T. Proud	615e6d13d7	Run ``make format``.	12 years ago
Julius Volz	caeb759ed7	Add tests for and fix getValuesAlongRangeOp value extraction.	12 years ago
Julius Volz	69a24427b7	Minor tiered storage fixups.	12 years ago
Julius Volz	3621148e7f	Comment out panicking test until proper support is implemented.	12 years ago
Julius Volz	e2fb497eba	Add operator value extraction tests.	12 years ago
Julius Volz	12a8863582	Add data extraction methods to operator types.	12 years ago
Julius Volz	1d5df867d1	Set test time to fixed value.	12 years ago
Julius Volz	2f06b8bea6	Fix tiered storage test to trigger iterator rewinding case.	12 years ago
Julius Volz	894ecfe161	Small cleanups and comments in tiered storage.	12 years ago
Julius Volz	f238b23b04	Set -leveldbFlushOnMutate to false by default.	12 years ago
Julius Volz	8939e0723a	Make LevelDB chunk size a flag.	12 years ago
Julius Volz	ce4f560e48	Encapsulate fingerprint frontier checks in renderView().	12 years ago
Julius Volz	1a1cba1bb2	Address outstanding PR comments.	12 years ago
Matt T. Proud	62b5d7ce20	Oops.	12 years ago
Matt T. Proud	1e0d740f2a	Conditionalize LevelDB index retrievals. ... The LevelDB index retrievals could be repeated in a given operation batch if multiple queued mutations affect the same (Label Name) singles and (Label Name, Label Value) doubles. This is wasteful and inefficient, as a single retrieval suffices. Thusly this commit retrieves the canonical index mappings if the said mapping has not been looked up in a given batch.	12 years ago
Matt T. Proud	34a921e16d	Checkpoint.	12 years ago
Matt T. Proud	8cc5cdde0b	checkpoint.	12 years ago
Matt T. Proud	d5380897c3	Cleanups and adds performance regression.	12 years ago
Matt T. Proud	f39b9c3c8e	Checkpoint.	12 years ago
Matt T. Proud	41068c2e84	Checkpoint.	12 years ago
Matt T. Proud	13ae29b304	Initial in-memory arena implementation. ... It is unbounded, and nothing uses it except for a gating flag in main.	12 years ago
Matt T. Proud	efbe0e8a12	Interface simplification. ... GetMetricForFingerprint(model.Fingerprint) (*Metric, error) -> GetMetricForFingerprint(model.Fingerprint) (Metric, error)	12 years ago
Matt T. Proud	f1245e8dda	Interface simplifications. ... GetFingerprintsForLabelName ([]*Fingerprint, error) -> GetFingerprintsForLabelName ([]Fingerprint, error)	12 years ago
Matt T. Proud	e8a733b525	Interface simplifications. ... GetFingerprintsForLabelSet ([]*Fingerprint, error) -> GetFingerprintsForLabelSet ([]Fingerprint, error)	12 years ago
Matt T. Proud	f03091b139	Interface simplifications: GetRangeValues ... From pointers to copies.	12 years ago
Matt T. Proud	14788cf4f3	Interface simplifications. ... GetBoundaryValues() from pointers to values.	12 years ago
Matt T. Proud	56f069b3ec	Interface simplifications: GetValueAtTime(). ... Pointer arguments to copies.	12 years ago
Matt T. Proud	1e2d6c7418	GetFingerprintsForLabelName simplifications. ... ``MetricPersistence.GetFingerprintsForLabelName(l *model.LabelName)`` -> ``MetricPersistence.GetFingerprintsForLabelName(l model.LabelName)``	12 years ago
Matt T. Proud	900bb988c1	Simplifications of GetFingerprintsForLabelSet. ... ``MetricPersistence.GetFingerprintsForLabelSet(s *model.LabelSet)`` -> ``MetricPersistence.GetFingerprintsForLabelSet(s model.LabelSet)``.	12 years ago
Matt T. Proud	4fbcea73f5	MetricPersistence.AppendSample signature changes. ... ``MetricPersistence.AppendSample(*model.Sample)`` -> ``MetricPersistence.AppendSample(model.Sample)``.	12 years ago
Matt T. Proud	4502b49524	Swap out fingerprinting infrastructure. ... All old database entries should be deleted. :-(	12 years ago
Julius Volz	d67e4b9131	Address outstanding comments from PR/47 and other cleanups.	12 years ago
Julius Volz	2659304380	Add interface for getting all metrics from a MetricsPersistence.	12 years ago
Julius Volz	e23ac0adbd	Implement bulk iteration/operation storage interface.	12 years ago
Matt T. Proud	ec3e98b365	Include Snappy in Runtime. ... Snappy should have been explicitly included in the runtime, for I erroneously thought that LevelDB bundled this into its runtime as-is. It turns out that this assumption is wrong, and I thought we had Snappy compression support all-along.	12 years ago
Matt T. Proud	79ba248bbe	Make LevelDB operating modes invocation-time conf. ... Presently our use of LevelDB and its operating modes are hardcoded into the storage stack. This pull request decouples this and re-exposes this through flags. We can now perform benchmarking and remedial tuning.	12 years ago
Matt T. Proud	ea54751431	Update import paths to new location. ... This repository moved from matttproud/prometheus to prometheus/prometheus, and all import paths need to be updated.	12 years ago
Matt T. Proud	f2ded515b7	Support versioned telemetry providers. ... client_golang was updated to support full label-oriented telemetry, which introduced interface incompatibilities with the previous version of Prometheus. To alleviate this, a general fetching and processing dispatching system has been created, which discriminates and processes according to the version of input.	12 years ago
Matt T. Proud	88d15373c5	Upgrade Prometheus to new API.	12 years ago
Julius Volz	6f937ee032	Add preliminary metric docstrings and empty base labels.	12 years ago
Matt T. Proud	d9b165220e	``GetFingerprintsForLabelSet`` uses intersection. ... This implementation needs to be cleaned up considerably, but it should hopefully provide some breathing room. Ultimately this will be extracted out of the storage layer---specifically the LevelDB hierarchy---to interface with a generic set of abstractions for a storage system, but this will be where it remains for now.	12 years ago
Matt T. Proud	ac438e51f6	Debug corner-case seeking anomaly.	12 years ago
Matt T. Proud	be9b7942c1	Fix Stale. Pol. support in GetValueAtTime.	12 years ago
Matt T. Proud	52f52a7ee2	Include nascent instrumentation of stack.	12 years ago
Matt T. Proud	4f7adbbe7d	Reduce work level for stochastic tests. ... The LevelDB stochastic tests could take a long time. Original: ``` Matt:prometheus mtp$ make test make -C model protoc --go_out=generated/ data.proto go build ./... go test ./... warning: building out-of-date packages: github.com/matttproud/golang_instrumentation/maths github.com/matttproud/golang_instrumentation/utility github.com/matttproud/golang_instrumentation/metrics github.com/matttproud/golang_instrumentation installing these packages with 'go test -i ./...' will speed future tests. ? github.com/matttproud/prometheus [no test files] ? github.com/matttproud/prometheus/coding [no test files] ok github.com/matttproud/prometheus/coding/indexable 0.012s ? github.com/matttproud/prometheus/model [no test files] ? github.com/matttproud/prometheus/model/generated [no test files] ? github.com/matttproud/prometheus/retrieval [no test files] ? github.com/matttproud/prometheus/storage/metric [no test files] ok github.com/matttproud/prometheus/storage/metric/leveldb 70.800s ? github.com/matttproud/prometheus/storage/raw [no test files] ? github.com/matttproud/prometheus/storage/raw/index [no test files] ok github.com/matttproud/prometheus/storage/raw/index/leveldb 0.012s ok github.com/matttproud/prometheus/storage/raw/leveldb 0.016s ok github.com/matttproud/prometheus/utility 0.012s ? github.com/matttproud/prometheus/utility/test [no test files] ``` to ``` Matt:prometheus mtp$ make test make -C model protoc --go_out=generated/ data.proto go build ./... go test ./... warning: building out-of-date packages: github.com/matttproud/golang_instrumentation/maths github.com/matttproud/golang_instrumentation/utility github.com/matttproud/golang_instrumentation/metrics github.com/matttproud/golang_instrumentation installing these packages with 'go test -i ./...' will speed future tests. ? github.com/matttproud/prometheus [no test files] ? github.com/matttproud/prometheus/coding [no test files] ok github.com/matttproud/prometheus/coding/indexable 0.011s ? github.com/matttproud/prometheus/model [no test files] ? github.com/matttproud/prometheus/model/generated [no test files] ? github.com/matttproud/prometheus/retrieval [no test files] ? github.com/matttproud/prometheus/storage/metric [no test files] ok github.com/matttproud/prometheus/storage/metric/leveldb 2.158s ? github.com/matttproud/prometheus/storage/raw [no test files] ? github.com/matttproud/prometheus/storage/raw/index [no test files] ok github.com/matttproud/prometheus/storage/raw/index/leveldb 0.013s ok github.com/matttproud/prometheus/storage/raw/leveldb 0.013s ok github.com/matttproud/prometheus/utility 0.013s ? github.com/matttproud/prometheus/utility/test [no test files] ```	12 years ago
Matt T. Proud	3ac5d48b1a	Impl' storage i'faces and fix non-idiomatic warts. ... This change includes implementation of most major storage layer features, albeit some imperfect. It also includes nascent telemetry bindings, too.	12 years ago
Matt T. Proud	a14dbd5bd0	Interim commit for Julius.	12 years ago
Matt T. Proud	0886592ebc	New interface definition after discussion.	12 years ago
Matt T. Proud	59a708f25a	Provide prototype of storage layer interfaces.	12 years ago
Matt T. Proud	6589fc92f8	Strip web services, which weren't adding value.	12 years ago
Matt T. Proud	577acf4fe7	Exploding the storage infrastructure by contexts.	12 years ago
Matt T. Proud	15a6681651	Various cleanups. ... Kill LevelDB watermarks due to redundancy. General interface documentation has begun. Creating custom types for the model to prevent errors down the road. Renaming of components for easier comprehension. Exposition of interface in LevelDB. Slew of simple refactorings.	12 years ago
Matt T. Proud	c0ce859c76	A few re-organizations.	12 years ago
Matt T. Proud	044a5b4e14	Add nascent Travis CI configuration.	12 years ago
Matt T. Proud	9f4bdaab50	Major LevelDB metric end-to-end test improvements. ... Performance is enhanced through better range selection.	12 years ago
Matt T. Proud	c1f0d8aefd	Levigo -> LevelDB in terminology and references.	12 years ago
Matt T. Proud	6ed67b02e2	Incorporate new interface tests.	12 years ago
Matt T. Proud	44f8802ae7	Add Apache License 2.0 boilerplate.	12 years ago
Matt T. Proud	2bbdaa5790	Initial directory re-arrangement for storage.	12 years ago