Signed-off-by: NBartlomiej Plotka <bwplotka@gmail.com>

* support for globalurls in targets page react
Signed-off-by: NHarkishen Singh <harkishensingh@hotmail.com>

* fixed tests
Signed-off-by: NHarkishen Singh <harkishensingh@hotmail.com>

* removed fmts
Signed-off-by: NHarkishen Singh <harkishensingh@hotmail.com>

* implemented suggestions
Signed-off-by: NHarkishen Singh <harkishensingh@hotmail.com>

* formatted
Signed-off-by: NHarkishen Singh <harkishensingh@hotmail.com>

* implemented suggestions. fixed tests.
Signed-off-by: NHarkishen Singh <harkishensingh@hotmail.com>

* formated go code
Signed-off-by: NHarkishen Singh <harkishensingh@hotmail.com>

* implemented suggestions
Signed-off-by: NHarkishen Singh <harkishensingh@hotmail.com>

* rules: Make deleted rule series as stale after a reload
Signed-off-by: NJulien Pivotto <roidelapluie@inuits.eu>

Signed-off-by: NThor <thansen@digitalocean.com>

Signed-off-by: Ngotjosh <josue@grafana.com>

Since we use ActiveQueryTracker to check for concurrency in
d992c36b it does not make sense to keep
the MaxConcurrent value as an option of the PromQL engine.

This pull request removes it from the PromQL engine options, sets the
max concurrent metric to -1 if there is no active query tracker, and use
the value of the active query tracker otherwise.

It removes dead code and also will inform people who import the promql
package that we made that change, as it breaks the EngineOpts struct.
Signed-off-by: NJulien Pivotto <roidelapluie@inuits.eu>

* Add query log, make stats logged in JSON like in the API
Signed-off-by: NJulien Pivotto <roidelapluie@inuits.eu>

This adds support for a new query param on the new `api/v1/metadata`
endpoint that provides metadata for a specified metric via the V1 API.

It collapses metadata that is equal across all targets, and aggregates
under the same metric name the ones that differ.
Signed-off-by: Ngotjosh <josue@grafana.com>

Signed-off-by: Ngotjosh <josue@grafana.com>

* api: provide per metric metadata

This adds a new endpoint that provides per metric metadata via the V1 API.

It collapses metadata that is equal across all targets, and aggregates under the same metric name the ones that differ.

* Allow tests to be asserted on response length

Some tests e.g. limit on API responses, don't require an assertion on
equality.

This allows us to assert against response length instead of
equality.
Signed-off-by: Ngotjosh <josue@grafana.com>

* url filter rules param
Signed-off-by: Nblalov <boiskila@gmail.com>
Signed-off-by: NBoyko Lalov <boiskila@gmail.com>
Signed-off-by: Nblalov <boiskila@gmail.com>

* address review changes
Signed-off-by: Nblalov <boiskila@gmail.com>
Signed-off-by: NBoyko Lalov <boiskila@gmail.com>
Signed-off-by: Nblalov <boiskila@gmail.com>

* ui initial commit
Signed-off-by: Nblalov <boiskila@gmail.com>
Signed-off-by: NBoyko Lalov <boiskila@gmail.com>
Signed-off-by: Nblalov <boiskila@gmail.com>

* improve ui
Signed-off-by: Nblalov <boiskila@gmail.com>
Signed-off-by: NBoyko Lalov <boiskila@gmail.com>
Signed-off-by: Nblalov <boiskila@gmail.com>

* fix typo in component name
Signed-off-by: NBoyko Lalov <boiskila@gmail.com>
Signed-off-by: Nblalov <boiskila@gmail.com>

* create query link + ui enhancements
Signed-off-by: NBoyko Lalov <boiskila@gmail.com>
Signed-off-by: Nblalov <boiskila@gmail.com>

* add count to state labels
Signed-off-by: Nblalov <boiskila@gmail.com>

* put alerts table render in the right place
Signed-off-by: Nblalov <boiskila@gmail.com>

* refactoring
Signed-off-by: Nblalov <boiskila@gmail.com>

* fix rules endpoint test
Signed-off-by: Nblalov <boiskila@gmail.com>

* lint fixes
Signed-off-by: Nblalov <boiskila@gmail.com>

* test query params
Signed-off-by: Nblalov <boiskila@gmail.com>

* refactoring
Signed-off-by: Nblalov <boiskila@gmail.com>

* review changes
Signed-off-by: Nblalov <boiskila@gmail.com>

* adding down arrow as click indicator in Alert
Signed-off-by: Nblalov <boiskila@gmail.com>

* add period at the end of the comment
Signed-off-by: Nblalov <boiskila@gmail.com>

* review changes
Signed-off-by: Nblalov <boiskila@gmail.com>

* remove left-over css
Signed-off-by: Nblalov <boiskila@gmail.com>

* adding expand/collapse arrows on Alert
Signed-off-by: Nblalov <boiskila@gmail.com>

* create proper expression for alert name
Signed-off-by: Nblalov <boiskila@gmail.com>

* Allows sorting of responses from the API in tests

Fixes flaky test for api/v1/targets/metadata.

Allows sorting of responses from the API. For our tests to be deterministic, we need to ensure the response from the API follows an order. This structure allows us to define one.

Fixes #6431
Signed-off-by: Ngotjosh <josue@grafana.com>

This commit introduces several test cases for the current /targets/metadata API endpoint.

To achieve so, we use a mock of the metadataStore and inject it to the targets under test.

Currently, three success cases are covered: with a metric name, with a target matcher, and with both. As for the failure scenario, the one where we couldn't match against a particular metric is covered.
Signed-off-by: Ngotjosh <josue@grafana.com>

Previously, the struct `testTargetRetriever` had hardcoded active and dropped targets. This made it difficult to change the target information depending on the test case.

This change introduces a way to define them as arguments and pass it to a constructor for building. It lays a foundation for dynamically defining targets with various set of arguments to test different scenarios.
Signed-off-by: Ngotjosh <josue@grafana.com>

* Port tsdb to use pkg/labels.
Signed-off-by: NTom Wilkie <tom.wilkie@gmail.com>

* Get tests passing.
Signed-off-by: NTom Wilkie <tom.wilkie@gmail.com>

* Remove useless cast.
Signed-off-by: NTom Wilkie <tom.wilkie@gmail.com>

* Appease linters.
Signed-off-by: NTom Wilkie <tom.wilkie@gmail.com>

* Fix review comments
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

Signed-off-by: NSharad Gaur <sgaur@splunk.com>

* Add LastScrapeDuration to targets endpoint
Signed-off-by: NDustin Hooten <dhooten@splunk.com>

* Add Scrape job name to targets endpoint
Signed-off-by: NDustin Hooten <dhooten@splunk.com>

* Implement the /targets page in react
Signed-off-by: NDustin Hooten <dhooten@splunk.com>

* Add state query param to targets endpoint
Signed-off-by: NDustin Hooten <dhooten@splunk.com>

* Use state filter in api call
Signed-off-by: NDustin Hooten <dhooten@splunk.com>

* api feedback
Signed-off-by: NDustin Hooten <dhooten@splunk.com>

* pr feedback frontend
Signed-off-by: NDustin Hooten <dhooten@splunk.com>

* Implement and use localstorage hook
Signed-off-by: NDustin Hooten <dhooten@splunk.com>

* PR feedback
Signed-off-by: NDustin Hooten <dhooten@splunk.com>

Signed-off-by: NYaoZengzeng <yaozengzeng@huawei.com>

Signed-off-by: NYaoZengzeng <yaozengzeng@zju.edu.cn>

remote-read: streamed chunked server side; Extended protobuf; Added chunked, checksumed reader  (#5703)

Part of: https://github.com/prometheus/prometheus/issues/4517 and https://github.com/improbable-eng/thanos/issues/488

Changes:
* Extended protobuf for chunked remote read and negotation.
* Added checksumed, chunked Writer/Reader.
* Added Server side implementation for chunked streamed remote-read.
Signed-off-by: NBartek Plotka <bwplotka@gmail.com>

Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

This avoids a circular dependency between the testutil and storage
packages.
Signed-off-by: NChris Marchbanks <csmarchbanks@gmail.com>

The return value of Set() was not checked.
Hence, the typo ("al" instead of "af") wasn't catched.
Signed-off-by: NFrançois (fser) <fser@code-libre.org>

* Add tests to ensure we can marshal and unmarshal our min/max times

Related to https://github.com/prometheus/client_golang/issues/614

Instead of implementing all the time parsing, we can special-case handle
these 2 times. This means if times in this format show up that
time.Parse can't handle they will still error, but we can marshal/parse
our own min/max time
Signed-off-by: NThomas Jackson <jacksontj.89@gmail.com>

Signed-off-by: NSimon Pasquier <spasquie@redhat.com>

Signed-off-by: NBjoern Rabenstein <bjoern@rabenste.in>

* Add support for POSTing to /series endpoint
* Document query API POST support
Signed-off-by: NBob Shannon <bob.m.shannon@gmail.com>

i) Uses the more idiomatic Wrap and Wrapf methods for creating nested errors.
ii) Fixes some incorrect usages of fmt.Errorf where the error messages don't have any formatting directives.
iii) Does away with the use of fmt package for errors in favour of pkg/errors
Signed-off-by: Ntariqibrahim <tariq181290@gmail.com>

- Unmarshall external_labels config as labels.Labels, add tests.
- Convert some more uses of model.LabelSet to labels.Labels.
- Remove old relabel pkg (fixes #3647).
- Validate external label names.
Signed-off-by: NTom Wilkie <tom.wilkie@gmail.com>

This change switches the remote_write API to use the TSDB WAL.  This should reduce memory usage and prevent sample loss when the remote end point is down.

We use the new LiveReader from TSDB to tail WAL segments.  Logic for finding the tracking segment is included in this PR.  The WAL is tailed once for each remote_write endpoint specified. Reading from the segment is based on a ticker rather than relying on fsnotify write events, which were found to be complicated and unreliable in early prototypes.

Enqueuing a sample for sending via remote_write can now block, to provide back pressure.  Queues are still required to acheive parallelism and batching.  We have updated the queue config based on new defaults for queue capacity and pending samples values - much smaller values are now possible.  The remote_write resharding code has been updated to prevent deadlocks, and extra tests have been added for these cases.

As part of this change, we attempt to guarantee that samples are not lost; however this initial version doesn't guarantee this across Prometheus restarts or non-retryable errors from the remote end (eg 400s).

This changes also includes the following optimisations:
- only marshal the proto request once, not once per retry
- maintain a single copy of the labels for given series to reduce GC pressure

Other minor tweaks:
- only reshard if we've also successfully sent recently
- add pending samples, latest sent timestamp, WAL events processed metrics

Co-authored-by: Chris Marchbanks <csmarchbanks.com> (initial prototype)
Co-authored-by: Tom Wilkie <tom.wilkie@gmail.com> (sharding changes)
Signed-off-by: NCallum Styan <callumstyan@gmail.com>

Signed-off-by: NHrishikesh Barman <hrishikeshbman@gmail.com>

Signed-off-by: NMatt Layher <mdlayher@gmail.com>

Signed-off-by: NCallum Styan <callumstyan@gmail.com>

Signed-off-by: NTom Wilkie <tom.wilkie@gmail.com>

Fixes https://github.com/prometheus/prometheus/issues/4939Signed-off-by: NJulius Volz <julius.volz@gmail.com>

Signed-off-by: NMark Knapp <mknapp@hudson-trading.com>

* update promlog to latest version
Signed-off-by: NAlex Yu <yu.alex96@gmail.com>

* Update api tests, fix main setup
Signed-off-by: NAlex Yu <yu.alex96@gmail.com>

* tidy go.sum
Signed-off-by: NAlex Yu <yu.alex96@gmail.com>

* revendor prometheus/common
Signed-off-by: NAlex Yu <yu.alex96@gmail.com>

* only initialize config; use kingpin for remote_storage_adapter
Signed-off-by: NAlex Yu <yu.alex96@gmail.com>

* actually parse the flags
Signed-off-by: NAlex Yu <yu.alex96@gmail.com>

* clean up imports
Signed-off-by: NAlex Yu <yu.alex96@gmail.com>

* vendor: update tsdb
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* /api/v1/labels endpoint
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* regex matchers for API
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Add docs
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Matchers behaving as OR
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Removed the matchers
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* vendor: update tsdb using go mod
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* vendor update: tsdb
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Added LabelNames() to storage.Querier
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Test for api.labelNames
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Nits
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

Signed-off-by: NSimon Pasquier <spasquie@redhat.com>

Signed-off-by: NSimon Pasquier <spasquie@redhat.com>