Label selector can be
"set-based"(https://kubernetes.io/docs/concepts/overview/working-with-objects/labels/#set-based-requirement)
but such a selector causes Prometheus start failure with the "unexpected
error: parsing YAML file ...: invalid selector: 'foo in (bar,baz)';
can't understand 'baz)'"-like error.

This is caused by the `fields.ParseSelector(string)` function that
simply splits an expression as a CSV-list, so a comma confuses such a
parsing method and lead to the error.

Use `labels.Parse(string)` to use a valid lexer to parse a selector
expression.

Closes #8284.
Signed-off-by: NAlexey Shumkin <Alex.Crezoff@gmail.com>

* Add docs for backfill
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

Signed-off-by: Nlzhfromustc <lzhfromustc@gmail.com>

Remove fuzzit, add oss-fuzz on PR

Signed-off-by: NJulien Pivotto <roidelapluie@inuits.eu>

Signed-off-by: NJulien Pivotto <roidelapluie@inuits.eu>

Signed-off-by: NJulien Pivotto <roidelapluie@inuits.eu>

TSDB backfill: enforce # EOF

Signed-off-by: NJulien Pivotto <roidelapluie@inuits.eu>

Signed-off-by: NJulien Pivotto <roidelapluie@inuits.eu>

Update remote-write grafana mixin

The blank line is not efficiently placed in the remote_write config,
affecting readability.
Signed-off-by: NJulien Pivotto <roidelapluie@inuits.eu>

mixin: Add a capability to exclude non-prod AM instances

* Logging added for when compaction takes more than the block time range
Signed-off-by: Narthursens <arthursens2005@gmail.com>

* Log only if no errors were already logged
Signed-off-by: Narthursens <arthursens2005@gmail.com>

* Log duration as human readable string
Signed-off-by: Narthursens <arthursens2005@gmail.com>

* Move logging from compactHead() to Compact()
Signed-off-by: Narthursens <arthursens2005@gmail.com>

* Compute duration of all head compactions plus wal truncation
Signed-off-by: Narthursens <arthursens2005@gmail.com>

* Remove named return added os first commits
Signed-off-by: Narthursens <arthursens2005@gmail.com>

* Address nits
Signed-off-by: Narthursens <arthursens2005@gmail.com>

* Change miliseconds to seconds to make fuzzit tests happy
Signed-off-by: NArthurSens <arthursens2005@gmail.com>

Signed-off-by: Nbeorn7 <beorn@grafana.com>

Improve the documentation to clarify the differences beetween rules in a
group and outside a group.
Signed-off-by: NThibault Jamet <tjamet@users.noreply.github.com>

* Guard closing quitCh with sync.Once to prevent double close
Signed-off-by: NMitsuo Heijo <mitsuo.heijo@gmail.com>

Signed-off-by: Nbirca <birca@adobe.com>

Signed-off-by: NMatt Berther <mattberther@users.noreply.github.com>

Signed-off-by: Njohncming <johncming@yahoo.com>

Signed-off-by: NMike DeSimone <michael.2.desimone@gmail.com>

Merge release 2.23 to master

Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* get parser working
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* import file created
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Find min and max ts
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* make two passes over file and write to tsdb
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* print error messages
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Fix Max and Min initializer
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Start with unit tests
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* reset file read
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* align blocks to two hour range
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Add cleanup test
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* remove .ds_store
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* add license to import_test
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Fix Circle CI error
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Refactor code
Move backfill from tsdb to promtool directory
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix gitignore
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Remove panic
Rename ContenType
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* adjust mint
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix return statement
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix go modules
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Added unit test for backfill
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix CI error
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Fix file handling
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Close DB
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Close directory
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Error Handling
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* inline err
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Fix command line flags
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* add spaces before func
fix pointers
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Add defer'd calls
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* move openmetrics.go content to backfill
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* changed args to flags
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* add tests for wrong OM files
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Added additional tests
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Add comment to warn of func reuse
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Make input required in main.go
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* defer blockwriter close
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix defer
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* defer
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Remove contentType
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* remove defer from backfilltest
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Fix defer remove in backfill_test
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* changes to fix CI errors
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix go.mod
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* change package name
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* assert->require
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* remove todo
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix format
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix todo
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix createblock
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix tests
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix defer
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix return
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* check err for anon func
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* change comments
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* update comment
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Fix for the Flush Bug
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix formatting, comments, names
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Print Blocks
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* cleanup
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* refactor test to take care of multiple samples
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* refactor tests
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* remove om
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* I dont know what I fixed
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Fix tests
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Fix tests, add test description, print blocks
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* commit after 5000 samples
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* reviews part 1
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Series Count
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix CI
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* remove extra func
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* make timestamp into sec
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Reviews 2
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Add Todo
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Fixes
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fixes reviews
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* =0
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* remove backfill.om
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* add global err var, remove stuff
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* change var name
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* sampleLimit pass as parameter
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Add test when number of samples greater than batch size
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Change name of batchsize
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* revert export
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* nits
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* remove
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* add comment, remove newline,consistent err
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Print Blocks
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Modify comments
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* db.Querier
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* add sanity check , get maxt and mint
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* ci error
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* comment change
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* nits
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* NoError
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* fix
Signed-off-by: NaSquare14 <atibhi.a@gmail.com>

* Set the min time of Head properly after truncation
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Fix lint
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Enhance compaction plan logic for completely deleted small block
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Fix review comments
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

Signed-off-by: NJulien Pivotto <roidelapluie@inuits.eu>

Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

Signed-off-by: NGeorge Brighton <george@gebn.co.uk>

* discovery: ec2: expose IPv6 as label
Signed-off-by: NMuhammad Falak R Wani <falakreyaz@gmail.com>

Signed-off-by: NJustin Toh <tohjustin@hotmail.com>

Signed-off-by: NChris Marchbanks <csmarchbanks@gmail.com>

Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Introduce a metadata watcher

Similarly to the WAL watcher, its purpose is to observe the scrape manager and pull metadata. Then, send it to a remote storage.
Signed-off-by: Ngotjosh <josue@grafana.com>

* Additional fixes after rebasing.
Signed-off-by: NCallum Styan <callumstyan@gmail.com>

* Rework samples/metadata metrics.
Signed-off-by: NCallum Styan <callumstyan@gmail.com>

* Use more descriptive variable names in MetadataWatcher collect.
Signed-off-by: NCallum Styan <callumstyan@gmail.com>

* Fix issues caused during rebasing.
Signed-off-by: NCallum Styan <callumstyan@gmail.com>

* Fix missing metric add and unneeded config code.
Signed-off-by: NCallum Styan <callumstyan@gmail.com>

* Address some review comments.
Signed-off-by: NCallum Styan <callumstyan@gmail.com>

* Fix metrics and docs
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Replace assert with require
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Bring back max_samples_per_send metric
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Fix tests
Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>
Co-authored-by: NCallum Styan <callumstyan@gmail.com>
Co-authored-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

Backport v2.22.2 to master

Signed-off-by: NGanesh Vernekar <cs15btech11018@iith.ac.in>

* Add option to customise head chunks write buffer size
Signed-off-by: NMarco Pracucci <marco@pracucci.com>

* Fixed tests
Signed-off-by: NMarco Pracucci <marco@pracucci.com>

commit 9875afc4 changed the type from
metric names to label values, we might as well adjust the description.
The alternative is to revert that commit and restrict names of alerting
rules again even if that was not really enforced.
Signed-off-by: NPeter Wu <pwu@cloudflare.com>

Signed-off-by: NKuntal Majumder <kuntal@infracloud.io>

prometheus-mixin: Make PrometheusRemoteWriteBehind more generic

Currently, it relies on `job, instance` being the labels completely
identifying a Prometheus instance. However, what's intended is to
simply not match on `remote_name, url`.
Signed-off-by: Nbeorn7 <beorn@grafana.com>