AverageMarcus
/
cluster.fun
1
0
Fork 0
Code Issues 1 Pull Requests 2 Releases Activity

Update victoriametrics/vmagent Docker tag to v1.95.0 #133

Merged
AverageMarcus merged 1 commits from renovate/victoriametrics-vmagent-1.x into master 2023-11-16 07:06:17 +00:00
Conversation 0 Commits 1 Files Changed 2 +2 -2
renovate commented 2023-11-15 18:01:46 +00:00
Collaborator
Copy Link

This PR contains the following updates:

Package Update Change
victoriametrics/vmagent minor v1.94.0 -> v1.95.0

Release Notes

VictoriaMetrics/VictoriaMetrics (victoriametrics/vmagent)

v1.95.0

Compare Source

Released at 2023-11-15

vmalert's cmd-line flag -datasource.lookback will be deprecated soon. Please use -rule.evalDelay command-line flag instead and see more details on how to use it here. The flag datasource.lookback will have no effect in the next release and will be removed in the future releases. See this issue.

vmalert's cmd-line flag -datasource.queryTimeAlignment was deprecated and will have no effect anymore. It will be completely removed in next releases. See this issue and more detailed changes related to vmalert below.

  • SECURITY: upgrade Go builder from Go1.21.1 to Go1.21.4. See the list of issues addressed in Go1.21.2, the list of issues addressed in Go1.21.3 and the list of issues addressed in Go1.21.4.

  • FEATURE: vmselect: improve performance for repeated instant queries if they contain one of the following rollup functions:

  • FEATURE: vmselect: improve query performance on systems with big number of CPU cores (>=32). Add -search.maxWorkersPerQuery command-line flag, which can be used for fine-tuning query performance on systems with big number of CPU cores. See this pull request.

  • FEATURE: vmselect: expose vm_memory_intensive_queries_total counter metric which gets increased each time -search.logQueryMemoryUsage memory limit is exceeded by a query. This metric should help to identify expensive and heavy queries without inspecting the logs.

  • FEATURE: MetricsQL: add drop_empty_series() function, which can be used for filtering out empty series before performing additional calculations as shown in this issue.

  • FEATURE: MetricsQL: add labels_equal() function, which can be used for searching series with identical values for the given labels. See this feature request.

  • FEATURE: MetricsQL: add outlier_iqr_over_time(m[d]) and outliers_iqr(q) functions, which allow detecting anomalies in samples and series using Interquartile range method.

  • FEATURE: vmalert: add eval_alignment attribute for Groups, it will align group query requests timestamp with interval like datasource.queryTimeAlignment did.
    This also means that datasource.queryTimeAlignment command-line flag becomes deprecated now and will have no effect if configured. If datasource.queryTimeAlignment was set to false before, then eval_alignment has to be set to false explicitly under group.
    See this issue.

  • FEATURE: vmalert: add -rule.evalDelay flag and eval_delay attribute for Groups. The new flag and param can be used to adjust the time parameter for rule evaluation requests to match intentional query delay from the datasource. See this issue.

  • FEATURE: vmalert: allow specifying full url in notifier static_configs target address, like http://alertmanager:9093/test/api/v2/alerts. See this issue.

  • FEATURE: vmalert: reduce the number of queries for restoring alerts state on start-up. The change should speed up the restore process and reduce pressure on remoteRead.url. See this pull request.

  • FEATURE: vmalert: add label file pointing to the group's filename to metrics vmalert_recording_.* and vmalert_alerts_.*. The filename should help identifying alerting rules belonging to specific groups with identical names but different filenames. See this issue.

  • FEATURE: vmalert: automatically retry remote-write requests on closed connections. The change should reduce the amount of logs produced in environments with short-living connections or environments without support of keep-alive on network balancers.

  • FEATURE: vmagent: support data ingestion from NewRelic infrastructure agent. See these docs, this feature request and this pull request.

  • FEATURE: vmagent: add -remoteWrite.shardByURL.labels command-line flag, which can be used for specifying a list of labels for sharding outgoing samples among the configured -remoteWrite.url destinations if -remoteWrite.shardByURL command-line flag is set. See these docs and this feature request for details.

  • FEATURE: vmagent: do not exit on startup when scrape_configs refer to non-existing or invalid files with auth configs, since these files may appear / updated later. See this feature request and this pull request.

  • FEATURE: vmagent: allow loading TLS certificates from HTTP and HTTPS urls by specifying these urls at cert_file and key_file options inside tls_config and proxy_tls_config sections at http client settings.

  • FEATURE: vmagent: reduce CPU load when big number of targets are scraped over HTTPS with the same custom TLS certificate configured via tls_config->cert_file and tls_config->key_file at scrape_config.

  • FEATURE: vmbackup: add -filestream.disableFadvise command-line flag, which can be used for disabling fadvise syscall during backup upload to the remote storage. By default vmbackup uses fadvise syscall in order to prevent from eviction of recently accessed data from the OS page cache when backing up large files. Sometimes the fadvise syscall may take significant amounts of CPU when the backup is performed with large value of -concurrency command-line flag on systems with big number of CPU cores. In this case it is better to manually disable fadvise syscall by passing -filestream.disableFadvise command-line flag to vmbackup. See this pull request for details.

  • FEATURE: vmbackup: add -deleteAllObjectVersions command-line flag, which can be used for forcing removal of all object versions in remote object storage. See this issue and these docs for the details.

  • FEATURE: Alerting rules for VictoriaMetrics: account for vmauth component for alerts ServiceDown and TooManyRestarts.

  • FEATURE: Alerting rules for VictoriaMetrics: make TooHighMemoryUsage more tolerable to spikes or near-the-threshold states. The change should reduce number of false positives.

  • FEATURE: Alerting rules for VictoriaMetrics: add TooManyMissedIterations alerting rule for vmalert to detect groups that miss their evaulations due to slow queries.

  • FEATURE: vmui: add support for functions, labels, values in autocomplete. See this issue.

  • FEATURE: vmui: retain specified time interval when executing a query from Top Queries. See this issue.

  • FEATURE: vmui: improve repeated VMUI page load times by enabling caching of static js and css at web browser side according to these recommendations.

  • FEATURE: vmui: sort legend under the graph in descending order of median values. This should simplify graph analysis, since usually the most important lines have bigger values.

  • FEATURE: vmui: reduce vertical space usage, so more information is visible on the screen without scrolling.

  • FEATURE: vmui: show query execution duration in the header of query input field. This should help optimizing query performance.

  • FEATURE: support Strict-Transport-Security, Content-Security-Policy and X-Frame-Options HTTP response headers in the all VictoriaMetrics components. The values for headers can be specified via the following command-line flags: -http.header.hsts, -http.header.csp and -http.header.frameOptions.

  • FEATURE: vmalert-tool: add unittest command to run unittest for alerting and recording rules. See this pull request for details.

  • FEATURE: dashboards/vmalert: add new panel Missed evaluations for indicating alerting groups that miss their evaluations.

  • FEATURE: all: track requests with wrong auth key and wrong basic auth at vm_http_request_errors_total metric with reason="wrong_auth_key" and reason="wrong_basic_auth". See this issue. Thanks to @​venkatbvc for the pull request.

  • FEATURE: vmauth: add ability to drop the specified number of /-delimited prefix parts from the request path before proxying the request to the matching backend. See these docs.

  • FEATURE: vmauth: add ability to skip TLS verification and to specify TLS Root CA when connecting to backends. See these docs and this issue.

  • FEATURE: vmstorage: gradually close vminsert connections during 25 seconds at graceful shutdown. This should reduce data ingestion slowdown during rolling restarts. The duration for gradual closing of vminsert connections can be configured via -storage.vminsertConnsShutdownDuration command-line flag. See this issue and these docs for details.

  • FEATURE: vmstorage: add -blockcache.missesBeforeCaching command-line flag, which can be used for fine-tuning RAM usage for indexdb/dataBlocks cache when queries touching big number of time series are executed.

  • FEATURE: add -loggerMaxArgLen command-line flag for fine-tuning the maximum lengths of logged args.

  • BUGFIX: vmalert: strip sensitive information such as auth headers or passwords from datasource, remote-read, remote-write or notifier URLs in log messages or UI. This behavior is by default and is controlled via -datasource.showURL, -remoteRead.showURL, remoteWrite.showURL or -notifier.showURL cmd-line flags. See this issue.

  • BUGFIX: vmalert: fix vmalert web UI when running on 32-bit architectures machine.

  • BUGFIX: vmalert: do not send requests to configured remote systems when -datasource.*, -remoteWrite.*, -remoteRead.* or -notifier.* command-line flags refer files with invalid auth configs. Previously such requests were sent without properly set auth headers. Now the requests are sent only after the files are updated with valid auth configs. See this pull request.

  • BUGFIX: vmalert: properly maintain alerts state in replay mode if alert's for param was bigger than replay request range (usually a couple of hours). See this issue for details.

  • BUGFIX: vmalert: increment vmalert_remotewrite_errors_total metric if all retries to send remote-write request failed. Before, this metric was incremented only if remote-write client's buffer is overloaded.

  • BUGFIX: vmalert: increment vmalert_remotewrite_dropped_rows_total and vmalert_remotewrite_dropped_bytes_total metrics if remote-write client's buffer is overloaded. Before, these metrics were incremented only after unsuccessful HTTP calls.

  • BUGFIX: vmselect: improve performance and memory usage during query processing on machines with big number of CPU cores. See this issue.

  • BUGFIX: dashboards: fix vminsert/vmstorage/vmselect metrics filtering when dashboard is used to display data from many sub-clusters with unique job names. Before, only one specific job could have been accounted for component-specific panels, instead of all available jobs for the component.

  • BUGFIX: dashboards: respect job and instance filters for alerts annotation in cluster and single-node dashboards.

  • BUGFIX: dashboards: update description for RSS and anonymous memory panels to be consistent for single-node, cluster and vmagent dashboards.

  • BUGFIX: dashboards/vmalert: apply desc sorting in tooltips for vmalert dashboard in order to improve visibility of the outliers on graph.

  • BUGFIX: dashboards/vmalert: properly apply time series filter for panel No data errors. Before, the panel didn't respect job or instance filters.

  • BUGFIX: dashboards/vmalert: fix panel Errors rate to Alertmanager not showing any data due to wrong label filters.

  • BUGFIX: dashboards/cluster: fix description about max threshold for Concurrent selects panel. Before, it was mistakenly implying that max is equal to the double of available CPUs.

  • BUGFIX: VictoriaMetrics cluster: bump hard-coded limit for search query size at vmstorage from 1MB to 5MB. The change should be more suitable for real-world scenarios and protect vmstorage from excessive memory usage. See this issue for details

  • BUGFIX: vmbackup: fix error when creating an incremental backup with the -origin command-line flag. See this issue for details.

  • BUGFIX: vmagent: properly apply relabeling with regex, which start and end with .+ or .* and which contain alternate sub-regexps. For example, .+;|;.+ or .*foo|bar|baz.*. Previously such regexps were improperly parsed, which could result in undexpected relabeling results. See this issue.

  • BUGFIX: vmagent: properly discover Kubernetes targets via kubernetes_sd_configs. Previously some targets and some labels could be skipped during service discovery because of the bug introduced in v1.93.5 when implementing this feature. See this issue for more details.

  • BUGFIX: vmagent: fix vmagent ignoring configuration reload for streaming aggregation if it was started with empty streaming aggregation config. Thanks to @​aluode99 for the pull request.

  • BUGFIX: vmagent: do not scrape targets if the corresponding scrape_configs refer to files with invalid auth configs. Previously the targets were scraped without properly set auth headers in this case. Now targets are scraped only after the files are updated with valid auth configs. See this pull request.

  • BUGFIX: vmagent: properly parse ca, cert and key options at tls_config section inside http client settings. Previously string values couldn't be parsed for these options, since the parser was mistakenly expecting a list of uint8 values instead.

  • BUGFIX: vmagent: properly drop samples if -streamAggr.dropInput command-line flag is set and -remoteWrite.streamAggr.config contains an empty file. See this issue.

  • BUGFIX: vmagent: do not print redundant error logs when failed to scrape consul or nomad target. See this pull request.

  • BUGFIX: vmagent: generate proper link to the main page and to favicon.ico at http pages served by vmagent such as /targets or /service-discovery when vmagent sits behind an http proxy with custom http path prefixes. See this issue.

  • BUGFIX: vmagent: properly decode Snappy-encoded data blocks received via VictoriaMetrics remote_write protocol. See this issue.

  • BUGFIX: vmstorage: prevent deleted series to be searchable via /api/v1/series API if they were re-ingested with staleness markers. This situation could happen if user deletes the series from the target and from VM, and then vmagent sends stale markers for absent series. Thanks to @​ilyatrefilov for the issue and pull request.

  • BUGFIX: vmstorage: log warning about switching to ReadOnly mode only on state change. Before, vmstorage would log this warning every 1s. See this issue for details.

  • BUGFIX: vmauth: show browser authorization window for unauthorized requests to unsupported paths if the unauthorized_user section is specified. This allows properly authorizing the user. See this issue for details.

  • BUGFIX: vmauth: properly proxy requests to HTTP/2.0 backends and properly pass Host header to backends.

  • BUGFIX: vmui: fix the Disable cache toggle at JSON and Table views. Previously response caching was always enabled and couldn't be disabled at these views.

  • BUGFIX: vmui: correctly display query errors on Explore Prometheus Metrics page. See this issue for details.

  • BUGFIX: vmui: properly handle trailing slash in the server URL. See this issue.

  • BUGFIX: vmbackupmanager: correctly print error in logs when copying backup fails. Previously, error was displayed in metrics but was missing in logs.

  • BUGFIX: fix panic, which could occur when query tracing is enabled. See this issue.

How to run VictoriaMetrics

Unpack the victoria-metrics-*.tar.gz archive and read these docs.

vmutils-*.tag.gz archive contains the following tools:

vmutils-*-enterprise.tar.gz archive contains the following additional enterprise tools:

The corresponding docker images are available here.
Cluster version is available here.

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

  • If you want to rebase/retry this PR, check this box

This PR has been generated by Renovate Bot.

This PR contains the following updates: | Package | Update | Change | |---|---|---| | [victoriametrics/vmagent](https://github.com/VictoriaMetrics/VictoriaMetrics) | minor | `v1.94.0` -> `v1.95.0` | --- ### Release Notes <details> <summary>VictoriaMetrics/VictoriaMetrics (victoriametrics/vmagent)</summary> ### [`v1.95.0`](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v1.95.0) [Compare Source](https://github.com/VictoriaMetrics/VictoriaMetrics/compare/v1.94.0...v1.95.0) Released at 2023-11-15 **vmalert's cmd-line flag `-datasource.lookback` will be deprecated soon. Please use `-rule.evalDelay` command-line flag instead and see more details on how to use it [here](https://docs.victoriametrics.com/vmalert.html#data-delay). The flag `datasource.lookback` will have no effect in the next release and will be removed in the future releases. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5155).** **vmalert's cmd-line flag `-datasource.queryTimeAlignment` was deprecated and will have no effect anymore. It will be completely removed in next releases. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5049) and more detailed changes related to vmalert below.** - SECURITY: upgrade Go builder from Go1.21.1 to Go1.21.4. See [the list of issues addressed in Go1.21.2](https://github.com/golang/go/issues?q=milestone%3AGo1.21.2+label%3ACherryPickApproved), [the list of issues addressed in Go1.21.3](https://github.com/golang/go/issues?q=milestone%3AGo1.21.3+label%3ACherryPickApproved) and [the list of issues addressed in Go1.21.4](https://github.com/golang/go/issues?q=milestone%3AGo1.21.4+label%3ACherryPickApproved). - FEATURE: `vmselect`: improve performance for repeated [instant queries](https://docs.victoriametrics.com/keyConcepts.html#instant-query) if they contain one of the following [rollup functions](https://docs.victoriametrics.com/MetricsQL.html#rollup-functions): - [`avg_over_time`](https://docs.victoriametrics.com/MetricsQL.html#avg_over_time) - [`sum_over_time`](https://docs.victoriametrics.com/MetricsQL.html#sum_over_time) - [`count_eq_over_time`](https://docs.victoriametrics.com/MetricsQL.html#count_eq_over_time) - [`count_gt_over_time`](https://docs.victoriametrics.com/MetricsQL.html#count_gt_over_time) - [`count_le_over_time`](https://docs.victoriametrics.com/MetricsQL.html#count_le_over_time) - [`count_ne_over_time`](https://docs.victoriametrics.com/MetricsQL.html#count_ne_over_time) - [`count_over_time`](https://docs.victoriametrics.com/MetricsQL.html#count_over_time) - [`increase`](https://docs.victoriametrics.com/MetricsQL.html#increase) - [`max_over_time`](https://docs.victoriametrics.com/MetricsQL.html#max_over_time) - [`min_over_time`](https://docs.victoriametrics.com/MetricsQL.html#min_over_time) - [`rate`](https://docs.victoriametrics.com/MetricsQL.html#rate) The optimization is enabled when these functions contain lookbehind window in square brackets bigger or equal to `6h` (the threshold can be changed via `-search.minWindowForInstantRollupOptimization` command-line flag). The optimization improves performance for SLO/SLI-like queries such as `avg_over_time(up[30d])` or `sum(rate(http_request_errors_total[3d])) / sum(rate(http_requests_total[3d]))`, which can be generated by [sloth](https://github.com/slok/sloth) or similar projects. - FEATURE: `vmselect`: improve query performance on systems with big number of CPU cores (`>=32`). Add `-search.maxWorkersPerQuery` command-line flag, which can be used for fine-tuning query performance on systems with big number of CPU cores. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5195). - FEATURE: `vmselect`: expose `vm_memory_intensive_queries_total` counter metric which gets increased each time `-search.logQueryMemoryUsage` memory limit is exceeded by a query. This metric should help to identify expensive and heavy queries without inspecting the logs. - FEATURE: [MetricsQL](https://docs.victoriametrics.com/MetricsQL.html): add [drop_empty_series()](https://docs.victoriametrics.com/MetricsQL.html#drop_empty_series) function, which can be used for filtering out empty series before performing additional calculations as shown in [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5071). - FEATURE: [MetricsQL](https://docs.victoriametrics.com/MetricsQL.html): add [labels_equal()](https://docs.victoriametrics.com/MetricsQL.html#labels_equal) function, which can be used for searching series with identical values for the given labels. See [this feature request](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5148). - FEATURE: [MetricsQL](https://docs.victoriametrics.com/MetricsQL.html): add [`outlier_iqr_over_time(m[d])`](https://docs.victoriametrics.com/MetricsQL.html#outlier_iqr_over_time) and [`outliers_iqr(q)`](https://docs.victoriametrics.com/MetricsQL.html#outliers_iqr) functions, which allow detecting anomalies in samples and series using [Interquartile range method](https://en.wikipedia.org/wiki/Interquartile_range). - FEATURE: [vmalert](https://docs.victoriametrics.com/vmalert.html): add `eval_alignment` attribute for [Groups](https://docs.victoriametrics.com/vmalert.html#groups), it will align group query requests timestamp with interval like `datasource.queryTimeAlignment` did. This also means that `datasource.queryTimeAlignment` command-line flag becomes deprecated now and will have no effect if configured. If `datasource.queryTimeAlignment` was set to `false` before, then `eval_alignment` has to be set to `false` explicitly under group. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5049). - FEATURE: [vmalert](https://docs.victoriametrics.com/vmalert.html): add `-rule.evalDelay` flag and `eval_delay` attribute for [Groups](https://docs.victoriametrics.com/vmalert.html#groups). The new flag and param can be used to adjust the `time` parameter for rule evaluation requests to match [intentional query delay](https://docs.victoriametrics.com/keyConcepts.html#query-latency) from the datasource. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5155). - FEATURE: [vmalert](https://docs.victoriametrics.com/vmalert.html): allow specifying full url in notifier static_configs target address, like `http://alertmanager:9093/test/api/v2/alerts`. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5184). - FEATURE: [vmalert](https://docs.victoriametrics.com/vmalert.html): reduce the number of queries for restoring alerts state on start-up. The change should speed up the restore process and reduce pressure on `remoteRead.url`. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5265). - FEATURE: [vmalert](https://docs.victoriametrics.com/vmalert.html): add label `file` pointing to the group's filename to metrics `vmalert_recording_.*` and `vmalert_alerts_.*`. The filename should help identifying alerting rules belonging to specific groups with identical names but different filenames. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5267). - FEATURE: [vmalert](https://docs.victoriametrics.com/vmalert.html): automatically retry remote-write requests on closed connections. The change should reduce the amount of logs produced in environments with short-living connections or environments without support of keep-alive on network balancers. - FEATURE: [vmagent](https://docs.victoriametrics.com/vmagent.html): support data ingestion from [NewRelic infrastructure agent](https://docs.newrelic.com/docs/infrastructure/install-infrastructure-agent). See [these docs](https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#how-to-send-data-from-newrelic-agent), [this feature request](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3520) and [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/4712). - FEATURE: [vmagent](https://docs.victoriametrics.com/vmagent.html): add `-remoteWrite.shardByURL.labels` command-line flag, which can be used for specifying a list of labels for sharding outgoing samples among the configured `-remoteWrite.url` destinations if `-remoteWrite.shardByURL` command-line flag is set. See [these docs](https://docs.victoriametrics.com/vmagent.html#sharding-among-remote-storages) and [this feature request](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4942) for details. - FEATURE: [vmagent](https://docs.victoriametrics.com/vmagent.html): do not exit on startup when [scrape_configs](https://docs.victoriametrics.com/sd_configs.html#scrape_configs) refer to non-existing or invalid files with auth configs, since these files may appear / updated later. See [this feature request](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4959) and [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5153). - FEATURE: [vmagent](https://docs.victoriametrics.com/vmagent.html): allow loading TLS certificates from HTTP and HTTPS urls by specifying these urls at `cert_file` and `key_file` options inside `tls_config` and `proxy_tls_config` sections at [http client settings](https://docs.victoriametrics.com/sd_configs.html#http-api-client-options). - FEATURE: [vmagent](https://docs.victoriametrics.com/vmagent.html): reduce CPU load when big number of targets are scraped over HTTPS with the same custom TLS certificate configured via `tls_config->cert_file` and `tls_config->key_file` at [scrape_config](https://docs.victoriametrics.com/sd_configs.html#scrape_configs). - FEATURE: [vmbackup](https://docs.victoriametrics.com/vmbackup.html): add `-filestream.disableFadvise` command-line flag, which can be used for disabling `fadvise` syscall during backup upload to the remote storage. By default `vmbackup` uses `fadvise` syscall in order to prevent from eviction of recently accessed data from the [OS page cache](https://en.wikipedia.org/wiki/Page_cache) when backing up large files. Sometimes the `fadvise` syscall may take significant amounts of CPU when the backup is performed with large value of `-concurrency` command-line flag on systems with big number of CPU cores. In this case it is better to manually disable `fadvise` syscall by passing `-filestream.disableFadvise` command-line flag to `vmbackup`. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5120) for details. - FEATURE: [vmbackup](https://docs.victoriametrics.com/vmbackup.html): add `-deleteAllObjectVersions` command-line flag, which can be used for forcing removal of all object versions in remote object storage. See [this](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5121) issue and [these docs](https://docs.victoriametrics.com/vmbackup.html#permanent-deletion-of-objects-in-s3-compatible-storages) for the details. - FEATURE: [Alerting rules for VictoriaMetrics](https://github.com/VictoriaMetrics/VictoriaMetrics/tree/master/deployment/docker#alerts): account for `vmauth` component for alerts `ServiceDown` and `TooManyRestarts`. - FEATURE: [Alerting rules for VictoriaMetrics](https://github.com/VictoriaMetrics/VictoriaMetrics/tree/master/deployment/docker#alerts): make `TooHighMemoryUsage` more tolerable to spikes or near-the-threshold states. The change should reduce number of false positives. - FEATURE: [Alerting rules for VictoriaMetrics](https://github.com/VictoriaMetrics/VictoriaMetrics/tree/master/deployment/docker#alerts): add `TooManyMissedIterations` alerting rule for vmalert to detect groups that miss their evaulations due to slow queries. - FEATURE: [vmui](https://docs.victoriametrics.com/#vmui): add support for functions, labels, values in autocomplete. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3006). - FEATURE: [vmui](https://docs.victoriametrics.com/#vmui): retain specified time interval when executing a query from `Top Queries`. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5097). - FEATURE: [vmui](https://docs.victoriametrics.com/#vmui): improve repeated VMUI page load times by enabling caching of static js and css at web browser side according to [these recommendations](https://developer.chrome.com/docs/lighthouse/performance/uses-long-cache-ttl/). - FEATURE: [vmui](https://docs.victoriametrics.com/#vmui): sort legend under the graph in descending order of median values. This should simplify graph analysis, since usually the most important lines have bigger values. - FEATURE: [vmui](https://docs.victoriametrics.com/#vmui): reduce vertical space usage, so more information is visible on the screen without scrolling. - FEATURE: [vmui](https://docs.victoriametrics.com/#vmui): show query execution duration in the header of query input field. This should help optimizing query performance. - FEATURE: support `Strict-Transport-Security`, `Content-Security-Policy` and `X-Frame-Options` HTTP response headers in the all VictoriaMetrics components. The values for headers can be specified via the following command-line flags: `-http.header.hsts`, `-http.header.csp` and `-http.header.frameOptions`. - FEATURE: [vmalert-tool](https://docs.victoriametrics.com/#vmalert-tool): add `unittest` command to run unittest for alerting and recording rules. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/4789) for details. - FEATURE: dashboards/vmalert: add new panel `Missed evaluations` for indicating alerting groups that miss their evaluations. - FEATURE: all: track requests with wrong auth key and wrong basic auth at `vm_http_request_errors_total` [metric](https://docs.victoriametrics.com/#monitoring) with `reason="wrong_auth_key"` and `reason="wrong_basic_auth"`. See [this issue](https://github.com/victoriaMetrics/victoriaMetrics/issues/4590). Thanks to [@&#8203;venkatbvc](https://github.com/venkatbvc) for the [pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5166). - FEATURE: [vmauth](https://docs.victoriametrics.com/vmauth.html): add ability to drop the specified number of `/`-delimited prefix parts from the request path before proxying the request to the matching backend. See [these docs](https://docs.victoriametrics.com/vmauth.html#dropping-request-path-prefix). - FEATURE: [vmauth](https://docs.victoriametrics.com/vmauth.html): add ability to skip TLS verification and to specify TLS Root CA when connecting to backends. See [these docs](https://docs.victoriametrics.com/vmauth.html#backend-tls-setup) and [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5240). - FEATURE: `vmstorage`: gradually close `vminsert` connections during 25 seconds at [graceful shutdown](https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#updating--reconfiguring-cluster-nodes). This should reduce data ingestion slowdown during rolling restarts. The duration for gradual closing of `vminsert` connections can be configured via `-storage.vminsertConnsShutdownDuration` command-line flag. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4922) and [these docs](https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#improving-re-routing-performance-during-restart) for details. - FEATURE: `vmstorage`: add `-blockcache.missesBeforeCaching` command-line flag, which can be used for fine-tuning RAM usage for `indexdb/dataBlocks` cache when queries touching big number of time series are executed. - FEATURE: add `-loggerMaxArgLen` command-line flag for fine-tuning the maximum lengths of logged args. - BUGFIX: [vmalert](https://docs.victoriametrics.com/vmalert.html): strip sensitive information such as auth headers or passwords from datasource, remote-read, remote-write or notifier URLs in log messages or UI. This behavior is by default and is controlled via `-datasource.showURL`, `-remoteRead.showURL`, `remoteWrite.showURL` or `-notifier.showURL` cmd-line flags. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5044). - BUGFIX: [vmalert](https://docs.victoriametrics.com/vmalert.html): fix vmalert web UI when running on 32-bit architectures machine. - BUGFIX: [vmalert](https://docs.victoriametrics.com/vmalert.html): do not send requests to configured remote systems when `-datasource.*`, `-remoteWrite.*`, `-remoteRead.*` or `-notifier.*` command-line flags refer files with invalid auth configs. Previously such requests were sent without properly set auth headers. Now the requests are sent only after the files are updated with valid auth configs. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5153). - BUGFIX: [vmalert](https://docs.victoriametrics.com/vmalert.html): properly maintain alerts state in [replay mode](https://docs.victoriametrics.com/vmalert.html#rules-backfilling) if alert's `for` param was bigger than replay request range (usually a couple of hours). See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5186) for details. - BUGFIX: [vmalert](https://docs.victoriametrics.com/vmalert.html): increment `vmalert_remotewrite_errors_total` metric if all retries to send remote-write request failed. Before, this metric was incremented only if remote-write client's buffer is overloaded. - BUGFIX: [vmalert](https://docs.victoriametrics.com/vmalert.html): increment `vmalert_remotewrite_dropped_rows_total` and `vmalert_remotewrite_dropped_bytes_total` metrics if remote-write client's buffer is overloaded. Before, these metrics were incremented only after unsuccessful HTTP calls. - BUGFIX: `vmselect`: improve performance and memory usage during query processing on machines with big number of CPU cores. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5087). - BUGFIX: dashboards: fix vminsert/vmstorage/vmselect metrics filtering when dashboard is used to display data from many sub-clusters with unique job names. Before, only one specific job could have been accounted for component-specific panels, instead of all available jobs for the component. - BUGFIX: dashboards: respect `job` and `instance` filters for `alerts` annotation in cluster and single-node dashboards. - BUGFIX: dashboards: update description for RSS and anonymous memory panels to be consistent for single-node, cluster and vmagent dashboards. - BUGFIX: dashboards/vmalert: apply `desc` sorting in tooltips for vmalert dashboard in order to improve visibility of the outliers on graph. - BUGFIX: dashboards/vmalert: properly apply time series filter for panel `No data errors`. Before, the panel didn't respect `job` or `instance` filters. - BUGFIX: dashboards/vmalert: fix panel `Errors rate to Alertmanager` not showing any data due to wrong label filters. - BUGFIX: dashboards/cluster: fix description about `max` threshold for `Concurrent selects` panel. Before, it was mistakenly implying that `max` is equal to the double of available CPUs. - BUGFIX: [VictoriaMetrics cluster](https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html): bump hard-coded limit for search query size at `vmstorage` from 1MB to 5MB. The change should be more suitable for real-world scenarios and protect vmstorage from excessive memory usage. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5154) for details - BUGFIX: [vmbackup](https://docs.victoriametrics.com/vmbackup.html): fix error when creating an incremental backup with the `-origin` command-line flag. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5144) for details. - BUGFIX: [vmagent](https://docs.victoriametrics.com/vmagent.html): properly apply [relabeling](https://docs.victoriametrics.com/vmagent.html#relabeling) with `regex`, which start and end with `.+` or `.*` and which contain alternate sub-regexps. For example, `.+;|;.+` or `.*foo|bar|baz.*`. Previously such regexps were improperly parsed, which could result in undexpected relabeling results. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5297). - BUGFIX: [vmagent](https://docs.victoriametrics.com/vmagent.html): properly discover Kubernetes targets via [kubernetes_sd_configs](https://docs.victoriametrics.com/sd_configs.html#kubernetes_sd_configs). Previously some targets and some labels could be skipped during service discovery because of the bug introduced in [v1.93.5](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v1.93.5) when implementing [this feature](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4850). See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5216) for more details. - BUGFIX: [vmagent](https://docs.victoriametrics.com/vmagent.html): fix vmagent ignoring configuration reload for streaming aggregation if it was started with empty streaming aggregation config. Thanks to [@&#8203;aluode99](https://github.com/aluode99) for the [pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5178). - BUGFIX: [vmagent](https://docs.victoriametrics.com/vmagent.html): do not scrape targets if the corresponding [scrape_configs](https://docs.victoriametrics.com/sd_configs.html#scrape_configs) refer to files with invalid auth configs. Previously the targets were scraped without properly set auth headers in this case. Now targets are scraped only after the files are updated with valid auth configs. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5153). - BUGFIX: [vmagent](https://docs.victoriametrics.com/vmagent.html): properly parse `ca`, `cert` and `key` options at `tls_config` section inside [http client settings](https://docs.victoriametrics.com/sd_configs.html#http-api-client-options). Previously string values couldn't be parsed for these options, since the parser was mistakenly expecting a list of `uint8` values instead. - BUGFIX: [vmagent](https://docs.victoriametrics.com/vmagent.html): properly drop samples if `-streamAggr.dropInput` command-line flag is set and `-remoteWrite.streamAggr.config` contains an empty file. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5207). - BUGFIX: [vmagent](https://docs.victoriametrics.com/vmagent.html): do not print redundant error logs when failed to scrape consul or nomad target. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5239). - BUGFIX: [vmagent](https://docs.victoriametrics.com/vmagent.html): generate proper link to the main page and to `favicon.ico` at http pages served by `vmagent` such as `/targets` or `/service-discovery` when `vmagent` sits behind an http proxy with custom http path prefixes. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5306). - BUGFIX: [vmagent](https://docs.victoriametrics.com/vmagent.html): properly decode Snappy-encoded data blocks received via [VictoriaMetrics remote_write protocol](https://docs.victoriametrics.com/vmagent.html#victoriametrics-remote-write-protocol). See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5301). - BUGFIX: [vmstorage](https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html): prevent deleted series to be searchable via `/api/v1/series` API if they were re-ingested with staleness markers. This situation could happen if user deletes the series from the target and from VM, and then vmagent sends stale markers for absent series. Thanks to [@&#8203;ilyatrefilov](https://github.com/ilyatrefilov) for the [issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5069) and [pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5174). - BUGFIX: [vmstorage](https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html): log warning about switching to ReadOnly mode only on state change. Before, vmstorage would log this warning every 1s. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5159) for details. - BUGFIX: [vmauth](https://docs.victoriametrics.com/vmauth.html): show browser authorization window for unauthorized requests to unsupported paths if the `unauthorized_user` section is specified. This allows properly authorizing the user. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5236) for details. - BUGFIX: [vmauth](https://docs.victoriametrics.com/vmauth.html): properly proxy requests to HTTP/2.0 backends and properly pass `Host` header to backends. - BUGFIX: [vmui](https://docs.victoriametrics.com/#vmui): fix the `Disable cache` toggle at `JSON` and `Table` views. Previously response caching was always enabled and couldn't be disabled at these views. - BUGFIX: [vmui](https://docs.victoriametrics.com/#vmui): correctly display query errors on [Explore Prometheus Metrics](https://docs.victoriametrics.com/#metrics-explorer) page. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5202) for details. - BUGFIX: [vmui](https://docs.victoriametrics.com/#vmui): properly handle trailing slash in the server URL. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5203). - BUGFIX: [vmbackupmanager](https://docs.victoriametrics.com/vmbackupmanager.html): correctly print error in logs when copying backup fails. Previously, error was displayed in metrics but was missing in logs. - BUGFIX: fix panic, which could occur when [query tracing](https://docs.victoriametrics.com/#query-tracing) is enabled. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5319). ##### How to run VictoriaMetrics Unpack the `victoria-metrics-*.tar.gz` archive and read [these docs](https://github.com/VictoriaMetrics/VictoriaMetrics/wiki/Single-server-VictoriaMetrics#operation). `vmutils-*.tag.gz` archive contains the following tools: - [vmagent](https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/app/vmagent/README.md) - [vmalert](https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/app/vmalert/README.md) - [vmalert-tool](https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/app/vmalert-tool/README.md) - [vmauth](https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/app/vmauth/README.md) - [vmbackup](https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/app/vmbackup/README.md) - [vmctl](https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/app/vmctl/README.md) - [vmrestore](https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/app/vmrestore/README.md) `vmutils-*-enterprise.tar.gz` archive contains the following additional [enterprise tools](https://victoriametrics.com/enterprise.html): - [vmbackupmanager](https://docs.victoriametrics.com/vmbackupmanager.html) - [vmgateway](https://docs.victoriametrics.com/vmgateway.html) The corresponding docker images are available [here](https://hub.docker.com/r/victoriametrics/). Cluster version is available [here](https://github.com/VictoriaMetrics/VictoriaMetrics/tree/cluster). </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy41OS43IiwidXBkYXRlZEluVmVyIjoiMzcuNTkuOCIsInRhcmdldEJyYW5jaCI6Im1hc3RlciJ9-->
renovate added 1 commit 2023-11-15 18:01:47 +00:00
AverageMarcus merged commit d28fc952ad into master 2023-11-16 07:06:17 +00:00
AverageMarcus deleted branch renovate/victoriametrics-vmagent-1.x 2023-11-16 07:06:18 +00:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No Label
Milestone
Clear milestone
No items
No Milestone
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: AverageMarcus/cluster.fun#133
No description provided.
Delete Branch "renovate/victoriametrics-vmagent-1.x"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?