CRE-2024-0019

Alloy entries too far behindLow

Impact: 3/10

Mitigation: 2/10

CRE-2024-0019View on GitHub

GrafanaAlloyLokiPublic

Description

Grafana can get into a state where it writes more errors messages than it can process. The problem is compounded when Grafana is collecting its own error logs that include the related warnings that it can no longer keep up.\nThis can consume several GB per day of storage.\n

Mitigation

Modify the following configuration parameters in Grafana:\n\n```\nreject_old_samples: false\nreject_old_samples_max_age: <raise this limit>\n```\n

References

• https://github.com/grafana/loki/issues/9869