PREQUEL-2025-0101
Loki Ingester Memcache Out of MemoryMediumImpact: 6/10Mitigation: 5/10
PREQUEL-2025-0101View on GitHub
Description
Loki ingester reports memcached errors indicating out-of-memory conditions while caching\nobjects, logging messages such as "SERVER_ERROR out of memory storing object". When this\noccurs, cache writes fail and can lead to degraded ingestion performance, retries, and\nincreased memory pressure on the ingester.\n
Mitigation
- Verify memcached memory allocation; consider increasing memory requests/limits\n- Reduce volume of cached data or adjust cache policies to fit capacity\n- Monitor cache hit/miss and eviction metrics to tune sizing appropriately\n- Review object sizes; consider compression or truncation strategies where applicable\n