Intermittent timeline event loss affecting approximately 8% of organizations

Incident Report for Splunk On-Call

Resolved

This incident has been resolved. Timeline events are no longer missing, all systems fully operational.

Posted May 10, 2024 - 08:58 MDT

Monitoring

A fix has been implemented and we are monitoring the results

Posted May 09, 2024 - 22:25 MDT

Investigating

Splunk On-Call is currently investigating an issue resulting in missing timeline events for approximately 8% of our customer base. These events display ingested alerts and incident actions such as paging and acknowledgments. The actual paging functionality is unaffected.
As a workaround, please leverage the Splunk On-Call Response Metrics, On-Call Review, and Incident Frequency reports to obtain your alert event information.

We apologize for this inconvenience. Please reach out to On-Call Support with any questions.
https://help.victorops.com/knowledge-base/how-to-contact-splunk-on-call-support/

Posted May 09, 2024 - 20:54 MDT

This incident affected: Clients (Web client (portal), Android client, iOS client).