Resolved -
All systems are currently operating as expected. We continue working to reconcile and verify documents impacted during this incident.
Oct 20, 21:00 CDT
Update -
All systems are currently operating as expected. We continue working to reconcile and verify documents impacted during this incident. Updates will be shared as we complete recovery activities.
Oct 20, 19:03 CDT
Monitoring -
Error rates have normalized, and all systems are now processing data as expected. We’ve transitioned this incident to monitoring while our teams verify stability and reconcile any transactions impacted during the earlier disruption.
Oct 20, 18:38 CDT
Update -
Error rates remain stable following earlier improvements. Processing continues as our teams work through the backlog of transactions and monitor system performance to confirm sustained recovery.
Oct 20, 17:28 CDT
Update -
Error rates have improved and document processing has resumed across affected systems. We are actively working through a backlog of transactions and continue to monitor performance to confirm sustained stability. We'll provide further updates as we process through the backlog.
Oct 20, 15:58 CDT
Update -
Our teams remain actively engaged and continue to monitor system performance closely. Error rates are still elevated, and mitigation work is ongoing. We’ll provide further updates as we confirm sustained improvement.
Oct 20, 14:54 CDT
Update -
Our teams remain actively engaged on this issue and continue to work toward recovery. Error rates remain elevated, and we’re monitoring system performance closely. We’ll provide another update as soon as we have additional information to share.
Oct 20, 13:24 CDT
Identified -
Error rates with our primary service provider have increased, resulting in broader impact to processing. We are reverting the incident status to Identified, response teams remain engaged focusing on mitigation and recovery. Updates will be shared as conditions evolve.
Oct 20, 12:02 CDT
Update -
We are currently observing increased error rates affecting a subset of data processing. Most data continues to process successfully, but we’re seeing intermittent delays in the subset of data affected. The incident remains in active monitoring while mitigation and recovery work continues.
Oct 20, 11:47 CDT
Update -
Data processing remains stable, and reconciliation work is nearing completion. The incident will remain in monitoring while teams continue to observe and investigate higher-than-normal error rates.
Oct 20, 10:32 CDT
Update -
All current inbound and outbound dataflow continues to process normally. Recovery of affected documents is continuing as expected, and no new impact has been observed.
Oct 20, 08:31 CDT
Monitoring -
All current inbound and outbound dataflow is processing normally. Documents that were in process during the incident are being recovered.
Oct 20, 06:37 CDT
Update -
All current inbound and outbound dataflow is processing normally. Documents that were in process during the incident are being recovered. Fulfillment Monitor visibility remains impacted and is actively being investigated.
Oct 20, 06:19 CDT
Update -
All current inbound and outbound dataflow is processing normally. Documents that were in process during the incident are being recovered. Fulfillment Monitor visibility remains impacted and is actively being investigated.
Oct 20, 06:18 CDT
Update -
All current inbound and outbound dataflow is processing normally. Documents that were in process during the incident are being recovered. Fulfillment Monitor visibility remains impacted and is actively being investigated.
Oct 20, 06:07 CDT
Update -
We are currently investigating an issue impacting multiple platform services, including backend systems and customer-facing applications. The disruption is linked to a broader incident with one of our cloud providers and may result in degraded performance, intermittent errors, or temporary delays across portions of our platform.
All data will be reconciled and fully processed once services have stabilized. Our teams continue to monitor the situation closely and will provide updates as recovery progresses.
Oct 20, 05:35 CDT
Update -
We are continuing to work on a fix for this issue.
Oct 20, 05:25 CDT
Update -
We are currently investigating an issue impacting multiple platform services, including backend systems and customer-facing applications. The disruption is linked to a broader incident with one of our cloud providers and may result in degraded performance, intermittent errors, or temporary delays across portions of our platform.
All data will be reconciled and fully processed once services have stabilized. Our teams continue to monitor the situation closely and will provide updates as recovery progresses.
Oct 20, 05:23 CDT
Update -
We are continuing to work on a fix for this issue.
Oct 20, 04:55 CDT
Identified -
We are investigating an open incident with our document processing infrastructure which is potentially causing delays or failures for transactions processing through the system. We will reconcile all data after we have recovered from the incident to ensure all transactions are processed as expected.
Oct 20, 04:54 CDT