Document Processing Delay

Incident Report for SPS Commerce

Resolved

All systems are currently operating as expected. We continue working to reconcile and verify documents impacted during this incident.
Posted Oct 20, 2025 - 21:00 CDT

Update

All systems are currently operating as expected. We continue working to reconcile and verify documents impacted during this incident. Updates will be shared as we complete recovery activities.
Posted Oct 20, 2025 - 19:03 CDT

Monitoring

Error rates have normalized, and all systems are now processing data as expected. We’ve transitioned this incident to monitoring while our teams verify stability and reconcile any transactions impacted during the earlier disruption.
Posted Oct 20, 2025 - 18:38 CDT

Update

Error rates remain stable following earlier improvements. Processing continues as our teams work through the backlog of transactions and monitor system performance to confirm sustained recovery.
Posted Oct 20, 2025 - 17:28 CDT

Update

Error rates have improved and document processing has resumed across affected systems. We are actively working through a backlog of transactions and continue to monitor performance to confirm sustained stability. We'll provide further updates as we process through the backlog.
Posted Oct 20, 2025 - 15:58 CDT

Update

Our teams remain actively engaged and continue to monitor system performance closely. Error rates are still elevated, and mitigation work is ongoing. We’ll provide further updates as we confirm sustained improvement.
Posted Oct 20, 2025 - 14:54 CDT

Update

Our teams remain actively engaged on this issue and continue to work toward recovery. Error rates remain elevated, and we’re monitoring system performance closely. We’ll provide another update as soon as we have additional information to share.
Posted Oct 20, 2025 - 13:24 CDT

Identified

Error rates with our primary service provider have increased, resulting in broader impact to processing. We are reverting the incident status to Identified, response teams remain engaged focusing on mitigation and recovery. Updates will be shared as conditions evolve.
Posted Oct 20, 2025 - 12:02 CDT

Update

We are currently observing increased error rates affecting a subset of data processing. Most data continues to process successfully, but we’re seeing intermittent delays in the subset of data affected. The incident remains in active monitoring while mitigation and recovery work continues.
Posted Oct 20, 2025 - 11:47 CDT

Update

Data processing remains stable, and reconciliation work is nearing completion. The incident will remain in monitoring while teams continue to observe and investigate higher-than-normal error rates.
Posted Oct 20, 2025 - 10:32 CDT

Update

All current inbound and outbound dataflow continues to process normally. Recovery of affected documents is continuing as expected, and no new impact has been observed.
Posted Oct 20, 2025 - 08:31 CDT

Monitoring

All current inbound and outbound dataflow is processing normally. Documents that were in process during the incident are being recovered.
Posted Oct 20, 2025 - 06:37 CDT

Update

All current inbound and outbound dataflow is processing normally. Documents that were in process during the incident are being recovered. Fulfillment Monitor visibility remains impacted and is actively being investigated.
Posted Oct 20, 2025 - 06:19 CDT

Update

All current inbound and outbound dataflow is processing normally. Documents that were in process during the incident are being recovered. Fulfillment Monitor visibility remains impacted and is actively being investigated.
Posted Oct 20, 2025 - 06:18 CDT

Update

All current inbound and outbound dataflow is processing normally. Documents that were in process during the incident are being recovered. Fulfillment Monitor visibility remains impacted and is actively being investigated.
Posted Oct 20, 2025 - 06:07 CDT

Update

We are currently investigating an issue impacting multiple platform services, including backend systems and customer-facing applications. The disruption is linked to a broader incident with one of our cloud providers and may result in degraded performance, intermittent errors, or temporary delays across portions of our platform.
All data will be reconciled and fully processed once services have stabilized. Our teams continue to monitor the situation closely and will provide updates as recovery progresses.
Posted Oct 20, 2025 - 05:35 CDT

Update

We are continuing to work on a fix for this issue.
Posted Oct 20, 2025 - 05:25 CDT

Update

We are currently investigating an issue impacting multiple platform services, including backend systems and customer-facing applications. The disruption is linked to a broader incident with one of our cloud providers and may result in degraded performance, intermittent errors, or temporary delays across portions of our platform.
All data will be reconciled and fully processed once services have stabilized. Our teams continue to monitor the situation closely and will provide updates as recovery progresses.
Posted Oct 20, 2025 - 05:23 CDT

Update

We are continuing to work on a fix for this issue.
Posted Oct 20, 2025 - 04:55 CDT

Identified

We are investigating an open incident with our document processing infrastructure which is potentially causing delays or failures for transactions processing through the system. We will reconcile all data after we have recovered from the incident to ensure all transactions are processed as expected.
Posted Oct 20, 2025 - 04:54 CDT
This incident affected: Integrations (Oracle Transportation Management, NetSuite) and Document Processing, AS2 Communications, FTP Communications, Assortment, Fulfillment Monitor, Dev Center, Commerce VAN.