Data for the past 10 days is backfilled. We sincerely apologize for any inconvenience this issue may have caused and greatly appreciate your patience.
Posted May 10, 2020 - 09:05 EDT
Update
Historical data going back to April 30 continues to backfill. Our rough estimate is this will complete sometime tomorrow before 11 PM ET Sunday, May 10th (3:00 AM UTC May 11). If this estimate changes significantly or the backfill completes we will update the status page. Thank you for your patience and we apologize for any inconvenience.
Posted May 09, 2020 - 07:31 EDT
Update
There are some 5xx errors, please retry. Thank you for your patience.
Posted May 08, 2020 - 17:14 EDT
Monitoring
We fixed the issue with the Events API service connecting to the new data backend and the Events API is working again. Data backfill for the full 10 days is still ongoing. Thank you for your patience and we are sorry for the inconvenience these outages have caused.
Posted May 08, 2020 - 16:11 EDT
Identified
We are continuing to work with our service provider to bring Events API back up.
Posted May 08, 2020 - 14:48 EDT
Investigating
We're seeing an increase in 5XX errors to the Events API. We're investigating.
Posted May 08, 2020 - 13:45 EDT
Update
There is an increase in API 5xx errors, we are investigating
Posted May 08, 2020 - 13:45 EDT
Monitoring
Events data is up to date since 1AM UTC and we are continuing to backfill older data. The API is responding successfully to requests. We are sorry for any inconvenience and are working to get all data backfilled as soon as possible. We will post updates as we progress.
Posted May 08, 2020 - 11:35 EDT
Update
The Events API is back up and should be responding successfully to requests. We are backfilling data now, giving priority to the most recent data.
Posted May 08, 2020 - 09:52 EDT
Identified
We are continuing to work on bringing the Events Search cluster back online. We are sorry for any inconvenience and will update as we make progress.
Posted May 08, 2020 - 09:02 EDT
Investigating
We have identified an issue with our database cluster and are investigating. Customers will see high 5xx error rates on the Events API and delayed data processing.
Posted May 08, 2020 - 05:57 EDT
Monitoring
The database has been restored and the API is up and serving requests. Data loading will be catching up over the next several hours.
Posted May 07, 2020 - 20:08 EDT
Update
We are continuing to work on this and are monitoring the health of our database closely.
Posted May 07, 2020 - 19:29 EDT
Update
We have identified the issue with our database cluster and our service provider has finished their maintenance. We are waiting for the cluster to return to a stable state before we can begin data loading or serving API requests.
Posted May 07, 2020 - 17:42 EDT
Identified
We are continuing to investigate and have identified the issue with our database. We are actively working with our service provider to restore service as soon as possible.
Posted May 07, 2020 - 16:33 EDT
Update
We are continuing to investigate this issue.
Posted May 07, 2020 - 15:51 EDT
Investigating
We are experiencing an elevated level of API and UI errors and latency for our APIs for some SparkPost and SparkPost Enterprise customers for the Events API. Please retry any 5xx error.
We have turned off data loading to allow the databased to recover, which is causing data loading delays. Note: This issue does not impact our SparkPost Enterprise customers hosted in the EU.
Posted May 07, 2020 - 15:39 EDT
This incident affected: Events API (Events API - USA) and SparkPost Application (WebUI) (SparkPost Application - USA).