Back to overview
Downtime

Azure service outage

Jan 09 at 10:19pm EST
Affected services
PROD PBD API
Test PBD API

Resolved
Jan 10 at 11:34pm EST

Azure regional network problems have been resolved.

Updating test API status to resolved.

Updated
Jan 10 at 03:59pm EST

The Azure resources serving the Test API appear to be up and down. Changing status to degraded until Azure confirms East US2 is stable once more.

Updated
Jan 10 at 03:45pm EST

The test API and supporting services / infrastructure have been restored.

Updated
Jan 10 at 01:23pm EST

The test API will be restored once Azure has recovered in East US2.

At that time, the production API will be re-deployed to East US2.

Current Azure status can be found here.

Updated
Jan 10 at 10:22am EST

Production API has resumed normal operation.

Note that performance will likely still be affected until the primary region has recovered.

Updated
Jan 10 at 08:41am EST

All primary API services have been re-deployed to the backup region.

Some data will be out of sync temporarily (transactions, items, receipts). PBD is working to recover these services as well.

Updated
Jan 10 at 07:59am EST

Some back-end services are beginning to recover.

We do not have a specific ETA available at this time. More updates to follow.

Updated
Jan 09 at 10:51pm EST

Downtime related to Azure outage in some regions.

The API and supporting services are in the the process of re-deployment to our secondary region.

More updates to follow.

Created
Jan 09 at 10:19pm EST

PROD PBD API went down.