Outage impacting some customer applications

The incident is now fully resolved. Thanks for your patience.

Supplier update:

The rollout of the fix to redundant networking equipment is fully completed, meaning all networking devices in AMS3, LON1, and SFO2 have been patched. Our Engineering team saw a brief period where SFO2 was impacted as traffic reconverged.

At this time, all services and regions impacted by this incident should be recovered.

We're now monitoring to ensure stability.

From Supplier:

The fix has now been rolled out for our LON1 region and users should be able to interact with their resources in LON1 normally at this time.

This concludes the rollout and all services in all regions should be recovered or showing recovery.

Our Engineering team is continuing work to roll out this fix to our redundant networking equipment, so that in the case of a failover, we are not susceptible to the issue that occurred and is mitigated by this rollout.

From supplier:

The fix has now been rolled out for our SFO2 region and users should be able to interact with their resources in SFO2 normally at this time. Our team continues to work on the rollout for LON1.

There has been a re-occurrence of this issue. The upstream provider is investigating. This may lead to intermittent service until full resolution.

The supplier has resolved the core issue, and we are waiting for things to recover.

An outage upstream at a supplier data centre is impacting services at this time. Our systems alerted us to this automatically and we are monitoring the supplier status.