Monitoring - We are now out of the double-failure scenario and performance of underlying systems has returned to more normal levels. Systems are still processing backlog from the degraded period and therefore overall user experience is not 100% back to normal yet.

In general, going forward we should see backups execute in a timely manner albeit possibly taking longer than normal due to previous delays. With this additional inflow of data we will expect to see delays in metadata import which will affect the browsing experience of the most recent backups for those affected. We expect to recover from this situation fairly quickly as we process the backlog.

We are monitoring this catch-up phase and will update this incident as we have news to report.
Oct 22, 09:54 CEST
Identified - Failures across multiple systems at the same time is causing a performance degradation on backup jobs and related services such as search data imports.

No data is lost and all automatic recovery mechanisms self-activated as intended during the two separate failure events.

Usually such failures go unnoticed by customers as systems dynamically reschedule loads to faster unaffected systems but in this particular case, because of two almost simultaneous failures, all load cannot transfer to systems that are not affected.

We are working on multiple tracks to re-establish usual performance. This issue will be updated until resolved.
Oct 20, 10:11 CEST
EU Operational
User Interface ? Operational
API ? Operational
SaaS Backup ? Operational
US Degraded Performance
User Interface ? Operational
API ? Operational
SaaS Backup ? Degraded Performance
AU Operational
User Interface ? Operational
API ? Operational
SaaS Backup ? Operational
UK Operational
User Interface ? Operational
API ? Operational
SaaS Backup ? Operational
Mobile Apps ? Operational
Desktop Backup ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Past Incidents
Oct 25, 2020

No incidents reported today.

Oct 24, 2020

No incidents reported.

Oct 23, 2020

No incidents reported.

Oct 22, 2020
Resolved - This incident has been resolved.
Oct 22, 13:35 CEST
Update - We are continuing to monitor for any further issues.
Oct 20, 21:25 CEST
Monitoring - As part of maintenance and troubleshooting works, we added additional up-to-date proxies to the existing systems. This should have a positive effect on the download issue of individual files experienced by the customers. We do not expect any major interruptions and the backup jobs should run as intended.
Oct 20, 21:23 CEST
Identified - We are currently deploying more capacity and upgrading existing systems to fix download issues that affect several customers. This may cause interruption and failure of some backup jobs, but new jobs will be started automatically, when this happens.
Oct 20, 13:42 CEST
Oct 21, 2020

No incidents reported.

Oct 20, 2020
Oct 19, 2020

No incidents reported.

Oct 18, 2020

No incidents reported.

Oct 17, 2020

No incidents reported.

Oct 16, 2020

No incidents reported.

Oct 15, 2020

No incidents reported.

Oct 14, 2020

No incidents reported.

Oct 13, 2020

No incidents reported.

Oct 12, 2020

No incidents reported.

Oct 11, 2020

No incidents reported.