Major Cloud Providers – Monthly Outage Recap December
MS Azure
12/27/19 Unable to create new resources in Azure Portal (Tracking ID 4_6S-NC8)Between 15:18 and 16:26 UTC on 27 Dec 2019 customers using the Azure Portal may have received failure notifications or 404 errors when attempting to create new resources through the Azure Portal. Programmatic deployments, such as CLI, Powershell, Template deployments etc., would have been successful.
12/12/19 RCA – Connectivity issue for Azure Resources in North America (Tracking ID HKZT-N88)Between 09:45 and 16:26 UTC on 12 Dec 2019, a subset of customers in North America may have experienced degraded performance, network drops, or timeouts when accessing Azure resources. Customers may also have experienced downstream impact to dependent Azure services.
12/12/19 DownDetector
Problems at Microsoft AzureMicrosoft Azure is having issues since 10:33 AM EST. Most reported problems
- 46% Website hosting
- 28% Cloud services
- 25% Virtual machines
12/11/19 RCA – Azure CDN and Azure Kubernetes Service – Service Availability Issue (Tracking ID LTPP-R98)Between 17:24 and 18:48 UTC on 11 Dec 2019, clients of customers attempting to reach Azure CDN from Verizon endpoints would intermittently receive HTTP (5XX) errors or connection failures instead of expected content.
12/11/19 DownDetector
Problems at Microsoft Azure Microsoft Azure is having issues since 12:05 PM EST. Most reported problems
- 48% Cloud services
- 41% Website hosting
- 10% Virtual machines
AWS
12/27/19 Amazon CloudFront Elevated CloudFront API errors Between 9:30 AM and 11:01 AM PST, customers may have seen elevated CloudFront API errors. Due to these API errors there was a backlog of changes that resulted in longer than usual change propagation delays for CloudFront configurations and invalidations.
12/16/19 VMware Cloud on AWS – SDDC Provisioning Failures SDDC provisioning and adding hosts/clusters in regions may intermittently fail.
Start Time: December 16, 2019, 14:36 UTC
End Time: December 16, 2019, 14:59 UTC
12/10/20 DownDetectorProblems at Amazon Web Services Amazon Web Services is having issues since 8:36 PM EST. Most reported problems
Other Platforms
12/31/19 SAP Cloud Platform Brazil (São Paulo) [cf-br10] – Service Advisory Since approximately 00:21 UTC until 01:12 UTC, Applications may be unavailable. Lifecycle management operations cannot be executed
12/29/19
– VMware Skyline Service Performance Degradation Issue Skyline Inventory and Finding reports will not get completed. Expanding product in Collector Health Overview will show no results.
Start Time: December 29, 2019 9:50 UTC
End Time: December 29, 2019 14:10 UTC
-SAP Cloud Platform Europe (Rot)
[neo-eu1]
– Service Advisory Since approximately 23:39 UTC on 29 Dec 2019 until 00:09 UTC on 30 Dec 2019, OAuth/platform tokens cannot be validated or created
12/28/19 SAP Cloud Platform Europe (Rot) [neo-eu1] – Service Advisory Since approximately 23:39 UTC on 28 Dec 2019 until 00:02 UTC on 29 Dec 2019, OAuth/platform tokens cannot be validated or created
12/27/19 VMware Cloud Services Performance Degradation with Skyline Notifications Service Users may not receive email notifications from Skyline
Start Time: December 27, 2019 10:59 UTC
End Time: December 27 , 2019 11:41 UTC
12/26/19 VMware Secure State Performance Degradation issue Users will not have event processing and new findings
Start Time: December 26, 2019 20:29 UTC
End Time: December 26, 2019 23:07 UTC
12/25/19
– VMware SD-WAN by VeloCloud Gateways in Seattle is Down All Gateways in the Seattle Region are currently down due to a network issue
Start Time: December 25, 2019 12:40 UTC
End Time: December 25, 2019 17:05 UTC
-SAP Cloud Platform Europe (Rot) [neo-eu1] – Service Advisory Since approximately 23:35 UTC on 25 Dec 2019 until 01:16 UTC on 26 Dec 2019, Security configuration changes cannot be made and platform API tokens cannot be issued. OAuth/platform tokens cannot be validated or created
12/24/19 VMware Secure State Performance Degradation issue VMware Secure State users will not able to see the latest alerts with regards to Security violation.
Start Time: December 24, 2019 09:04 UTC
End Time: December 24, 2019 18:05 UTC
12/22/19
– VMware Skyline Service Performance Degradation issue Few Skyline customers running Collector version 2.3.0.1 may see the Collectors in Inactive state after auto-upgrade.
Start Time: December 21, 2019 06:20 UTC
End Time: December 21, 2019 04:21 UTC
-SAP Cloud Platform Europe (Rot) [cf-eu1] – Service Advisory Since approximately 13:24 UTC until 15:54 UTC Customer could not consume docker images and also an installations which involve binaries from Artifactory would not be possible
12/19/19
– VMware Cloud Services Intermittent AppDefense login failure Some users may face login issues when accessing AppDefense.
Start Time: Dec 19, 2019 17:08 UTC
End Time: Dec 19, 2019 19:20 UTC
– SAP Cloud Platform Japan (Tokyo) [neo-jp1] – Service Advisory Since approximately 10:26 UTC until 10:54 UTC Internet of Things management and deployment is not possible
– SAP Cloud Platform Europe (Frankfurt) [neo-eu2] – Service Advisory Since approximately 06:21 UTC until 07:00 UTC Lifecycle management operations for Java applications cannot be executed
-Google Cloud Functions Incident #19010 Creation of new Cloud Functions is failing in europe-west1 and europe-west2. Incident began at 2019-12-19 10:19 and ended at 2019-12-19 11:39 (US/Pacific) lasting 1 hour 19 minutes
12/18/19
–VMware Skyline Service Login Issue. Users may experience an issue while accessing the Skyline Service.
Start Time: December 18, 2019 11:15 UTC
End Time: December 18, 2019 12:05 UTC
– SAP Cloud Platform US West (Chandler) [neo-us2] – Service Advisory Since approximately 15:31 UTC until 23:11 UTC A general disruption is impacting the availability of applications and services
– Google Cloud Networking Incident #19023 Regional network issue. Incident began at 2019-12-18 23:48 and ended at 2019-12-19 02:36 (all times are US/Pacific) lasting 2 hours 48 minutes
–Google Cloud Networking Incident #20001 Google’s production network experienced a temporary reduction in capacity, due to multiple fiber cuts in optical links interconnecting Sofia, Bulgaria. Incident began at 2019-12-18 23:43 and ended at 2019-12-19 00:44 (US/Pacific) lasting 1 hour 1 minute
12/16/19 VMware Cloud on AWS – SDDC Provisioning Failures SDDC provisioning and adding hosts/clusters in regions may intermittently fail.
Start Time: December 16, 2019, 14:36 UTC
End Time: December 16, 2019, 14:59 UTC
12/15/19
–VMware Skyline Service Performance Degradation issue Users will experience degraded performance while fetching Account details for Advisor login via MyVMware.
Start Time: December 15, 2019 13:30 UTC
End Time: December 15, 2019 15:15 UTC
-SAP Cloud Platform Europe (Frankfurt) [neo-eu2] – Service Advisory Since approximately 03:48 UTC until 04:42 UTC, Connectivity and connections established with Connectivity are unavailable. OData Provisioning is unavailable
12/14/19 SAP Cloud Platform Japan (Tokyo) [neo-jp1] – Service Advisory Since approximately 16:30 UTC until 16:39 UTC A general disruption is impacting the availability of applications and services
12/13/19
–VMware Cloud on AWS Service Intermittent Availability issue User may not be able to access the service or may experience trouble while accessing the service.
Start Time: December 13, 2019 12:48 UTC
End Time: December 13, 2019 15:10 UTC
-Google Cloud Asset Inventory Incident #19001 Symptoms: high error rate on Cloud Asset Inventory API calls. Incident began at 2019-12-13 13:01 and ended at 2019-12-13 13:39 (US/Pacific) lasting 37 minutes
12/11/19 SAP Cloud Platform US West (Chandler) [neo-us2] – Service Advisory Since approximately 05:00 UTC until 18:40 UTC on 12 Dec 2019 Database lifecycle operations (restart, upgrade, etc.) are not possible for HANA and ASE DBs. Automatic failover for High-Availability HANA systems is temporarily turned off.
12/10/19
-SAP Cloud Platform Australia (Sydney) [neo-ap1] – Service Advisory Since approximately 15:24 UTC until 16:30 UTC, A general disruption is impacting the availability of applications and services
-SAP Cloud Platform Europe (Amsterdam) [neo-eu3] – Service Advisory Since approximately 08:10 UTC until 08:21 UTC, A general disruption is impacting the availability of applications and services
-SAP Cloud Platform Europe (Rot) – Trial [neo-eu1-trial] – Service Advisory Since approximately 07:44 UTC until 08:12 UTC Web IDE Full-Stack is unavailable
12/9/19
-SAP Cloud Platform Europe (Rot) [cf-eu1] – Service Advisory Since approximately 02:40 UTC until 04:28 UTC IoT applications cannot run Spark jobs
– Google Cloud infrastructure components Incident #19002 High latency and elevated error rate. Incident began at 2019-12-09 00:26 and ended at 2019-12-09 03:44 (all times are US/Pacific) lasting 3 hours 17 minutes
12/8/19
-SAP Cloud Platform Europe (Rot) [neo-eu1] – Service Advisory Since approximately 06:30 UTC on 08 Dec 2019 until 18:40 UTC on 12 Dec 2019 Database lifecycle operations (restart, upgrade, etc.) are not possible for HANA and ASE DBs. Automatic failover for High-Availability HANA systems is temporarily turned off.
-SAP Cloud Platform Europe (Netherlands) [cf-eu20] – Service Advisory Since approximately 05:39 UTC until 05:52 UTC Applications protected by Authorization & Trust Management (XSUAA) are not accessible
12/7/19
– SAP Cloud Platform Multiple Regions – Service Advisory Since approximately 22:42 UTC until 23:01 UTC, A general disruption is impacting the availability of applications and services
-Google Cloud SQL Incident #19006 We’ve received a report of an issue with Cloud SQL unavailability hosted in the us-east region. Incident began at 2019-12-07 11:18 and ended at 2019-12-07 13:04 (US/Pacific) lasting 1 hour 45 minutes
12/6/19 SAP Cloud Platform Europe (Rot) [neo-eu1] – Service Advisory Since approximately 07:30 UTC on 06 Dec 2019 until 16:55 UTC, Database lifecycle operations are not possible for HANA and ASE DBs. High-Availability for HANA is temporarily turned off.
12/5/19
-SAP Cloud Platform Europe (Frankfurt) [cf-eu10] – Service Advisory Since approximately 14:03 UTC on 05 Dec 2019, until 18:23 UTC. Lifecycle management operations cannot be executed
–VMware Cloud on AWS Service Performance Degradation issue VMware Cloud Services Console may be inaccessible.
Start Time: December 05, 2019 21:05 UTC
End Time: December 05, 2019 23:05 UTC
12/3/19 VMware Skyline Service Performance Degradation issue Skyline users may be experiencing availability issues with Log Assist and data collection. Start Time: December 03, 2019 16:22 UTC
End Time: December 03, 2019 21:27 UTC
