tag:status.yubico.com,2005:/historyYubico Status - Incident History2024-03-19T08:49:56ZYubicotag:status.yubico.com,2005:Incident/200194502024-03-13T11:13:49Z2024-03-13T11:13:49ZDowntime on upload.yubico.com<p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>11:13</var> UTC</small><br><strong>Completed</strong> - Maintenance on upload.yubico.com has been completed.</p><p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>08:14</var> UTC</small><br><strong>Update</strong> - We're still not able to enable upload.yubico.com from it's maintenance mode. We will provide updates throughout this maintenance window until we can set the service back in operation.</p><p><small>Mar <var data-var='date'>13</var>, <var data-var='time'>06:59</var> UTC</small><br><strong>Update</strong> - Unfortunately we will need to prolong our maintenance window for upload.yubico.com. We will provide updates when necessary.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>23:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>19</var>, <var data-var='time'>10:27</var> UTC</small><br><strong>Update</strong> - We will be undergoing scheduled maintenance during this time.</p><p><small>Feb <var data-var='date'>19</var>, <var data-var='time'>10:26</var> UTC</small><br><strong>Scheduled</strong> - upload.yubico.com will be set in maintenance mode between 2024-03-12 23:00 and 2024-03-13 07:00 UTC.</p>tag:status.yubico.com,2005:Incident/199412202024-02-09T00:53:19Z2024-02-09T00:53:19ZInternational address verification experiencing errors<p><small>Feb <var data-var='date'> 9</var>, <var data-var='time'>00:53</var> UTC</small><br><strong>Resolved</strong> - The issues related to international address validation have been resolved. All aspects of YubiEnterprise Services are operational.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>20:15</var> UTC</small><br><strong>Monitoring</strong> - The issue has been addressed at about 19:00 08-Feb-2024 UTC. We will monitor the status of the service for a few more hours before resolving.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>17:30</var> UTC</small><br><strong>Identified</strong> - YubiEnterprise Services has identified an issue with international address verification. Users of the /validate-address or the (deprecated) /address-validation APIs will receive a 500 response. Shipment requests to countries other than the United States and Canada will remain in the Awaiting Validation status.<br /><br />The incident started at about 21:30 07-Feb-2024 UTC. The root cause has been identified and we are working to bring the service back into full operation.</p>tag:status.yubico.com,2005:Incident/194362892023-12-21T09:24:48Z2023-12-21T09:24:48ZMaintenance on YubiEnterprise Console<p><small>Dec <var data-var='date'>21</var>, <var data-var='time'>09:24</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance for the YubiEnterprise services is now complete and the system is up and running again. The services should now perform as normal.</p><p><small>Dec <var data-var='date'>21</var>, <var data-var='time'>08:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Dec <var data-var='date'>14</var>, <var data-var='time'>09:20</var> UTC</small><br><strong>Scheduled</strong> - The YubiEnterprise services will be down for maintenance on December 21st, 2023 between 08:00 and 11:00 UTC. During this time the services will be unreachable via console and API.</p>tag:status.yubico.com,2005:Incident/191895612023-12-10T04:00:07Z2023-12-10T04:00:07ZMaintenance on YubiEnterprise service/console<p><small>Dec <var data-var='date'>10</var>, <var data-var='time'>04:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'>10</var>, <var data-var='time'>02:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>19:11</var> UTC</small><br><strong>Scheduled</strong> - The address validation service for YubiEnterprise service/console will be undergoing routine maintenance on December 10, 2023 between 02:00 and 04:00 UTC. During this time, the address validation of the YubiEnterprise service via console and API might be unreachable and shipment requests submission might be affected or might not be accepted.</p>tag:status.yubico.com,2005:Incident/192370842023-11-30T02:29:36Z2023-11-30T02:29:36ZDegraded performance for YubiEnterprise Console<p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>02:29</var> UTC</small><br><strong>Resolved</strong> - The fix addressed the issue correctly, the YubiEnterprise services are back to operating normally.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>02:48</var> UTC</small><br><strong>Monitoring</strong> - An issue was identified and a fix was deployed, we will be monitoring the situation for the next 24 hours.</p><p><small>Nov <var data-var='date'>28</var>, <var data-var='time'>20:46</var> UTC</small><br><strong>Investigating</strong> - The YubiEnterprise Services are currently experiencing degraded performance and we're currently investigating.</p>tag:status.yubico.com,2005:Incident/191801282023-11-28T15:01:04Z2023-11-28T15:01:04ZMaintenance on upload.yubico.com<p><small>Nov <var data-var='date'>28</var>, <var data-var='time'>15:01</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>28</var>, <var data-var='time'>13:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>20</var>, <var data-var='time'>14:25</var> UTC</small><br><strong>Scheduled</strong> - On Tuesday, November 28, 2023 we will perform maintenance on upload.yubico.com.<br /><br />The service will be unavailable between 13:00 and 15:00 UTC.</p>tag:status.yubico.com,2005:Incident/175668622023-06-14T01:03:24Z2023-06-14T01:04:51ZYubiCloud service interruption<p><small>Jun <var data-var='date'>14</var>, <var data-var='time'>01:03</var> UTC</small><br><strong>Resolved</strong> - On Tuesday, June 13, 2023 between 18:49 and 20:45 UTC, YubiCloud experienced a spike in API failures. The failures originated from an AWS us-east-1 region outage and only affected clients connecting to that region. At peak during this time up to 75% of API calls resulted in a 500 response. Functionality returned to normal after this spike and no further service interruptions were observed. No other regions were affected.</p>tag:status.yubico.com,2005:Incident/172206742023-05-31T10:00:03Z2023-05-31T10:00:03ZMaintenance on upload.yubico.com<p><small>May <var data-var='date'>31</var>, <var data-var='time'>10:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>May <var data-var='date'>31</var>, <var data-var='time'>07:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>May <var data-var='date'>11</var>, <var data-var='time'>17:21</var> UTC</small><br><strong>Scheduled</strong> - On Wednesday, May 31st, 2023 we will perform maintenance on upload.yubico.com.<br /><br />The service will be unavailable between 07:00 and 10:00 UTC.</p>tag:status.yubico.com,2005:Incident/172206692023-05-25T10:01:12Z2023-05-25T10:01:13ZMaintenance on upload.yubico.com<p><small>May <var data-var='date'>25</var>, <var data-var='time'>10:01</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>May <var data-var='date'>25</var>, <var data-var='time'>07:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>May <var data-var='date'>11</var>, <var data-var='time'>17:20</var> UTC</small><br><strong>Scheduled</strong> - On Thursday, May 25th, 2023 we will perform maintenance on upload.yubico.com.<br /><br />The service will be unavailable between 07:00 and 10:00 UTC.</p>tag:status.yubico.com,2005:Incident/166804062022-10-20T10:34:00Z2023-05-31T16:15:11ZYubiCloud service interruption<p><small>Oct <var data-var='date'>20</var>, <var data-var='time'>10:34</var> UTC</small><br><strong>Resolved</strong> - On Thursday, October 20, 2022 between 10:34 and 10:43 UTC, YubiCloud experienced a spike in API failures. The failures only affected clients connecting to the US East and EU Central region. At peak during this time, up to 75% of API calls resulted in a 504 response. Functionality returned to normal after this spike and no further service interruptions were observed. No other regions were affected.</p>tag:status.yubico.com,2005:Incident/113332972022-09-28T12:30:00Z2023-05-31T16:15:11ZImportant YubiCloud Notification<p><small>Sep <var data-var='date'>28</var>, <var data-var='time'>12:30</var> UTC</small><br><strong>Resolved</strong> - YubiCloud server certificates are obtained / renewed through AWS Certificate Manager (ACM) and issued by one of Amazon’s limited number of intermediate CAs, which chain to Amazon Trust Services root CA. <br /><br />AWS announced starting October 8 that any public certificates obtained through ACM will be issued from one of its multiple intermediate CAs, which also chain to an existing Amazon Trust Services root CA. <br />Since this root CA is trusted by default by most standard operating systems, most customers should not be impacted by this change. However, if you validate the YubiCloud server through pinned intermediate CA certificates, you will need to make an update to pin an Amazon Trust Services root CA instead. Yubico does not recommend certificate pinning to use YubiCloud. If however, your system requires the usage of pinned or hardcoded certificates, you will need to update that information per the AWS guideline linked below:<br /><br />https://aws.amazon.com/blogs/security/amazon-introduces-dynamic-intermediate-certificate-authorities/</p>tag:status.yubico.com,2005:Incident/113333172022-07-15T01:30:00Z2023-05-31T16:15:11ZYubiCloud service interruption<p><small>Jul <var data-var='date'>15</var>, <var data-var='time'>01:30</var> UTC</small><br><strong>Resolved</strong> - On Wednesday, July 13, 2022 between 20:23 and 20:31 UTC, YubiCloud experienced a spike in API failures. The failures primarily occurred between 20:23-20:26 and 20:28-20:31. The failures only affected clients connecting to the EU Central region. At peak during this time, up to 70% of API calls resulted in a 500 response. The problem occurred due to communication issues between two AWS services that are used in the implementation of YubiCloud. Functionality returned to normal after this spike and no further service interruptions were observed. No other regions were affected.</p>tag:status.yubico.com,2005:Incident/113333352022-03-10T08:00:00Z2023-05-31T16:15:11ZMaintenance on upload.yubico.com<p><small>Mar <var data-var='date'>10</var>, <var data-var='time'>08:00</var> UTC</small><br><strong>Resolved</strong> - On Thursday, March 17th, 2022 we will perform maintenance on upload.yubico.com.<br /><br />The service will be unavailable between 08:00 and 10:00 UTC.</p>tag:status.yubico.com,2005:Incident/113333392022-01-05T19:00:00Z2023-05-31T16:15:11ZMaintenance on upgrade.yubico.com<p><small>Jan <var data-var='date'> 5</var>, <var data-var='time'>19:00</var> UTC</small><br><strong>Resolved</strong> - On Tuesday, January 11th, 2022 we will perform maintenance on upgrade.yubico.com.<br /><br />The service will be unavailable between 08:00 and 10:00 UTC.</p>tag:status.yubico.com,2005:Incident/113333492021-12-16T03:30:00Z2023-05-31T16:15:11ZYubiCloud service restored<p><small>Dec <var data-var='date'>16</var>, <var data-var='time'>03:30</var> UTC</small><br><strong>Resolved</strong> - As of December 15 2021 at 17:00 UTC, YubiCloud service has returned to normal. Due to issues with our Cloud platform provider, requests to our US-West region intermittently failed for about 45 minutes between 15:15 - 16:00 UTC. No other regions were affected.</p>tag:status.yubico.com,2005:Incident/113333552021-12-16T00:00:00Z2023-05-31T16:15:11ZYubiCloud interrupted service<p><small>Dec <var data-var='date'>16</var>, <var data-var='time'>00:00</var> UTC</small><br><strong>Resolved</strong> - Yubico is aware of disruptions to our YubiCloud service. AWS is experiencing a service outage which is impacting YubiCloud. Requests routed to YubiCloud's US-West region are impacted in the form of intermittent failures. We apologize for any inconvenience caused by the disruption to the YubiCloud service and are closely monitoring for AWS recovery. Updates will be provided here as more information becomes available.</p>tag:status.yubico.com,2005:Incident/113333702021-12-15T23:00:00Z2023-05-31T16:15:11ZYubiCloud interrupted service<p><small>Dec <var data-var='date'>15</var>, <var data-var='time'>23:00</var> UTC</small><br><strong>Resolved</strong> - Yubico is aware of disruptions to our YubiCloud service. AWS is experiencing a service outage which is impacting YubiCloud. The majority of the impact is to those requests routed to YubiCloud’s US-East region. We apologize for any inconvenience caused by the disruption to the YubiCloud service and are closely monitoring for AWS recovery. Updates will be provided here as more information becomes available.</p>tag:status.yubico.com,2005:Incident/113333592021-12-08T14:30:00Z2023-05-31T16:15:12ZYubiCloud service restored<p><small>Dec <var data-var='date'> 8</var>, <var data-var='time'>14:30</var> UTC</small><br><strong>Resolved</strong> - As of December 08 2021 at 04:15 UTC, YubiCloud service has returned to normal.</p>tag:status.yubico.com,2005:Incident/113333742021-05-18T22:30:00Z2023-05-31T16:15:12ZMaintenance on upload.yubico.com<p><small>May <var data-var='date'>18</var>, <var data-var='time'>22:30</var> UTC</small><br><strong>Resolved</strong> - On Thursday, May 20th, 2021 we will perform maintenance on upload.yubico.com.<br /><br />The service will be unavailable between 08:00 and 13:00 UTC.</p>tag:status.yubico.com,2005:Incident/113333762021-04-16T06:30:00Z2023-05-31T16:15:12ZOne api.yubico.com; One HTTP GET<p><small>Apr <var data-var='date'>16</var>, <var data-var='time'>06:30</var> UTC</small><br><strong>Resolved</strong> - A year ago, we moved all YubiOTP validation API servers behind one common api.yubico.com endpoint, introducing a modernized, cloud-based, YubiOTP validation service to improve reliability and scalability. As a result, customers no longer need to call multiple endpoints; instead, we recommend implementing Yubico OTP support in applications using an HTTP GET request to api.yubico.com.<br /><br />In order to direct YubiCloud clients to the closest location, domain names pointing to the new service are geolocated to the closest endpoint to the requestor. If you have not done so already, we recommend configuring your clients to point to our servers via the api.yubico.com domain name.<br /><br />Refer to this status post from 2019 to ensure you have updated your configurations: https://status.yubico.com/2019/11/21/2019-11-21-yubicloud-service-upgrade/<br /><br />The Yubico legacy client libraries in PHP, C, .NET, Perl, and Java on Github will be archived; they will not be updated to call the new endpoint. Their main benefit was to abstract the calling of multiple YubiCloud endpoints from client applications. This is no longer necessary and actually makes resulting client applications use the backwards-compatible legacy interface for YubiCloud, which is a sub-optimal solution for our customers.<br />By implementing the one HTTP GET call directly in client applications, customers no longer need to take a dependency on a 3rd party library in their solutions.<br /><br />How to generate and verify signatures and how to construct an HTTP GET call to verify OTPs and what responses you need to handle is outlined in the Yubico OTP Validation Protocol Version 2.0 that can be found on https://developers.yubico.com/OTP/Specifications/OTP_validation_protocol.html <br />For more recent (and older) status.yubico.com updates, please scroll through https://status.yubico.com/</p>tag:status.yubico.com,2005:Incident/113333902020-12-22T09:30:00Z2023-05-31T16:15:12Zapi.yubico.com unscheduled downtime<p><small>Dec <var data-var='date'>22</var>, <var data-var='time'>09:30</var> UTC</small><br><strong>Resolved</strong> - On Wednesday, November 25, 2020, starting at about 15:00 UTC Yubico became aware of an issue servicing api.yubico.com requests which were routed to YubiCloud's US-East data center. At peak, about 2.5% of requests were receiving error responses. By 17:00 UTC, error rates had fallen to < 0.5% with complete resolution by 19:00 UTC. Only requests sent to the US-East data center were affected; all other data centers were operating normally. A retry of a failed request should have been successful.<br /><br />The underlying cause was a prolonged outage of services in AWS's US-East1 region. AWS is YubiCloud's Cloud Platform provider. More information on the AWS outage can be found here. <br /><br />We apologize for any inconvenience the disruption of YubiCloud's service may have caused. Steps are being taken to mitigate the effects of such outages upon our customers in the future.</p>tag:status.yubico.com,2005:Incident/113333952020-03-20T08:30:00Z2023-05-31T16:15:12ZPostponement of decommissioning<p><small>Mar <var data-var='date'>20</var>, <var data-var='time'>08:30</var> UTC</small><br><strong>Resolved</strong> - Yubico has introduced a new global endpoint supporting our YubiOTP service based on the AWS platform. Most of our customers have already migrated to the new service. As a result of having some customers still using the legacy endpoints, we have decided to move the decommissioning date of the old service from March 23 to April 14, 2020.<br /><br />For more details of the change, see https://status.yubico.com/2020/02/25/decommissioning-old-yubiotp-api-validation-servers/.</p>tag:status.yubico.com,2005:Incident/113333982020-02-25T16:30:00Z2023-05-31T16:15:12ZDecommissioning old YubiOTP API validation servers<p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>16:30</var> UTC</small><br><strong>Resolved</strong> - On March 23, 2020 Yubico will be decommissioning the old YubiOTP API validation servers. This is the final step of an ongoing initiative to improve reliability and scalability of the YubiOTP validation service. If you are hardcoding the IP address of any of the API servers, then you will see responses indicating that they have been decommissioned.<br /><br />These responses will look like:<br /><br />status=DECOMMISSIONED<br />message=See https://status.yubico.com/<br /><br />To ensure that you are not adversely impacted, please follow the instructions at https://status.yubico.com/2019/11/21/2019-11-21-yubicloud-service-upgrade/.</p>tag:status.yubico.com,2005:Incident/113334072020-01-29T09:30:00Z2023-05-31T16:15:12Z[2020-02-03] api.yubico.com service upgrade<p><small>Jan <var data-var='date'>29</var>, <var data-var='time'>09:30</var> UTC</small><br><strong>Resolved</strong> - On February 3, 2020 at 23:00 UTC, we will be moving the api.yubico.com domain name to point to the modernized, cloud-based YubiOTP validation service.<br /><br />This is the final domain name to be changed as part of the ongoing YubiCloud upgrades.<br /><br />To ensure that you are not disrupted by this change, we recommend taking the actions listed in our previous update.</p>tag:status.yubico.com,2005:Incident/113334152019-11-21T11:00:00Z2023-05-31T16:15:12Z[2019-11-21] YubiCloud service upgrade<p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>11:00</var> UTC</small><br><strong>Resolved</strong> - On 12th November 2019, one of the YubiOTP validation API servers, api5.yubico.com, was replaced by a modernized, cloud-based YubiOTP validation service to improve reliability and scalability of the existing service. We will gradually be moving all existing domain names (api.yubico.com, api2.yubico.com, api3.yubico.com, and api4yubico.com) to point to the new service. The current (v2) YubiOTP API contract has not changed as part of this gradual upgrade.<br /><br />In order to direct YubiCloud clients to the closest location, domain names pointing to the new service are geolocated to the closest endpoint to the requestor. If you have not done so already we recommend configuring your clients to point to our servers via a domain name.<br /><br />To ensure that you are not disrupted by this and further planned upgrades we recommend the following actions:<br /><br />If you have hardcoded the CA or certificate fingerprint that you use to validate the YubiOTP API servers’ identities you will need to update the hardcoded information.<br /><br />If you have hardcoded the IP address you will need to use DNS instead. We will no longer allocate static IP addresses and will not be able to provide a list of stable addresses.<br /><br />SNI is required as part of TLS negotiation due to the edge routing layer of our new infrastructure. For example, if you are using nginx as a forward proxy to connect to the YubiOTP validation API you may need to enable the proxy_ssl_server_name option.<br /><br />The third-party open-source Python client library yubico-client (PyPI, GitHub) must be upgraded to version 1.12.0 or newer. Previous versions had an issue where a TLS failure on one request could be interpreted as a verification failure for the OTP itself.</p>