CloudStatus

RackSpace Status Alerts

Rackspace
Maintenance: Cloud Networks | DFW | April 24 - April 25, 2017

The Rackspace Open Cloud system engineers will perform a priority maintenance to the control infrastructure of our Cloud Networks DFW region during the following dates and times: CHG0073503/CHG0073483 - DFW - April 24, 2017 from 10:00 PM to April 25, 2017 2:00 AM CDT During these times, customers accessing management level services (public APIs for these regions) may experience errors for a period of up to 30 minutes. This includes requests for networking changes through the Cloud Servers account via Reach (mycloud.rackspace.com). This maintenance will NOT pose any impact to existing Cloud Networks under your account which are located in this region. However, certain operations being performed during this period may be interrupted (such as server builds, resizes, or snapshots). Customers are urged to perform these operations before or after this maintenance event. If you have any questions or concerns in regards to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407 and INTL +1.210.581.0407.

Rackspace
Incident: Cloud Load Balancers (Resolved: LBASS | Admin API Unavailable | LON Region)

Resolved: Hello, On 21 April 2017, between 10:20 UTC and 12:02 UTC , engineers became aware of an issue affecting the admin api in the LON region for Cloud Loadbalancers and are working to resolve the issue. During this time, customers attempting to make updates in the LON region using the admin api may receive error messages. Regards, Rackspace

Rackspace
Incident: Cloud Load Balancers (Cloud Load Balancers | Inaccurate Node State in the API and Cloud Control Panel | DFW Region)

Unresolved: 04/21/17 On 6 March 2017, the Cloud Load Balancer team was made aware that a portion of customers are experiencing inaccurate node state being reflected in the API and the Cloud Control Panel for the DFW region. Some customers have reported that the status returned by the API for a given node in a load balancer instance is inconsistent with the running state of the node and traffic flow. This issue affects the CLB API and control panel node statuses only â�‚��€œ it has not been observed to impact client traffic flow to nodes. Customers can recreate monitoring health checks on impacted nodes to restore the impacted status views in the API and control panel. At this time, Cloud Load Balancer engineers continue to investigate the issue. If you have any questions or need assistance, please contact a member of your support team.

Rackspace
Incident: Cloud Load Balancers (LBASS | Admin API Unavailable | LON Region)

Unresolved: On 21 April 2017, between 10:20 and 12:05 UTC , engineers worked to resolve an issue affecting the admin api in the LON region for Cloud Loadbalancers. During this time, customers attempting to make updates in the LON region using the admin api may receive error messages.

Rackspace
Incident: Cloud Load Balancers (LBASS | Admin API Unavailable | LON Region)

Unresolved: On 21 April 2017, between 10:20 and 12:02 UTC , engineers worked to resolve an issue affecting the admin api in the LON region for Cloud Loadbalancers. During this time, customers attempting to make updates in the LON region using the admin api may receive error messages.

Rackspace
Incident: Cloud Load Balancers (Cloud Load Balancers | Inaccurate Node State in the API and Cloud Control Panel | DFW Region)

Resolved: On 21 April 2017, between 10:20 and 12:05 UTC , engineers worked to resolve an issue affecting the admin api in the LON region for Cloud Loadbalancers. During this time, customers attempting to make updates in the LON region using the admin api may receive error messages.

Rackspace
Incident: Cloud Load Balancers (LBASS | Admin API Unavailable | LON Region)

Unresolved: On 21 April 2017, at approximately 10:20 UTC , engineers became aware of an issue affecting the admin api in the LON region for Cloud Loadbalancers and are working to resolve the issue. During this time, customers attempting to make updates in the LON region using the admin api may receive error messages.

Rackspace
Incident: Control Panels (Resolved: MyRackspace and Encore | Managed Virtualization Section Unavailable | All Regions)

Resolved: On 20 April 2017, from 10:45 to 12:41 CDT, engineers identified impact to the Managed Virtualization sections of the MyRackspace Portal and Encore in all regions and worked to resolve the issue as quickly as possible. During this time, Customers may have experienced issues when attempting to access the Managed Virtualization section of the MyRackspace Portal. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Control Panels (MyRackspace and Encore | Managed Virtualization Section Unavailable | All Regions)

Unresolved: On 20 April 2017, starting at 10:45 CDT, engineers identified issues impacting the Managed Virtualization sections of the MyRackspace Portal and Encore in all regions. Engineers are engaged and actively working to resolve the issue. During this time, Customers may experience issues when attempting to access the Managed Virtualization section of the MyRackspace Portal.

Rackspace
Incident: Cloud Servers (Cloud Servers | ServiceNet Disruption | DFW Region)

Resolved: On 20 April 2017, starting at 05:00 CDT, engineers identified ServiceNet issues during a scheduled non-impacting maintenance. Engineers determined that an internal error caused a ServiceNet outage for a subset of customers in the DFW Region. Engineers resolved customer impact at 05:10 CDT. During this time, customers and may have experienced connectivity issues between their Cloud Servers, RackConnect v2, and other cloud products.

Rackspace
Incident: RackConnect (RackConnect v3 | RackConnect v3 Unavailable | DFW Region)

Resolved: On 20 April 2017, starting at 05:30 CDT, engineers identified that a scheduled maintenance is currently impacting RackConnect v3 in the DFW Region. As of 06:53 CDT, engineers confimed that the affected RackConnect v3 instances were back online and the any remaining issues were resolved. During this time, RackConnect v3 environments may have been unavailable for a subset of customers in the DFW Region.

Rackspace
Incident: RackConnect (RackConnect v3 | RackConnect v3 Unavailable | DFW Region)

Unresolved: On 20 April 2017, starting at 05:30 CDT, engineers began work to resolve issues impacting RackConnect v3 in the DFW Region. During this time, RackConnect v3 environments may be unavailable for a subset of customers in the DFW Region.

Rackspace
Incident: Cloud Servers (Cloud Servers | ServiceNet Disruption | DFW Region)

Unresolved: On 20 April 2017, starting at 05:00 CDT, engineers identified ServiceNet issues during a scheduled non-impacting maintenance. Engineers determined that an internal error caused a ServiceNet outage for a subset of customers in the DFW Region. Engineers resolved customer impact at 05:10 CDT. During this time, customers and may have experienced connectivity issues between their Cloud Servers, RackConnect v2, and other cloud products.

Rackspace
Incident: Control Panels (Resolved: DCX Services | Database Server became Unresponsive | All Regions )

Resolved: On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. As of 09:37 CDT, engineers reported the issues were resolved. During this time, customers were unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers were unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers were unable to view their customer service IP address for dedicated gear.

Rackspace
Incident: Control Panels (Resolved: DCX Services | Database Server became Unresponsive | All Regions )

Resolved: On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. As of 09:37 CDT, engineers reported the issues were resolved. During this time, customers were unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers were unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers were unable to view their customer service IP address for dedicated gear.

Rackspace
Incident: Control Panels (Resolved: DCX Services | Database Server became Unresponsive | All Regions )

Unresolved: On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. As of 09:37 CDT, engineers reported the issues were resolved. During this time, customers were unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers were unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers were unable to view their customer service IP address for dedicated gear.

Rackspace
Incident: RackConnect (Resolved: DCX Services | Database Server became Unresponsive | All Regions )

Resolved: On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. As of 09:37 CDT, engineers reported the issues were resolved. During this time, customers were unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers were unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers were unable to view their customer service IP address for dedicated gear.

Rackspace
Incident: Cloud DNS (Resolved: DCX Services | Database Server became Unresponsive | All Regions )

Resolved: On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. As of 09:37 CDT, engineers reported the issues were resolved. During this time, customers were unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers were unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers were unable to view their customer service IP address for dedicated gear.

Rackspace
Incident: Control Panels (DCX Services | Database Server became Unresponsive | All Regions )

Unresolved: On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. During this time, customers will be unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers are unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers will not be able to view their customer service IP address for dedicated gear. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud DNS (DCX Services | Database Server became Unresponsive | All Regions )

Unresolved: On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. During this time, customers will be unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers are unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers will not be able to view their customer service IP address for dedicated gear. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: RackConnect (DCX Services | Database Server became Unresponsive | All Regions )

Unresolved: On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. During this time, customers will be unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers are unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers will not be able to view their customer service IP address for dedicated gear. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Control Panels (DCX Services | Database Server became Unresponsive | All Regions )

Unresolved: On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. During this time, customers will be unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers are unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers will not be able to view their customer service IP address for dedicated gear. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
General Notice: Resolved: DCX Services | Database Server became Unresponsive | All Regions

On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. As of 09:37 CDT, engineers reported the issues were resolved. During this time, customers were unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers were unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers were unable to view their customer service IP address for dedicated gear.

Rackspace
General Notice: DCX Services | Database Server became Unresponsive | All Regions

On 17 April 2017, at approximately 08:57 CDT, engineers identified that a database server became unresponsive in the IAD2 data center. The database server impacted MyRackspace Portal and Cloud Control Panel sections for DNS and for customer service IP address. During this time, customers will be unable to make DNS updates through MyRackspace portal or the Cloud Control Panel. During this time, Rack Connect customers are unable to make changes or delete public IPs for their Cloud Servers and Cloud Accounts. Additionally, customers will not be able to view their customer service IP address for dedicated gear. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Maintenance: Cloud Servers | DFW | April 17 - April 20, 2017

The Rackspace Open Cloud system engineers will perform a priority maintenance to the control infrastructure of our Next Generation Cloud Servers DFW region during the following dates and times: CHG0073125 - DFW - April 17, 2017 from 10:00 PM to April 18, 2017 5:00 AM CDT CHG0073282 - DFW - April 19, 2017 from 10:00 PM to April 20, 2017 6:00 AM CDT During these times, customers accessing management level services (public APIs for these regions) may experience errors for a period of up to 30 minutes. This includes requests sent from the MyCloud Control Panel as well as those sent to the Next Gen Cloud Servers API directly (First Gen Cloud Servers management will not be affected). This maintenance will NOT pose any impact to existing Next Gen Cloud Servers under your account which are located in this region. However, certain operations being performed during this period may be interrupted (such as server builds, resizes, or snapshots). Customers are urged to perform these operations before or after this maintenance event. If you have any questions or concerns in regards to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407 and INTL +1.210.581.0407.

Rackspace
Incident: Cloud Databases (CDB Ops | API Unavailable During Maintenance | DFW2)

Resolved: On 14 April 2017, from 00:00 to 04:00 CDT, engineers worked through a planned maintenance on Cloud Databases in the DFW2 data center. During the time of the maintenance, the Cloud Databases API was unavailable to make any changes to hosted databases. The maintenance has now concluded and API access has been restored. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Databases (CDB Ops | API Unavailable During Maintenance | DFW2)

Unresolved: On 14 April 2017, between 00:00 and 04:00 CDT, engineers are working to complete a planned maintenance in the DFW region. During this time, the Cloud Database API may be unavailable to make changes to your hosted databases. If you have any further questions, please reach out to a member of your support team.

Rackspace
Maintenance: Cloud Orchestration | All Regions | April 24, 2017 - April 26, 2017

The Rackspace Cloud Orchestrations engineers will be performing a scheduled maintenance on their infrastructure in the following regions: CHG0072983 - SYD - April 24, 2017 10:00 AM to 12:00 PM CDT (1:00 AM to 3:00 AM AEST) CHG0072978 - HKG - April 24, 2017 2:00 PM to 4:00 PM CDT (3:00 AM to 5:00 AM HKT) CHG0072984 - LON - April 25, 2017 4:00 PM to 6:00 PM CDT (10:00 PM April 25 to 12:00 AM April 26 BST) CHG0072986 - DFW - April 25, 2017 10:00 PM to 11:59 PM CDT CHG0072987 - ORD - April 26, 2017 12:00 AM to 2:00 AM CDT CHG0072989 - IAD - April 26, 2017 2:01 AM to 4:00 AM EDT During this maintenance, customers will not be able to create, update, or delete stacks via the Orchestration section of the Cloud Control Panel or the Orchestration API for a period of up to 2 hours in the affected regions. Existing stacks will not be affected. If you have any questions or concerns in regards to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407 and INTL +1.210.581.0407.

Rackspace
Incident: Cloud Databases (Cloud Databases | API Unavailable | DFW Region)

Resolved: On 11 April 2017, from 20:20 CDT to 23:30 CDT, engineers worked to resolve issues which affected the Cloud Databases API in the DFW region. During this time, customers in the affected region may have been unable to perform actions such as creating, resizing, or deleting databases, however, existing instances remain online. Functionality has returned to the Cloud Database API; however, a scheduled disruptive maintenance will begin at 00:01 CDT to 06:00 CDT on 12 April 2017.

Rackspace
Incident: Cloud Databases (Cloud Databases | API Unavailable | DFW Region)

Unresolved: On 11 April 2017, at approximately 20:20 CDT, our engineers began working to resolve of issue affecting the Cloud Databases API in the DFW region and are working to resolve the problem. During this time, customers in the affected region may be unable to make changes to their existing database instances, however, instances remain online. Currently, the maintenance scheduled for 12 April, at 00:01 CDT, will go forward as planned. This notification will be updated as further information becomes available.

Rackspace
Maintenance: Cloud Databases | DFW | Starting April 12, 2017 - April 14, 2017

Rackspace Network Services will be performing a disruptive maintenance in our DFW data centers to relocate Cloud Database network infrastructure. Please review the following times associated with the maintenance events: CHG0072679 - DFW2 - Wednesday, April 12, 2017, between 12:01 AM CDT and 6:00 AM CDT CHG0072684 - DFW3 - Thursday, April 13, 2017, between 12:01 AM CDT and 6:00 AM CDT CHG0072685 - DFW3 - Friday, April 14, 2017, between 12:01 AM CDT and 4:00 AM CDT This maintenance will not affect the customer's database, however, it does have the potential of affecting management level services . This could include direct calls to our API (running backups, creating/resizing/deleting instances) or access to the database details through the MyCloud Portal. These systems being migrated are highly available and we expect minimal impact across all three network migrations. If you have any questions or concerns in regards to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407 and INTL +1.210.581.0407.

Rackspace
Incident: Cloud Load Balancers (Cloud Load Balancers | Inaccurate Node State in the API and Cloud Control Panel | DFW Region)

Unresolved: On 6 March 2017, the Cloud Load Balancer team was made aware that a portion of customers are experiencing inaccurate node state being reflected in the API and the Cloud Control Panel for the DFW region. Some customers have reported that the status returned by the API for a given node in a load balancer instance is inconsistent with the running state of the node and traffic flow. This issue affects the CLB API and control panel node statuses only – it has not been observed to impact client traffic flow to nodes. Customers can recreate monitoring health checks on impacted nodes to restore the impacted status views in the API and control panel. At this time, Cloud Load Balancer engineers continue to investigate the issue. If you have any questions or need assistance, please contact a member of your support team.

Rackspace
Incident: Control Panels (Global Billing | Payment and Sign-up Failures | ORD1)

Resolved: On 29 March 2017, between 07:20 and 10:00 CDT, engineers identified an issue impacting Payment Services and Sign-up Services in the all regions. The team engaged the vendor, who reported a widespread issue across all of their data centers. At 12:19 CDT, the vendor confirmed they fixed the issue and impact was resolved at 10:00 CDT. During this time customers may have experienced failures when making payments or delays when attempting to initiate new services.

Rackspace
Incident: Control Panels (Global Billing | Payment and Sign-up Failures | ORD1)

Resolved: On 29 March 2017, at 07:20 CDT, Engineers identified an issue impacting Payment Service System in the ORD1 region. The team has engaged the vendor, who has reported a widespread issue across all of their data centers. During this time customers may experience failures when making payments or delays when attempting to initiate new services.

Rackspace
General Notice: Recent Patch for Ubuntu and Red Hat Issue | All Regions

Beginning on 21 March 2017, engineers noted an increase in customer contacts in response to recent patch updates released for Ubuntu 12.04, 14.04, 16.04, as well as Red Hat 6 and 7, which have caused some customer applications to break once the update is installed. To address these issues, restart any web service applications that use the affected library. To ensure that all existing processes get the new version, a full server reboot is recommended. Ubuntu has issued multiple updates for this issue via https://www.ubuntu.com/usn/usn-3239-1/ and https://www.ubuntu.com/usn/usn-3239-2/. Customers that restarted services to compensate for the USN-3239-1 update may need restart services once again to compensate for the USN-3239-2 update. Red Hat has communicated this issue through https://access.redhat.com/security/vulnerabilities/2168451. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Databases (Cloud Databases | Cloud Database instances in Read Only | IAD Region)

Resolved: On 21 March 2017, between 02:18 and 08:10 CDT, Rackspace engineers worked to resolve an issue impacting a subset of Cloud Database instances that were in 'read-only' status in the IAD Region. During this time, a subset of customers in the IAD Region may find their Cloud Database instances in read-only status.

Rackspace
Incident: Cloud Servers (Cloud Servers | API Degraded Performance | ORD1)

Resolved: On 21 March 2017, between 03:26 and 07:35 CDT, engineers worked to resolve an issue impacting the Cloud Server API in ORD1 for a subset of Cloud Servers customers. During this time, customers may have experienced issues when attempting to perform actions, such as rebooting and resizing, on their servers.

Rackspace
Incident: Cloud Servers (Cloud Servers | API Degraded Performance | ORD1)

Unresolved: On 21 March 2017, at 03:26 CDT, engineers identified an issue impacting the Cloud Server API in ORD1 for a subset of Cloud Servers customers. During this time, customers may experience issues when attempting to perform actions, such as rebooting and resizing, on their servers.

Rackspace
Incident: Cloud Databases (Cloud Databases | Cloud Database instances in Read Only | IAD Region)

Unresolved: Rackspace engineers identified a subset of Cloud Database instances currently in 'read-only' status in the IAD Region, starting at 02:18 CDT on 21 March 2017. During this time, a subset of customers in the IAD Region may find their Cloud Database instances in read-only status.

Rackspace
Incident: Control Panels (My Rackspace Portal | Unavailable | All Regions)

Resolved: On 15 March 2017, from 15:10 to 15:35 CDT, Rackspace engineers identified an issue affecting access to the MyRack Portal in all regions and worked to resolve the problem as quickly as possible. During this time, customers may experienced issues with logging in to the MyRackspace Portal.

Rackspace
Incident: Control Panels (My Rackspace Portal | Unavailable | All Regions)

Unresolved: On 15 March 2017, at 15:10 CDT, Our engineers are aware of an issue affecting MyRackspace Portal in all regions and are working to resolve the problem as quickly as possible. During this time, customers may experience issues with logging in to MyRackspace Portal.

Rackspace
Incident: Cloud Load Balancers (Cloud Load Balancers | Inaccurate Node State in the API and Reach Control Panel | DFW Region)

Unresolved: On 6 March 2017, the Cloud Load Balancer team was made aware that a portion of customers are experiencing inaccurate node state being reflected in the API and the Reach Control Panel for the DFW region. Some customers have reported that the status returned by the API for a given node in a load balancer instance is inconsistent with the running state of the node and traffic flow. At this time, Cloud Load Balancer engineers are actively working to investigate and resolve the issue. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Resolved: Cloud Servers | API Unavailable | IAD Region)

Resolved: On 14 March 2017, approximately 12:30 to 13:40 CDT, the Cloud Servers API in the IAD region was unavailable. During this time, customers may have experienced errors when attempting to access the Cloud Server API in the IAD region. If you have any further questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Resolved: Cloud Servers | API Unavailable | IAD Region)

Resolved: On 14 March 2017, approximately 12:30 to 13:40 CDT, the Cloud Servers API in the IAD region was unavailable. During this time, customers may have experienced errors when attempting to access the Cloud Server API in the IAD region. If you have any further questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Cloud Servers | API Unavailable | IAD Region)

Unresolved: On 14 March 2017, at approximately 12:30 CDT, the Cloud Servers API in the IAD region became unavailable. At this time, engineers are actively working to resolve the issue. During this time, customers may experience errors when attempting to access the Cloud Server API in the IAD region. If you have any further questions or concerns, please contact a member of your support team.

Rackspace
General Notice: Cloud Orchestrations | Cloud Orchestration API Unavailable | HKG Region

On 14 March 2017, starting at 07:30 UTC , engineers began work to resolve issues affecting the Cloud Orchestration API in the HKG Region. During this time, the Cloud Orchestration API is unavailable in the HKG Region.

Rackspace
Incident: Cloud Identity (Resolved: Cloud Identity | API 500 Errors | All Regions )

Resolved: On 8 March 2017, from 15:46 CST to 17:07 CST, engineers worked to resolve an issue affecting Cloud Identity. During this time, customers may have experienced issues accessing Cloud products and the Cloud Control Panel.

Rackspace
Incident: Cloud Identity (Cloud Identity | API 500 Errors | All Regions )

Unresolved: Our engineers are aware of an issue affecting Cloud Identity and are working to resolve the problem. At this time engineers are seeing high error rates from Cloud Identity, which is affecting access to multiple Cloud products as well as the Cloud Control Panel. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Databases (Cloud Databases | Cloud Databases in Shutdown State | LON Region)

Resolved: On 7 March 2017, between 10:35 and 14:25 UTC , engineers worked to resolve an issue affecting Cloud Databases in the LON Region. During this time, a subset of Cloud Database instances in the LON Region may have been in a "shutdown" status. Engineers identified a software bug on the affected host, and manually rebooted the instances one by one to resolve the issue.

Rackspace
Incident: Cloud Databases (Cloud Databases | Cloud Databases in Shutdown State | LON Region)

Unresolved: On 7 March 2017, starting at approximately 10:35 UTC , Cloud Database engineers began work to resolve issues affecting Cloud Databases in the LON Region. During this time, a subset of Cloud Database instances in the LON Region may be in a "shutdown" state.

Rackspace
Incident: Cloud Files (Resolved: Cloud Files | Intermittent 401 Unauthorized Error | LON)

Resolved: On 03 March 2017, at 03:30 CST/9:30 UTC , engineers became aware of an incident intermittently affecting the Cloud Control Panel resurfacing at 06:22 CST/12:22 UTC . The Cloud Files team removed the affected proxy servers out of rotation at 09:58 CST/15:58 UTC , verifying resolution for customers at 10:20 CST/ 16:20 UTC . During this time, a portion of Cloud customers may experience intermittent 401 errors or delays when attempting to access Cloud Files in the Cloud Control Panel. Additionally, customers may have experienced intermittent errors or delays when attempting to upload content to Cloud Files in the LON region.

Rackspace
Incident: Cloud Servers (Cloud Servers | API 500 Errors | LON Region)

Resolved: From 2 March 2017 22:00 UTC to 3 March 2017 16:37 UTC , engineers worked to resolve an issue impacting Cloud Servers in the LON region. During this time, customers attempting to make any changes to their Cloud Servers via the API may have experienced intermittent 500 error messages.

Rackspace
Incident: Cloud Files (Cloud Files | Intermittent 401 Unauthorized Error | LON)

Unresolved: On 03 March 2017, at 03:30 CST, engineers became aware of an incident intermittently affecting the Cloud Control Panel. The issue has resurfaced at 06:22 CST. The Cloud Files team has removed the affected proxy servers out of rotation resulting in improved performance for customers. During this time, a portion of Cloud customers may experience intermittent 401 errors or delays when attempting to access Cloud Files in the Cloud Control Panel. Additionally, customers may experience intermittent errors or delays when attempting to upload content to Cloud Files in the LON region.

Rackspace
Incident: Cloud Servers (Cloud Servers | API 500 Errors | LON Region)

Unresolved: On 2 March 2017, at approximately 22:00 UTC , engineers became aware of an issue affecting the Cloud Servers API in the LON Region and are working to resolve the problem. During this time, customers attempting to make any changes to their cloud server via the API may experience intermittent 500 error messages.

Rackspace
Incident: Cloud Files (Cloud Files | Intermittent 401 Unauthorized Error | LON)

Unresolved: On 03 March 2017, at 03:30 CDT, engineers became aware of an incident intermittently affecting the Cloud Control Panel. The issue resurfaced at 06:22 CDT. Engineers are engaged and working to resolve the issue. During this time, a portion of Cloud customers may experience intermittent 401 errors or delays when attempting to access Cloud Files in the Cloud Control Panel. Additionally, customers may experience intermittent errors or delays when attempting to upload content to Cloud Files in the LON region. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Rackspace CDN (Rackspace CDN | Intermittent 500 and 404 Errors )

Resolved: On 27 February 2017, from 08:30 CST to 15:41 CST, engineers worked to resolve issues which affected Rackspace CDN in Western Europe. Vendor Akamai confirmed customer impact was resolved at 15:41 CST and are working to identify root cause. During time of impact, customers may have experienced 500 or 404 errors when attempting to access Rackspace CDN.

Rackspace
Incident: Rackspace CDN (Rackspace CDN | Intermittent 500 and 404 Errors )

Unresolved: On 27 February 2017, at approximately 08:30 CST, customers located in Western Europe region may experience 500 or 404 errors when attempting to access Rackspace CDN. At 09:21 CST, the vendor identified and removed nodes from Rackspace's CDN map to resolve the 500 errors. At this time, the vendor is actively investigating the 404 errors. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Rackspace CDN (Rackspace CDN | Intermittent 500 and 404 Errors )

Unresolved: On 27 February 2017, at approximately 08:30 CST, customers located in Western Europe region may experience 500 or 404 errors when attempting to access Rackspace CDN. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Control Panels (MyRackspace Portal | Intermittent Errors when Accessing Support Tickets | All Regions)

Resolved: On 27 February 2017, between 11:00 UTC /005:00 CST and 13:55 UTC /07:55 CST, engineers worked to resolve an issue affecting the MyRackspace Portal. During time of impact, customers may have experienced intermittent errors when trying to access support tickets.

Rackspace
Incident: Control Panels (MyRackspace Portal | Intermittent Errors when Accessing Support Tickets | All Regions)

Unresolved: On 27 February 2017, starting at 11:00 UTC /05:00 CST, engineers began work to resolve issues currently affecting the MyRackspace Portal. During this time, customers may experience intermittent errors when attempting to access support tickets through the MyRackspace Portal.

Rackspace
Maintenance: Next Gen Cloud Servers | DFW2 | Starting Tuesday, February 28 at 10:00 PM CST

The Rackspace Open Cloud system engineers will perform a priority maintenance to the control infrastructure of our Next Generation Cloud Servers regions during the following date and time: CHG0071751 - DFW Region - February 28, 2017 from 10:00 PM to March 1, 2017 1:00 AM CST During these times, customers accessing management level services (public APIs for these regions) may experience errors for a period of up to 30 minutes. This includes requests sent from the MyCloud Control Panel as well as those sent to the Next Gen Cloud Servers API directly (First Gen Cloud Servers management will not be affected). This maintenance will NOT pose any impact to existing Next Gen Cloud Servers under your account which are located in this region. However, certain operations being performed during this period may be interrupted (such as server builds, resizes, or snapshots). Customers are urged to perform these operations before or after this maintenance event. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Cloud Backup (Cloud Backup | Intermittent Errors within Control Panel | LON)

Resolved: On 13 February 2017, between 07:45 and 08:35 CST, customers may have experienced intermittent 502 errors when attempting to access the Cloud Backup section of the Cloud Control Panel for the LON region. Engineers restarted the web heads to resolve the issue. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Backup | Intermittent Errors within Control Panel | LON)

Unresolved: On 13 February 2017, at approximately 07:45 CST, customers began reporting intermittent 502 errors when attempting to access the Cloud Backup section of the Cloud Control Panel for the LON region. At this time, engineers are actively working to resolve the issue. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Backup | Intermittent Errors within Control Panel | LON)

Unresolved: On 13 February 2017, at approximately 07:45 CST, customers began reporting intermittent errors when attempting to access the Cloud Backup section of the Cloud Control Panel for the LON region. At this time, engineers are actively working to resolve the issue. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Control Panels (MyRackspace Customer Portal | Transactions Page Unavailable | All Regions)

Resolved: On 8 February 2017, at approximately 00:45 CST, MyRackspace Portal engineers reported that the 'Transactions' section of the Portal was disabled due to issues displaying customer transaction details. Portal engineers determined a misconfiguration on the database that caused errors in the MyRackspace Portal's Transactions page. Full service was restored at 04:55 CST. During time of impact, customers may have seen see the 'System Unavailable' message when they navigated to the Transactions page of the Portal.

Rackspace
Incident: Control Panels (MyRackspace Customer Portal | Transactions Page Unavailable | All Regions)

Unresolved: As of 8 February 2017, at approximately 00:45 CST, Rackspace engineers report that the 'Transactions' section of the MyRackspace Portal is currently disabled. Engineers are working to restore service. During this time, customers may see the System Unavailable message when they navigate to the Transactions page of the Portal.

Rackspace
Maintenance: Cloud Block Storage | DFW | Starting Friday, February 10, 2017

Rackspace Cloud Block Storage Engineers will perform a planned maintenance on the Cloud Block Storage environment in DFW. CHG0071076 - Friday, February 10, 2017 10:00pm CST - February 11, 2017 4:00am CST During the above maintenance, Cloud Block Storage customers will not have access to management level services (create, attach, detach, snapshot, clone, or query specific details about the volume) during the maintenance. Any volumes that are already attached to a Cloud Server will remain in an attached state and can be mounted or unmounted as customers see fit. CHG0071128 - Saturday, February 11, 2017 10:00pm CST - February 12, 2017 4:00am CST During this maintenance, Cloud Block Storage volumes will become inaccessible. Those customers who have been identified as being impacted by this maintenance have been contacted and have been provided guidance on actions to take in order to avoid impact. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Maintenance: Next Gen Cloud Servers | DFW2 | Starting Tuesday, February 7 at 10:00 PM CST

The Rackspace Open Cloud system engineers will perform a priority maintenance to the control infrastructure of our Next Generation Cloud Servers regions during the following date and time: CHG0071094 – DFW Region - February 7, 2017 from 10:00 PM - 11:00 PM CST During these times, customers accessing management level services (public APIs for these regions) may experience errors for a period of up to 30 minutes. This includes requests sent from the MyCloud Control Panel as well as those sent to the Next Gen Cloud Servers API directly (First Gen Cloud Servers management will not be affected). This maintenance will NOT pose any impact to existing Next Gen Cloud Servers under your account which are located in this region. However, certain operations being performed during this period may be interrupted (such as server builds, resizes, or snapshots). Customers are urged to perform these operations before or after this maintenance event. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Control Panels (Cloud Control Panel | Global Database Unavailable | IAD)

Resolved: On 28 January 2017, at 22:06 CST, engineers became an issue affecting the Cloud Control Panel. Engineers rebooted the affected server, resolving the issue at 23:10 CST. During the time of impact, API calls made within the Cloud Control Panel may have failed and or errored out. Cloud Orchestration was also unable to create new stacks, or search current stacks for data. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Control Panels (Cloud Control Panel | Global Database Unavailable | IAD)

Unresolved: On 28 January 2017, at 22:06 CST, engineers became an issue affecting the Cloud Control Panel. Engineers are engaged and working to resolve the issue. During this time, API calls made within the Cloud Control Panel may fail and or error out. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Databases (Resolved: Cloud Datastores | Database Host Reboot | ORD Region)

Resolved: Engineers have completed the reboot of the affected host, and all database instances have been brought back online.

Rackspace
Incident: Cloud Backup (Resolved: Cloud Backup | api.drivesrvr.com Returing 500 Errors | All Regions)

Resolved: Engineers have determined that the observed errors were due to a faulty API health check. There was no customer impact.

Rackspace
Incident: Cloud Backup (Cloud Backup | API.DriveServer.com Returing 500 Errors | All Regions)

Unresolved: On 26 January 2017, at 08:00 CST, Rackspace engineers began receiving reports that api.driveserver.com was returning 500 errors. At this time, customers attempting to make changed to Cloud Backup configurations may encounter errors.

Rackspace
Incident: Cloud Databases (Cloud Datastores | Database Host Reboot | ORD Region)

Unresolved: On 26 January 2017, starting at 04:19 CST, Database Engineering team identified the need to initiate an emergency host reboot for a subset of Cloud Database instances in the ORD Region. We anticipate up to a 10-15 minute interruption to your services. After rebooting, our Engineering team will ensure your instance is available and will troubleshoot further if any issue persists. For further assistance, please contact your support team.

Rackspace
Incident: Cloud Servers (Cloud Servers | Cloud Server Public API Outage | DFW Region)

Resolved: On 26 January 2017, from 02:20 CST to 02:42 CST, Cloud Engineers worked to resolve issues which affected the Cloud Server Public API in the DFW Region. Engineers reported customer and Racker impact resolved at 02:42 CST. During time of impact, the Cloud Server Public API in the DFW Region may have been unavailable or returned '5XX Errors', preventing customers from performing server actions.

Rackspace
Incident: Cloud Servers (Cloud Servers | Cloud Server Public API Outage | DFW Region)

Unresolved: On 26 January 2017, from 02:20 CST to 02:42 CST, Cloud Engineers worked to resolve issues which affected the Cloud Server Public API in the DFW Region. Engineers reported customer and Racker impact resolved at 02:42 CST. During time of impact, the Cloud Server Public API in the DFW Region may have been unavailable or returned '5XX Errors', preventing customers from performing server actions.

Rackspace
Incident: Cloud Servers ( Resolved: Cloud Servers | Servers Inaccessible | DFW)

Resolved: On 25 January 2017, from 10:38 CST to 14:36 CST, Cloud Servers engineers worked to resolve an issue affecting a portion of server instances in the DFW region. Engineers have brought all affected instances back online. During the time of impact, a portion of customers would have been unable to access their Cloud Server instances in the affected region.

Rackspace
Incident: Cloud Servers ( Cloud Servers | Servers Inaccessible | DFW)

Unresolved: Our engineers continue to work to bring the affected Cloud Server instances back online. At this time, affected customers may be unable to log into or access their server instances. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Servers ( Cloud Servers | Servers Inaccessible | DFW)

Unresolved: Our engineers are continuing to work to bring the affected Cloud Server instances back online. At this time, affected customers may be unable to log into or access their server instances. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Servers ( Cloud Servers | Servers Inaccessible | DFW)

Unresolved: Our engineers are aware of an issue affecting a portion of Cloud Servers customers in the DFW region. At this time, affected customers may be unable to log into or access their server instances. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Backup (Resolved: Cloud Backup | Drive Client Agent Install Failing on RHEL and CentOS | All Regions)

Resolved: On 23 January 2017, from 14:00 to 16:57 CST, our engineers worked to resolve an issue affecting new Cloud Backup Drive Agent installations on RHEL and CentOS server builds. During the time of impact, the agent install would fail on new builds due to a key signing error.

Rackspace
Incident: Cloud Backup (Cloud Backup | Drive Client Agent Install Failing on RHEL and CentOS | All Regions)

Unresolved: Our engineers are aware of an issue affecting new Cloud Backup Drive Agent installations on RHEL and CentOS server builds. At this time, the agent install is failing due to a key signing error. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Backup (Cloud Back Up | 500 Errors | DFW Region)

Resolved: On 20 January 2017, between 06:50 and 07:50 CST, engineers worked to resolve an issue impacting Cloud Back ups in the DFW region. During time of impact, customers may have experienced 500 errors when attempting to access the Back ups. If you have any additional questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Back Up | 500 Errors | DFW Region)

Unresolved: On 20 January 2017, at approximately 07:35 CST, engineers became aware of an issue impacting Cloud Back ups in the DFW region. Engineers are actively engaged and are working to resolve the issue. During time of impact, customers may experience 500 errors when attempting to access the Back ups. If you have any additional questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Databases (Resolved: Cloud DBaaS | New MariaDB Build Failures | All Regions)

Resolved: On 19 January 2017, from 12:15 CST to 15:57 CST, customers attempting to build new Cloud DBaaS MariaDB instances would have encountered failures in all regions. Engineers identified a missing package following a repository sync, and re-added the package to resolve the issue.

Rackspace
Incident: Cloud Databases (Cloud DBaaS | New MariaDB Build Failures | All Regions)

Unresolved: Our engineers are aware of an issue affecting new Cloud DBaaS MariaDB builds in all regions. At this time, customers attempting to build new MariaDB instances may encounter failures. Existing database instances are not affected.

Rackspace
Incident: Cloud Backup (Cloud Backup | clouddrive.rackspace.co.uk Not Available In Reach | SAT6)

Resolved: On 19 January 2017, from 12:03 UTC to 13:25 UTC , engineers worked to resolve issues which affected Cloud Backup. During time of impact, https://clouddrive.rackspace.co.uk is returning 500 errors within the Cloud Control Panel.

Rackspace
Incident: Cloud Backup (Cloud Backup | clouddrive.rackspace.co.uk Not Available In Reach | SAT6)

Unresolved: On 19 January 2017, at 06:03 CST, engineers became aware of an issue affecting Cloud Backup. Engineers are engaged and working to resolve the issue. During this time, https://clouddrive.rackspace.co.uk is returning 500 errors within the Cloud Control Panel. Engineers report that the Cloud Backup API is working as expected.

Rackspace
Maintenance: My Rackspace Portal | Maintenance | All Regions

On 17 January 2017, between 06:00 and 14:00 CST, Rackspace engineers will be conducting a scheduled maintenance affecting a portion of functionality in the MyRackspace Portal. During this time, customers may be unable to access the Managed Virtualization section, ticket templates and device configuration downloads within the My Rackspace Portal. If you have any additional questions, please contact a member of your support team.

Rackspace
Incident: Control Panels (Resolved: Cloud Control Panel Unable to Add Users | All Regions )

Resolved: On 10 January 2017, between 08:50 and 10:43 CST, Support Rackers began reporting an error message when customers try to add a user to a Cloud Account in all regions. During time of impact, customers may have experienced the below error message when trying to add a user to a Cloud Account: "Your Rackspace Cloud Accont is not currently eligible for Fanatical Support on AWS. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Control Panels (Cloud Control Panel Unable to Add Users | All Regions )

Unresolved: Our engineers are aware of an issue affecting the ability for customers to add new users via the Cloud Control Panel. We will provide additional information as it becomes available.

Rackspace
Incident: Control Panels (Resolved: MyRackspace Portal | Managed Virtualization Section Unavailable | All Regions)

Resolved: On 9 January 2017, between 10:45 CST and 20:10 CST, Our engineers worked to resolve an issue affecting the availability of the Managed Virtualization section of the MyRackspace Portal. During time of impact, customers were unable to view the Managed Virtualization section of the MyRackspace Portal.� Additionally, customers using the MyRackspace portal may need to log out and log back in to view the Managed Virtualization section of the MyRackspace Portal.

Rackspace
Incident: Control Panels (MyRackspace Portal | Managed Virtualization Section Unavailable | All Regions)

Unresolved: Our engineers are aware of an issue affecting the availability of the Managed Virtualization section of the MyRackspace Portal and are working to resolve the issue.

Rackspace
Incident: Cloud Servers (Next Generation) (Resolved: Cloud Servers | Nova DB Server Issues | DFW2)

Resolved: Between 4 January 2017, at 20:55 CST, and 5 January 2017, at 15:22 CST, Cloud Engineers worked to resolve issues affecting Cloud Servers in the DFW region. During this time, a subset of customers may have experienced issues with API actions (restart, build, delete, etc.).

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Nova DB Server Issues | DFW2)

Unresolved: On 4 January 2017, at 20:55 CST, Cloud Engineers began work to resolve issues affecting Cloud Servers in the DFW region. Engineers report that VMs are working as expected but a subset of customers may experience issues with API actions (restart, build, delete, etc.).

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Nova DB Server Issues | DFW2)

Unresolved: On 4 January 2017, at 20:55 CST Rackspace is aware of an issue affecting Could Servers in our DFW2 data center and our engineers are working to resolve it as quickly as possible. Currently some customers may be unable to complete API calls to the Nova data base. This will affect restarts and new provisioning.

Rackspace
Incident: Cloud Sites (Cloud Sites | MariaDB Degradation | DFW Region)

Resolved: On 3 January 2017, from 00:01 CST to 04:28 CST, engineers worked to resolve issues which affected Cloud Sites in the DFW Region. Engineers determined hardware issues as the cause for a subset of customers in the DFW region to be in read-only. Engineers resolved customer impact at 04:28 CST.

Rackspace
Incident: Cloud Sites (Cloud Sites | MariaDB Degradation | DFW Region)

Unresolved: On 3 January 2017, starting at approximately 00:01 CST, engineers began work to resolve issues affecting Cloud Sites. During this time, a subset customers in the DFW region may experience issues with MariaDB.

Rackspace
General Notice: Intermittent Phone Issues

Our engineers are aware of an issue affecting inbound phone calls. At this time, customers may be intermittently unable to reach support teams via phone.

Rackspace
Incident: Cloud Servers (Next Generation) (Resolved: Cloud Servers | Cloud Servers API Degredation | IAD Region)

Resolved: On 27 December 2016, between 22:40 CST and 07:25CST on 28 December 2016, Cloud Engineers identified and worked to resolve issues affecting the Cloud Servers API in the IAD region resulting in intermittent API performance. During time of impact, customers may have experienced error messages when performing any server actions (build, image, delete, etc.) via the API and in the customer control panel.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Cloud Servers API Degredation | IAD Region)

Unresolved: On 27 December 2016, starting at approximately 22:40 CST, Cloud Engineers identified and began work to resolve issues affecting the Cloud Servers API in the IAD Region. Engineers report, during this time customers may experience errors performing server actions (build, image, delete, etc.) via the API and in the customer control panel.

Rackspace
Incident: Email & Apps Administrator Tools (Cloud Office - Rackspace Email | Unable to Create New Mailboxes | All Regions)

Resolved: On 21 December 2016, from 01:20 CST to 03:28 CST, Cloud Office engineers worked to resolve issues which affected Rackspace Email in all regions. During time of impact, customers may have not been able to create new mailboxes.

Rackspace
Incident: Email & Apps Administrator Tools (Cloud Office - Rackspace Email | Unable to Create New Mailboxes | All Regions)

Unresolved: On 21 December 2016, starting at approximately 01:20 CST, Cloud Office engineers began work to resolve issues affecting Rackspace Email in all regions. During this time customers may not be able to create new mailboxes.

Rackspace
Incident: Cloud Databases (Resolved: Cloud Datastores | Issue Affecting Redis and MySQL Build and API Calls | DFW)

Resolved: On 19 December 2016, between approximately 13:00 CST and 15:53 CST, Cloud DBaaS engineers worked to resolve an issue affecting API calls and new builds for Redis and MySQL instances in the DFW region. During this time, customer attempting to perform API management functions or build new Redis or mySQL instances in the affected region may have experienced failures.

Rackspace
Incident: Cloud Databases (Cloud Datastores | Issue Affecting Redis and MySQL Build and API Calls | DFW, IAD)

Unresolved: Our engineers are aware of an issue affecting new Cloud DBaaS builds and API calls for Redis and MySQL instances in the DFW and IAD regions and are working to resolve the problem.

Rackspace
General Notice: External ISP Network Issues

UPDATE: On 19 December 2016, from 10:00 to 11:20 CST, a portion of Rackspace customers may have encountered network related issues as a result of an Internet Service Provider (ISP) outage in the DFW region. The provider line has been filtered to resolve customer impact. During the time of impact, you may have experienced latency and or packet loss. If you have any further questions or concerns, please contact a member of your support team. Our engineers have been made aware of an issue impacting an Internet Service Provider (ISP) in the Dallas-Fort Worth region. This issue is occurring outside of our internal network, and at no point has the internal network been affected. Our data centers are designed to leverage multiple circuits of varying sizes in order to distribute and balance traffic efficiently. Rackspace cannot control the paths customer traffic takes outside of our network, and customers may continue to experience latency, packet loss, or dropped connections impacting traffic traveling over the affected provider.

Rackspace
General Notice: External ISP Network Issues

Our engineers have been made aware of an issue impacting an Internet Service Provider (ISP) in the Dallas-Fort Worth region. This issue is occurring outside of our internal network, and at no point has the internal network been affected. Our data centers are designed to leverage multiple circuits of varying sizes in order to distribute and balance traffic efficiently. Rackspace cannot control the paths customer traffic takes outside of our network, and customers may continue to experience latency, packet loss, or dropped connections impacting traffic traveling over the affected provider.

Rackspace
Incident: RackConnect (CLOUD - RackConnect | RackConnect Environments Inaccessible | ORD Region)

Resolved: On 18 December 2016, from approximately 23:00 CST to 00:38 CST, engineers worked to resolve RackConnect in the ORD Region. Engineers reported a gateway device failed and required manual intervention to recover. During time of impact, customers may have experienced difficulties accessing their RackConnect environments.

Rackspace
Incident: RackConnect (CLOUD - RackConnect | RackConnect Environments Inaccessible | ORD Region)

Unresolved: On 18 December 2016, starting at approximately 23:00 CST, engineers identified issues with RackConnect in the ORD Region and are working to resolve impact. During this time, customers may experience difficulties accessing their RackConnect environments.

Rackspace
Incident: Control Panels (Resolved: MyRack Portal | Login Errors)

Resolved: On 9 December 2016, between 05:56 CST and 08:23 CST, Rackspace engineers worked to resolve an issue affecting logins to the MyRackspace portal. During the time of impact, customers attempting to log in to the portal may have received an error message stating "An unexpected error has occurred. Please try again later."

Rackspace
Incident: Control Panels (MyRack Portal | Login Errors)

Unresolved: Our engineers are aware of an issue affecting the MyRackspace Portal and are working to resolve the problem. At this time, customers attempting to log in to the portal may receive an error message stating "An unexpected error has occurred. Please try again later."

Rackspace
Incident: Cloud Backup (Resolved: Cloud Backup | Unavailable in Cloud Control Panel | All Regions )

Resolved: On 6 December 2016, from 10:27 to 15:37 CST, our engineers worked to resolve an issue affecting Cloud Backup access within the customer control panel. During the time of impact, Cloud Backup was unavailable. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Monitoring: Cloud Backup | Unavailable in Cloud Control Panel | All Regions )

Unresolved: On 6 December 2016, from 10:27 to 15:37 CST, our engineers worked to resolve an issue affecting Cloud Backup access within the customer control panel. Engineers are continuing to monitor for further impact. During the time of impact, Cloud Backup was unavailable.

Rackspace
Incident: Cloud Block Storage (Cloud Backup | Unavailable within Reach | All Regions )

Resolved: Please ignore the previous communications posted to this issue. The incident was posted to the incorrect product status page. For the Cloud Backup issue please refer to the Cloud Backup section of the status page.

Rackspace
Incident: Cloud Backup (Cloud Backup | Unavailable within Reach | All Regions )

Unresolved: On 6 December 2016 , at 10:27 CST our engineers became aware of an issue affecting cloudbackup access to clouddrive.rackspace.com within the customer control panel. Engineers are engaged to resolve this issue and have verified the API is functioning. During this time Cloudbackup is unavailable. We will provide the next update as soon as information becomes available.

Rackspace
Incident: Cloud Block Storage (Cloud Backup | Unavailable within Reach | All Regions )

Unresolved: On 6 December 2016 , at 10:27 CST our engineers became aware of an issue affecting cloudbackup access to clouddrive.rackspace.com within the customer control panel. Engineers are engaged to resolve this issue and have verified the API is functioning.

Rackspace
Incident: Cloud Networks (Cloud Networks | Intermittent Cloud Networks Creation Failures | SYD Region)

Resolved: On 28 November 2016, between 00:31 and 15:53 UTC , Cloud Engineers worked to resolve an issue with Cloud Networks in the SYD Region. During time of impact, customers who were creating Cloud Networks in the SYD Region may have experienced intermittent failures. Please contact a member of your support team for further assistance.

Rackspace
Incident: Cloud Networks (Cloud Networks | Intermittent Cloud Networks Creation Failures | SYD Region)

Unresolved: On 28 November 2016 starting at 00:31 UTC , Cloud Engineers identified issues with Cloud Networks in the SYD Region. During this time, customers creating Cloud Networks in the SYD Region may experience intermittent failures.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Errors in Listing Images and Non-Cached VM Builds)

Resolved: On 25 November 2016, from 14:00 CST to 19:20 CST, engineers worked to resolve issues which affected Cloud Server Images in the IAD region. Engineers resolved impact at 19:20 CST. During time of impact, some customers may have experienced intermittent errors when attempting to list images or build a VM from a non-cached image.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Errors in Listing Images and Non-Cached VM Builds)

Unresolved: Rackspace is aware of an issue affecting Cloud Servers in our IAD data centers and our engineers are working to resolve it as quickly as possible. Currently, some customers may experience intermittent error when attempting to list images or build a VM from a non-cached image. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Control Panels (MyRackspace Portal | Errors Logging into MyRackspace Customer Portal | LON Region)

Resolved: On 23 November 2016, at approximately 10:00 UTC , engineers began work to resolve log-in and system errors issues which affected the MyRackspace customer portal. Engineers restored service at 10:58 UTC . During time of impact, a subset of customers in the LON region may have experienced authentication or system errors when logging into MyRackspace portal.

Rackspace
Incident: Cloud Load Balancers (Cloud Load Balancers | Delay in Response Times for Cloud Load Balancers | LON3)

Resolved: On 23 November 2016, from 10:00 UTC to 11:50 UTC , engineers worked to resolve issues which affected Cloud Load Balancers in the LON3 data center. Engineers reported delay in response and load times. During time of impact, a subset of Cloud Load Balancers in the LON region may have experienced long load and response times.

Rackspace
Incident: Cloud Load Balancers (Cloud Load Balancers | Delay in Response Times for Cloud Load Balancers | LON3)

Unresolved: On 23 November 2016, starting at 10:00 UTC , engineers started work to resolve issues affecting Cloud Load Balancers in the LON3 data center. Engineers report that a delay in response and load times. During this time, a subset of Cloud Load Balancers in the LON region may experience long load and response times.

Rackspace
Incident: Control Panels (MyRackspace Portal | Errors Logging into MyRackspace Customer Portal | LON Region)

Unresolved: On 23 November 2016, starting at approximately 10:00 UTC , engineers began work to resolve issues affecting the MyRackspace customer portal. During this time, UK customers may experience authentication or system errors when logging into MyRackspace portal.

Rackspace
Incident: Cloud Servers (Next Generation) (Gateway Time-outs On Console Access )

Resolved: As of 20:42 CST, engineers confirm that console access has been restored in ORD1. During the affected time, customers may have experienced time-outs when attempting console access. Instances were otherwise unaffected.

Rackspace
Incident: Cloud Servers (Next Generation) (Gateway Time-outs On Console Access )

Unresolved: On 18 November 2016, at 19:20 CST, Rackspace engineers identified an issue affecting Cloud Servers in our ORD1 data center and our engineers are working to resolve it as quickly as possible. Currently, customers attempting console access to any instances in ORD1 may experience gateway timeouts. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Sites (Control Panel Down During Maintenance)

Resolved: Engineers have resolved the issue as of 00:37 CST. During the time of incident, some customers may have been unable to access the Cloud Sites Control Panel. If you hav eany further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Sites (Control Panel Down During Maintenance)

Unresolved: On 17 November 2016, at 23:55 CST, engineers became aware of an issue affecting the Cloud Sites Control Panel. Engineers are aware of the issue and working to resolve. At this time, Cloud Sites customers may be unable to access their Cloud Sites Control Panel.

Rackspace
General Notice: Salesforce Live Chat Unavailable

On 16 November 2016,at 18:35 CST Rackspace identified an issue involving Salesforce Live Chat. Currently, the vendor has reported several outages and customers will be unable to initiate a chat with any of our support teams. If you require assistance please contact your support team via phone, ticket, or email at this time. Salesforce has provided their own status page to track progress. https://status.salesforce.com/status/NA32

Rackspace
General Notice: Salesforce Live Chat Unavailable

On 16 November 2016,at 18:35 CST Rackspace identified an issue involving Salesforce Live Chat. Currently, the vendor has reported several outages and customers will be unable to initiate a chat with any of our support teams. If you require assistance please contact your support team via phone, ticket, or email at this time.

Rackspace
Incident: Cloud Sites (Cloud Sites | Maintenance out of Scope - Sites in Read-Only Status | DFW Region)

Resolved: On 15 November 2016, from at 23:00 CST to 02:27 CST, Cloud Sites engineers worked to complete a scheduled maintenance that went over its maintenance window. Engineers reported, during the maintenance, ran into unexpected networking issues. During time of impact, a subset of customers in the DFW Region had their Cloud Sites in a read-only status.

Rackspace
Incident: Cloud Sites (Cloud Sites | Maintenance out of Scope - Sites in Read-Only Status | DFW Region)

Unresolved: On 15 November 2016, starting at 23:00 CST, Cloud Sites engineers report that a scheduled maintenance has gone over its maintenance window. Engineers report, during the maintenance, ran into unexpected networking issues. Engineers are engaged and are working to resolve the issue. During this time, a subset Cloud Sites customers in the DFW Region will be in read-only status.

Rackspace
Incident: Cloud Monitoring (Rackspace Monitoring | Intermittent Monitoring API Issues)

Resolved: On 15 November 2016, from 20:37 CST to 21:21 CST, Rackspace Monitoring engineers worked to resolve intermittent '500 Errors' from the Rackspace Monitoring API. During time of impact, customers may have experienced intermittent errors from the Rackspace Monitoring API or through the customer Cloud Control Panel.

Rackspace
Incident: Cloud Sites (Cloud Sites | Maintenance out of Scope - Sites in Read-Only Status | DFW Region)

Unresolved: On 15 November 2016, starting at 23:00 CST, Cloud Sites engineers report that a scheduled maintenance has gone over its maintenance window. Engineers report, during the maintenance, ran into unexpected networking issues. Engineers are engaged and are working to resolve the issue. During this time, Cloud Sites customers in the DFW Region will be in read-only status.

Rackspace
Incident: Cloud Monitoring (Rackspace Monitoring | Intermittent Monitoring API Issues)

Unresolved: On 15 November 2016, from 20:37 CST to 21:21 CST, Rackspace Monitoring engineers worked to resolve intermittent '500 Errors' from the Rackspace Monitoring API. During time of impact, customers may have experienced intermittent errors from the Rackspace Monitoring API or through the customer Cloud Control Panel.

Rackspace
Maintenance: Cloud Sites | ORD & DFW Web Server Maintenance

At 11:00 AM CST, Cloud Sites Engineers will be performing maintenance on web servers in all environments. There is no expected customer impact during the time of the maintenance. The maintenance is expected to last 8 hours. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Sites (FTP connection errors)

Resolved: Problems connecting to FTP have no longer occurred. Thank you for your patience.

Rackspace
Incident: Cloud Sites (FTP connection errors)

Unresolved: ~12:05pm CST Cloud Sites Engineers became aware of a problem connecting to FTP for many users. Actions have been taken to resolve the connection errors. We are actively investigating the cause and a firm resolution. Thank you for your patience. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
General Notice: GDCI - Network | UK Providers Experiencing Intermittent Connectivity | LON Region

On 10 November 2016, at approximately 10:00 UTC , engineers became aware of an issue with UK internet providers experiencing intermittent connectivity issues. Providers are working to resolve the issue on their side. During this time, a portion of UK Rackspace customers may experience intermittent connectiivity when accessing Rackspace products and services from the UK region. If you have any further questions, please reach out to a member of your support team.�

Rackspace
General Notice: Cloud Autoscale | Cloud Autoscale API '500 Errors' | HKG Region

On 10 November 2016, starting at 07:25 UTC , Autoscale engineers bean work to resolve issues which affected Cloud Autoscale in the HKG Region. Engineers reported hat the Autoscale API responds with a '500 Server Error' message. During this time, customers may be unable to access or make changes to their Cloud Autoscale configurations in the HKG Region.

Rackspace
Incident: Cloud Monitoring (Rackspace Monitoring | Monitoring API Issues)

Unresolved: Engineers continue work to resolve issues affecting the Rackspace Monitoring API. At this time, customers may experience intermittent errors when making calls to the Rackspace Monitoring API.

Rackspace
Incident: Cloud Monitoring (Rackspace Monitoring | Monitoring API Issues)

Unresolved: Rackspace Monitoring engineers are working to resolve an issue affecting the Rackspace Monitoring API. At this time, customers may experience errors when making calls to the Rackspace Monitoring API.

Rackspace
Maintenance: Cloud Sites | Load Balancer Maintenance | Nov 7

At 9pm Cloud Sites Engineers will be performing maintenance on the load balancers in both datacenters. Maintenance is expected to last up to an hour, during which time there is potential for services to degrade slightly. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Sites (FTP - Network Latency and Timeouts)

Resolved: Engineers completed monitoring the environment.

Rackspace
Incident: Cloud Sites (Resolved: Cloud Sites | Intermittent Accessibility | DFW Region)

Resolved: On 7 November 2016, from 04:09 CST to 05:17 CST, engineers worked to resolve issues which affected Cloud Sites in the DFW Region. Engineers resolved the issue at 05:17 CST and continue to monitor the environment for stability. During time of impact, Cloud Sites customers in the DFW region may have been intermittently not able to access their sites.

Rackspace
Incident: Cloud Sites (Cloud Sites | Intermittent Accessibility | DFW Region)

Unresolved: On 7 November 2016, starting at 04:09 CST, engineers began work to resolve issues affecting Cloud Sites in the DFW region. During this time, customers may intermittently not be able to access their site.

Rackspace
Maintenance: Cloud Networks | All Regions | Starting Wednesday, November 9 - November 15

Rackspace Cloud Networks Engineers will be performing disruptive maintenance to update Openstack Neutron Software in the following regions: CHG0069248 - SYD - November 10, 2016 2:00 AM to 6:00 AM AEDT CHG0069127 - LON - November 9, 2016 11:00 PM GMT to November 10, 2016 3:00 AM GMT CHG0069125 - DFW - November 9, 2016 10:00 PM CST to November 10, 2016 4:00 AM CST CHG0069128 - ORD - November 10, 2016 10:00 PM CST to November 11, 2016 4:00 AM CST CHG0069386 - HKG - November 14, 2016 11:00 PM HKT to November 15, 2016 3:00 AM HKT CHG0069129 - IAD - November 14, 2016 10:00 PM CST to November 15, 2016 4:00 AM CST For approximately 30 minutes, this maintenance will impact customers’ ability to utilize the API directly as well as make networking changes through the Cloud Servers account via Reach (mycloud.rackspace.com). This means that new Cloud Servers builds will go into error and new Cloud Networks creation requests will fail while Neutron related services are unavailable. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407

Rackspace
Incident: Cloud Sites (FTP - Network Latency and Timeouts)

Unresolved: At ~8:54am Cloud Sites Engineers received reports of intermittent FTP timeout issues in both datacenter. Customers were unable to access their websites via FTP. At ~9:14am the issue was fixed, however we will continue monitoring to ensure resolution. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Cloud Sites | Load Balancer Maintenance | Nov 9

At 9pm Cloud Sites Engineers will be performing maintenance on the load balancers in both datacenters. Maintenance is expected to last up to an hour, during which time there is potential for services to degrade slightly. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Control Panels (My Rackspace Portal | 500 Errors | ORD1)

Resolved: On 1 November 2016, between 05:00 and 09:33 CDT, engineers began to work to resolve an issue affecting the MyRackspace portal in the ORD1 data center. During time of impact, customers may have experienced errors when attempting to view their devices. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Control Panels (My Rackspace Portal | 500 Errors | ORD1)

Unresolved: Rackspace is aware of an issue impacting MyRackspace Portal in the ORD1 data center and our engineers are working to resolve it as quickly as possible. During this time, a portion of customers may experience errors when attempting to access the portal or to view their devices.

Rackspace
General Notice: Fanatical Support for AWS and Rackspace Cloud | Account Issues | All Regions

On 31 October 2016, at approximately 23:37 CDT, engineers began working to resolve an issue affecting the Fanatical Support for AWS control panel. A portion of customers may have been unable to access the affected control panel until the issue was resolved at 03:46 on 1 November 2016. Currently, customers may experience issues with activating new accounts for Rackspace Cloud and Fanatical Support for AWS.

Rackspace
General Notice: Fanatical Support for AWS and Rackspace Cloud | Account Issues | All Regions

On 31 October 2016, at approximately 23:37 CDT, engineers began working to resolve an issue affecting the Fanatical Support for AWS control panel. A portion of customers may have been unable to access the affected control panel until the issue was resolved at 03:46 on 1 November 2016. Currently, customers may experience issues with activating new accounts for Rackspace Cloud and Fanatical Support for AWS. Currently, there is an issue with activating new Rackspace Cloud and Fanatical Support for AWS accounts.

Rackspace
General Notice: Fanatical Support for AWS and Rackspace Cloud | Account Issues | All Regions

On 31 October 2016, at approximately 23:37 CDT, engineers began working to resolve an issue affecting the Fanatical Support for AWS control panel. Initially, a portion of customers may have been unable to access the affected control panel until the issue was resolved. Currently, there is an issue with activating new Rackspace Cloud and Fanatical Support for AWS accounts.

Rackspace
Incident: Cloud Servers (Next Generation) (Resolved: Control Plane API issues)

Resolved: Between 29 October 2016, at 23:45 UTC , and 30 October 2016, at 01:15 UTC , Cloud Servers engineers worked to resolve an issue affecting Control Plane API nodes in the LON region. During the time of impact, customers may have received 500 errors when attempting to make calls to the affected API nodes.

Rackspace
Incident: Cloud Servers (Next Generation) (Control Plane API issues)

Unresolved: Rackspace is aware of an issue affecting Cloud Servers Control Plane in our LON data center region and our engineers are working to resolve it as quickly as possible. Currently customers in that region may receive '500' errors when making Control Plane API calls.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Intermittent ServiceNet Connectivity Issues | LON Region)

Resolved: On 29 October 2016, at approximately 06:00 UTC , Rackspace engineers began receiving reports of sporadic ServiceNet connectivity issues in the LON region. Further investigation identified a small number of RackConnect v2 devices that were unreachable following a planned load balancer device upgrade due to an incorrect configuration. Engineers corrected the configuration on the affected devices as of 12:22 UTC . During the time of impact, a small subset of RackConnect v2 devices in the LON region would have been unreachable.

Rackspace
Incident: Control Panels (Resolved: Sites | Control Panel Inaccessible | All Regions)

Resolved: On 29 October 2016, from approximately 03:20 to 04:50 CDT, engineers worked to resolve an issue affecting the Cloud Sites Control Panel. During the time of impact, customers may have been unable to access the Cloud Sites Control Panel.

Rackspace
Incident: Control Panels (Cloud Sites | Control Panel Inaccessible | All Regions)

Unresolved: The Control Panel issue was resolved at approximately 04:40 CDT, however, engineers are continuing to monitor for further impact.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Intermittent ServiceNet Connectivity Issues | LON Region)

Unresolved: Our engineers are aware of an issue affecting Cloud Servers in the LON Region and are working to resolve the problem. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Control Panels (Cloud Sites | Control Panel Inaccessible | All Regions)

Unresolved: On 29 October 2016, at approximately 03:20 CDT, engineers began working to resolve an issue affecting the Cloud Sites Control Panel. During this time, customers may be unable to access the Cloud Sites Control Panel. If you have any further questions or concerns, please contact a member of your support team.

Rackspace
Maintenance: Cloud Sites | DFW & ORD Windows Maintenance | Nov 1

At 2am each night of the maintenance Cloud Sites Engineers will be performing maintenance on the Windows/IIS hosting platforms to apply routine patches issued by Microsoft. The length of each maintenance will vary depending on the node. There should be no visible ill effects, however, it is possible that a server being rebooted message may show up in some applications logs or sessions may be lost due to a node rebooting. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
General Notice: Fanatical AWS | Passport Issues

Our engineers are aware of an issue affecting Passport for Fanatical AWS. At this time, customers may experience issues connecting to their server instances through the Passport tool.

Rackspace
General Notice: Main Support Line Issue

Rackspace engineers are aware of an issue impacting our inbound calls to our toll free support numbers. During this time, customers are advised to contact our local support line 210.312.4000 or via alternate channels including live chat or ticket.

Rackspace
General Notice: Main Support Line Issue

Rackspace engineers are aware of an issue impacting our main support line number: 1.800.961.4454. During this time, customers are advised to contact our local support line 210.312.4000 or via alternate channels including live chat or ticket.

Rackspace
General Notice: Main Support Line Issue

Rackspace engineers are aware of an issue impacting our main support line number: 1.800.961.4454. During this time, customers are advised to contact our support team via alternate channels including live chat or ticket.

Rackspace
Incident: Cloud Backup (Cloud Backup | Cloud Backup API '500 Errors' | ORD, DFW, and IAD Regions)

Resolved: On 27 October 2016, from 23:39 CDT to 00:25 CDT, engineers worked to resolve issues affecting the Cloud backup API. Engineers determined that the downtime was caused by a scheduled maintenance. During time of impact, customers may have experienced '500 Errors' when accessing Cloud Backup via the API or the Customer Control Panel.

Rackspace
Incident: Cloud Backup (Cloud Backup | Cloud Backup API '500 Errors' | ORD, DFW, and IAD Regions)

Unresolved: On 28 October 2016, starting at 11:39 CDT, engineers are working to resolve issues affecting the Cloud Backup API in the ORD, DFW, and IAD regions. During this time, customers my experience '500 Errors' when accessing Cloud Backup via the API or the Customer Control Panel.

Rackspace
General Notice: Network Services Maintenance in HKG1

Rackspace Network Services will be performing a non-disruptive maintenance to upgrade the software on our switching infrastructure in our HKG data center between 07:00 and 11:00 HKT, on October 28, 2016. This maintenance is designed to increase stability, network resiliency, and scalability. We have taken precautions in preparation for this maintenance and do not anticipate any disruption of service during this time.

Rackspace
Maintenance: Cloud Customer | All regions | Starting Monday, October 31 at 10:00 PM CDT

Rackspace Engineering will be performing a scheduled maintenance for our Customer Service in all regions: DFW and ORD: Between 22:00:00 and 22:15:00 CDT on October 31, 2016 IAD: Between 23:00:00 and 23:15:00 EDT on October 31, 2016 LON: Between 03:00:00 and 03:15:00 GMT on November 1, 2016 SYD: Between 14:00:00 and 14:15:00 AEDT on November 1, 2016 HKG: Between 11:00:00 and 11:15:00 HKT on November 1, 2016 For approximately 15 minutes, this maintenance will impact customers ability to make changes to their account information within Reach and the MyRack Portal. Sign Up for new customers will potentially be impeded for that same period. If a customer attempts to sign up and encounters a failure, the Onboarding Team will contact the customer to complete the sign up action. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Control Panels (MyRackspace Portal | Intermittent Loading Issues )

Resolved: Rackspace engineers have resolved the issue affecting the MyRackspace Portal as of approximately 10:52 CDT. During the time of impact, customers may have experienced intermittent issues loading sections of the portal.

Rackspace
Incident: Control Panels (MyRackspace Portal | Intermittent Loading Issues )

Unresolved: Our engineers are aware of an issue affecting the MyRack Portal and are working to resolve the problem. At this time, customers may experience intermittent issues loading sections of the MyRack Portal.

Rackspace
Incident: Cloud Servers (Next Generation) (Resolved: New Cloud Servers Builds with Mailgun Errors)

Resolved: Between 20 October 2016, at 14:00 CDT, and 24 October 2016, at 12:40 CDT, Rackspace engineers worked to resolve an issue affecting a portion of new server builds. During this time, customers attempting to build Cloud Servers with the Mailgun option would have experienced failures.

Rackspace
Incident: Cloud Servers (Next Generation) (New Cloud Servers Builds with Mailgun Errors)

Unresolved: On 20 October 2016, at 14:00 CDT our engineers identified an issue affecting Servermill and are working to resolve the problem. Currently new Cloud Servers builds with Mailgun setup are failing. If you encounter this problem, please contact your support team who will provide you with a workaround.

Rackspace
Incident: Control Panels (MyRackspace Ticketing Requests Intermittent Failures)

Resolved: On 21 October 2016, from 15:17 to 15:55 CDT, engineers worked to resolve an issue affecting ticket requests from the MyRackspace portal. During the affected time, customers attempting template based ticket requests may have seen intermittent failures.

Rackspace
Incident: Control Panels (MyRackspace Ticketing Requests Intermittent Failures)

Resolved: On 21 October 2016, at 15:17 CDT, engineers identified an issue affecting ticket requests from the MyRackspace portal. During this time, customers attempting template based ticket requests may have seen intermittent failures.

Rackspace
Incident: Cloud Databases (Resolved: Cloud DBaaS - Object Rocket Redis, MySQL New Build and HA Conversion Errors)

Resolved: On 21 October 2016, between 09:00 CDT and 14:50 CDT, engineers worked to resolve an issue affecting Cloud Databases in the LON region. During this time, customers attempting to create new Object Rocket Redis or MySQL builds or HA conversions in the affected region may have experienced build failures.

Rackspace
Incident: Cloud Databases (Resolved: Cloud DBaaS - Object Rocket Redis, MySQL New Build and HA Conversion Errors)

Resolved: On 21 October 2016, at 09:00 CDT engineers identified an issue affecting Cloud Databases and are working to restore it as soon as possible. Currently, customer attempting to create new Object Rocket Redis or MySQL builds or HA conversions in the LON region may experience build failures.

Rackspace
Maintenance: Cloud Sites | ORD & DFW Maintenance | 10-27

At 10/27 at 10PM Cloud Sites Engineers will be performing maintenance on on the firewalls in our environment. There is no expected customer impact during the time of the maintenance. The maintenance is expected to last 2 hours. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Cloud Sites | ORD & DFW Maintenance | 10/25-10/26

At 10/25 at 2PM and 10/26 at 2PM Cloud Sites Engineers will be performing maintenance on the cron servers in our environment. We will updating the technologies available that cron tasks will run as. Below is a list of the affected technologies - PHP 5.2 --> 5.6 - Perl 5.8.8 --> 5.20.2 - Python 2.4 --> 2.7.9 - Ruby 1.8.5 -- > 2.1.5 - Curl 7.15.5 -- > 7.38.0 During the change, there is expected to be a disruption of cron tasks running at that time for no more than 30 minutes. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Cloud Sites – Emergency Maintenance

Cloud Sites Our Engineers are currently performing an emergency maintenance on web servers across our ORD and DFW datacenters. During this time, certain web servers will be taken out of rotation while the maintenance is performed. There is no expected impact to customer web sites during the maintenance. If you have any further questions please feel free to contact a member of our support team.

Rackspace
Incident: Cloud Databases (Cloud Databases | API Issues | ORD Region)

Resolved: On 19 October 2016, from 19:00 to 21:39 CDT, our engineers worked to resolve an issue with Cloud Databases API in the ORD region. During the affected time, some customers may have experienced API calls in the affected region failing, however, existing databases remained unaffected. If you have further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Databases (Cloud Databases | API Issues | ORD Region)

Unresolved: On 19 October 2016, at 19:00 CDT, our engineers began working to resolve an issue with Cloud Databases API in the ORD region. During this time, API calls in the affected region are failing, however, existing databases remain unaffected. If you have further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Backup | Service Unavailable Errors | All Regions)

Resolved: On 19 October 2016, at approximately 01:10 CDT, engineers started work to resolve issues affecting Cloud Backup. Engineers determined that the errors ceased at 01:45 CDT. During time of impact, customers that attempted to access Cloud Backups from the MyCloud Control Panel, may have experienced 'Service Unavailable' errors; the Cloud Backup API was not affected.

Rackspace
Incident: Cloud Backup (Cloud Backup | Service Unavailable Errors | All Regions)

Unresolved: On 19 October 2016, at approximately 01:10 CDT, engineers started work to resolve issues affecting Cloud Backup. Engineers determined that the errors ceased at 01:45 CDT. Cloud Backup engineers continue to monitor the stability of the environment. During time of impact, customers that attempted to access Cloud Backups from the MyCloud Control Panel, may have experienced 'Service Unavailable' errors; the Cloud Backup API was not affected.

Rackspace
Incident: Cloud Backup (Cloud Backup | Service Unavailable Errors | All Regions)

Unresolved: On 19 October 2016, at approximately 01:10 CDT, engineers started work to resolve issues affecting CloudBackup. During this time, customers that attempt to access Cloud Backups from the MyCloud Control Panel, may experience 'Service Unavailable' errors; the Cloud Backup API is not impacted.

Rackspace
Incident: Cloud Files (Cloud FIles | Packet Loss | DFW Region)

Resolved: On 18 October 2016, from 18:30 to 21:45 CDT, our engineers worked to resolve an issue affecting Cloud Files in the DFW region. During this time, a portion of customers may have received errors or timeouts for Cloud Files requests in the affected region.

Rackspace
Incident: Cloud Files (Cloud FIles | Packet Loss | DFW Region)

Unresolved: On 18 October 2016, at 18:30 CDT, our engineers began working to resolve an issue affecting Cloud Files in the DFW region and are working to resolve the problem. During this time, a portion of customers may receive errors or timeouts for Cloud Files requests in the affected region. If you have any further questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Resolved: Cloud Files | Response Time Latency | DFW)

Resolved: On Tuesday, October 18, 2016, from 12:06 to 15:20 CDT, our engineers worked to resolve aware an issue affecting Cloud Files in the DFW Region. During the time of impact, a portion of customers may have experienced slow response times on Cloud Files requests in the affected region. If you have any further question, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Cloud Files | Response Time Latency | DFW)

Unresolved: On Tuesday, October 18, 2016, at 12:06 CDT our engineers became aware of an issue affecting Cloud Files and are working to resolve the problem. During this time, customers may experience slow response times on DFW Cloud Files requests.

Rackspace
Maintenance: Cloud Sites | ORD & DFW Load Balancer Maintenance | Oct 18-21

Cloud Sites Engineers will be performing updates to all load balancers within the infrastructure in both datacenters. Maintenance is expected to last up to 6 hours each evening. Due to the updates all systems will be affected in the following manner: Load balancers will go in and out of rotation during the maintenance while reboots are performed If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Cloud Sites | DFW & ORD Storage Maintenance | Oct 18 @ 11pm

At 11pm Cloud Sites Engineers will be performing maintenance on storage in both datacenters. This should have no visible impact and maintenance is expected to last up to 2 hours. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Network Engineering | DFW1 | Thursday, October 9th @ 00:01 AM CDT

Rackspace Network Services will be performing a service disrupting maintenance on our RackConnectv2 network in our DFW data center. CHG0067182 -DFW1 - Oct 9th 00:00 AM to 04:00 AM CDT. Connectivity between dedicated and cloud environments will be down during the second hour of this maintenance. Customers affected by this maintenance have been notified by a MyRackspace ticket. If you have any questions or concerns in regards to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407 and INTL +1.210.581.0407.

Rackspace
Incident: Cloud Load Balancers (Resolved: Cloud LBaaS | Log Access Issue | LON3 )

Resolved: On 6 October 2016, from 15:04 UTC to 17:27 UTC , engineers worked to resolve an issue affecting Cloud LBaaS log file access for a portion of customers in the LON region. During this time, customers may have been unable to access log files for their Cloud Load Balancer devices.

Rackspace
Maintenance: Cloud Sites | ORD & DFW All Systems Maintenance | Oct 11 - 14 @ 9pm

Cloud Sites Engineers will be performing Debian 8.6 updates to all servers within the infrastructure in both datacenters. Maintenance is expected to last up to 4 hours each evening. Due to the updates all systems will be affected in the following manner: PHP Web servers will go in and out of rotation during the maintenance while reboots are performed MariaDB Database servers will be put into read-only mode during their respective reboots FTP nodes will require a reboot and will present a loss of session for customers currently uploading data PHPMyAdmin will require a reboot and customers will lose their existing session If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Sites (IIS latency in some sites)

Resolved: On 4 October 2016, at 02:00, engineers began working to resolve an issue affecting Cloud Sites in the DFW and ORD regions. Engineers found that the latency issues were isolated to a small subset of sites.A workaround was tested, then deployed on 06 October 2016, resolving the issue at 22:12 CDT. During the time of impact, a small portion of customers experienced latent response times to web requests with their hosted site. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Sites (IIS latency in some sites)

Unresolved: Engineers have scheduled an emergency maintenance for 21:00 CDT to address this latency issue. Status will be updated again upon completion of this maintenance.

Rackspace
Incident: Cloud Load Balancers (Cloud LBaaS | Log Access Issue | LON3 )

Unresolved: Our engineers are aware of an issue affecting access to logs for a portion of Cloud LBaaS instances in the LON region. At this time, some customers may be unable to access logs for their LBaaS instances in the affected region. This issue does not affect normal operation or availability of LBaaS instances. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Sites (IIS latency in some sites)

Unresolved: Our Engineering team has deployed a fix on two clusters resolving the performance issues which were affecting IIS sites with unique dependencies in the DFW datacenter. At this time, the corrective action is still being evaluated before full release. In the meantime, if you have an IIS website which is being impacted please bring this to the attention of our Support team so we can assist.

Rackspace
Incident: Cloud Sites (IIS latency in some sites)

Unresolved: Our engineers continue to dig into the issue and have found no correlation between the latency in DFW and prior maintenance. There have been no reports or alerts indicative of latency with websites in the ORD datacenter so ORD is being set to the normal status at this time. If you have an IIS site experiencing performance problems please let our support team know so we can investigate further. In the meantime, we will continue to research this issue and update the status as information is made available.

Rackspace
Incident: Cloud Sites (IIS latency in some sites)

Unresolved: Our Cloud Sites Engineers continue to investigate the cause for latency impacting a small subset of Windows based Cloud Sites. We will continue to provide information as it becomes available. If you need immediate assistance, please contact a member of our support team by visiting us in live-chat or by calling 1.877.934.0407 or INTL +1.210.581.0407.

Rackspace
Incident: Cloud Sites (IIS latency in some sites)

Unresolved: Cloud Sites Windows Engineers have identified an issue causing a 1-5 second delay when loading some websites. We are actively investigating if this is caused by a patch from this week's maintenance or another factor. We will provide more information when it becomes available. If you need immediate assistance, please contact a member of our support team by visiting us in live-chat or by calling 1.877.934.0407 or INTL +1.210.581.0407.

Rackspace
Maintenance: Rackspace CDN | Upcoming Disruptive Vendor Maintenance - Akamai | All Regions

On 5 October 2016, from 14:00 to 15:00 CDT, the Rackspace CDN may be impacted during a planned vendor maintenance. The maintenance will not effect the CDN itself, but only changes and content refreshes made during the maintenance window. During this time, customers may experience errors when trying to make changes and content refreshes during the maintenance window. If you need a content refresh done during the maintenance, please contact support.

Rackspace
Maintenance: Cloud Sites | DFW & ORD Windows Maintenance | Oct 3 - 14

At 2am each night of the maintenance Cloud Sites Engineers will be performing maintenance on the Windows/IIS hosting platforms to apply routine patches issued by Microsoft. The length of each maintenance will vary depending on the node. There should be no visible ill effects, however, it is possible that a server being rebooted message may show up in some applications logs or sessions may be lost due to a node rebooting. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Monitoring (Cloud Control Panel | Errors for Links to Rackspace Intelligence | All Regions)

Resolved: Between 28 September 2016 22:52 CDT and 29 September 2016 08:59 CDT, engineers identified issues affecting links to Rackspace Intelligence in the MyCloud Customer Control Panel. During time of impact, customers that attempted to access Rackspace Intelligence through the portal may have encountered "Page Not Available" errors. As a workaround, customers were able to access their monitoring data via intelligence.rackspace.com, or by clicking the Rackspace Intelligence link under the Rackspace Cloud dropdown menu in mycloud.rackspace.com

Rackspace
Incident: Cloud Databases (Maintenance Outage)

Resolved: On 2 October 2016, at 00:12 UTC Rackspace identified an issue affecting Cloud Datastores in our LON5 data center and our engineers worked to resolve it as quickly as possible. At that time, some customers may have found their Reddis, Mongo, ElasticSearch and MySQL instances unavailble due to impact from a scheduled maintenance. By 01:00 UTC , engineers reported Reddis, Mongo, and ElasticSearch were again available, while MySQL customers may have found their data in a read-only state. By 02:40 UTC all MySQL data bases were restored to read-write capability. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Databases (Maintenance Outage)

Unresolved: Engineers continue to restore the affected databases on the equipment that was restarted due to the maintenance. Currently Reddis and Mongo are fully functional and MySql is being restored.

Rackspace
Incident: Cloud Databases (Maintenance Outage)

Unresolved: On 1 October 2016 at 12:12 UTC Engineers identified an issue with Cloud Datastores due to a scheduled maintenance in LON5. Currently some customers may be unable to access their DBaaS products, including MySql, Reddis, and Mongo.

Rackspace
Incident: Cloud Databases (Cloud Datastores | New Builds and Database changes failing | DFW2)

Resolved: On 01 October 2016, from 06:00 to 08:37 CDT, engineers worked to resolve an issue affecting Cloud Datastores in the DFW2 data center. Engineers found that an influx of messages on the API nodes had caused new builds to fail. Engineers restarted the API nodes once the influx of messages was cleared and then restarted the API stack to resolve the issue. During the time of impact, a portion of customers may have experienced failures when building new databases in the DFW region, as well as making resize or boot changes to current databases. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Databases (Cloud Datastores | New Builds and Database changes failing | DFW2)

Unresolved: On 01 October 2016, at approximately 06:00 CDT, engineers became aware of an issue affecting Cloud Datastores in the DFW region. Engineers are engaged and working to resolve the issue. During this time, customers may experience failures when building new databases in the DFW region, or when attempting to resize or reload currently hosted databases. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Sites (Maria DB Host Down | DFW3)

Resolved: On 30 September 2016, from 14:45 CDT to 17:13 CDT engineers worked to resolve an issue affecting Cloud Sites in our DFW3 data center. During the affected time, some customers may have found their data base in a read only state until the matter was resolved. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Sites (Maria DB Host Down | DFW3)

Unresolved: Rackspace is aware of an issue affecting Cloud Sites in our DFW3 data center and our engineers are working to resolve it as quickly as possible. Currently, some customers may find their data base in a read only state until the matter is resolved. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Databases (DBaaS New Build Errors | DFW1)

Resolved: Engineers have restored new build function to DBaaS in DFW1

Rackspace
Incident: Cloud Databases (DBaaS New Build Errors | DFW1)

Unresolved: Rackspace is aware of an issue in our DFW1 data center affecting Cloud Datastores and our engineers are working to resolve it as quickly as possible. Currently customers attempting new DBaaS builds in DFW1 may see these builds error out. Existing DBaaS instances are unaffected.

Rackspace
Maintenance: Next Gen Cloud Servers | All Regions | Starting Wednesday, October 5 at 9:00 AM CDT

The Rackspace Open Cloud system engineers will perform a priority maintenance to the control infrastructure of our Next Generation Cloud Servers regions during the following dates and times: CHG0068112 - SYD Region - October 5 from 9:00 AM - 3:00 PM CDT (October 6 from 1:00 AM - 7:00 AM AEST) CHG0068119 - HKG Region - October 6 from 9:00 AM - 3:00 PM CDT (October 5 from 10:00 PM - October 6 to 4:00 AM HKT) CHG0068121 - LON Region - October 6 from 4:00 PM - 10:00 PM CDT (October 6 from 10:00 PM BST – October 7 to 4:00 AM BST) CHG0068122 - IAD Region - October 10 from 9:00 PM - October 11 to 3:00 AM CDT CHG0068124 - DFW Region - October 11 from 10:00 PM - October 12 to 4:00 AM CDT CHG0068123 - ORD Region - October 12 from 10:00 PM - October 13 to 4:00 AM CDT During these times, customers accessing management level services (public APIs for these regions) may experience errors for a period of up to 30 minutes. This includes requests sent from the MyCloud Control Panel as well as those sent to the Next Gen Cloud Servers API directly (First Gen Cloud Servers management will not be affected). This maintenance will NOT pose any impact to existing Next Gen Cloud Servers under your account which are located in this region. However, certain operations being performed during this period may be interrupted (such as server builds, resizes, or snapshots). Customers are urged to perform these operations before or after this maintenance event. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Cloud Monitoring (Cloud Control Panel | Errors for Links to Rackspace Intelligence | All Regions)

Unresolved: On 29 September 2016, starting at approximately 22:52 CDT. engineers began work to resolve issues affecting links to Rackspace Intelligence in the MyCloud Customer Control Panel. During this time, customers that attempt to access Rackspace Intelligence through the portal may encounter "Page Not Available" errors. As a workaround, customers can access their monitoring data via intelligence.rackspace.com, or click the Rackspace Intelligence link under the Rackspace Cloud dropdown menu in mycloud.rackspace.com

Rackspace
Incident: Cloud Monitoring (Cloud Control Panel | Errors for Links to Rackspace Intelligence | All Regions)

Unresolved: On 29 September 2016, starting at approximately 22:52 CDT. engineers began work to resolve issues affecting links to Rackspace Intelligence in the MyCloud Customer Control Panel. During this time, customers that attempt to access Rackspace Intelligence through the portal may encounter "Page Not Available" errors.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss | LON Region)

Resolved: On 23 September 2016, at 14:00 CDT, engineers reported that Cloud Files affected customers' start response times remain consistently within acceptable ranges. Engineers determined that after adding new proxies to the LON Cloud Files environment, customers appear to be functioning well within acceptable ranges and have not recorded any timeouts.

Rackspace
Incident: Cloud Servers (Next Generation) (Line Card Reload in DFW3 affecting Cloud Servers )

Resolved: On 23 September 2016, from 17:14 to 19:45 CDT engineers worked to resolve an issue affecting Cloud Servers in DFW2. The team identified a line card that had reloaded and knocked Cloud Servers data bases out of sync. The line card was replaced and engineers re-synced the affected data bases. During time of impact, some customers may have noticed errors or interruptions during API calls.

Rackspace
Incident: Cloud Servers (Next Generation) (Line Card Reload in DFW3 affecting Cloud Servers )

Unresolved: Rackspace is aware of an issue affecting ServiceNet in our DFW data center and our engineers are working to resolve it as quickly as possible. Currently some Cloud Servers customers may experience API errors or interruptions when making API calls to their instances.

Rackspace
Incident: RackConnect (RackConnect V3 issues with Arista VTEP VXLAN traffic.)

Resolved: On 15 September 2016 in the DFW Region and on 22 September 2016 in the IAD region, Rackspace identified an issue affecting RackConnect v3. Engineers resolved both issues on their corresponding dates. During time of impact, RackConnect v3 customers who are also using Arista VTEP may have experienced drops in VXLAN traffic. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: RackConnect (RackConnect V3 issues with Arista VTEP VXLAN traffic.)

Unresolved: On 15 September 2016 in the DFW Region and on 21 September 2016 in the IAD region, Rackspace identified an issue affecting RackConnect v3 and our engineers are working to resolve it as quickly as possible. Currently, some customers using RackConnect v3 who are also using Arista VTEP may experience drops in VXLAN traffic.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss | LON Region)

Unresolved: Engineers are in the process of adding new proxies to the Cloud Files environment to be able to process new requests more efficiently. Engineers report that the proposed changes should improve the monitoring and stability of the Cloud Files environment in the LON Region. During this time, affected customers may experience timeouts or slow loading times when interacting with Cloud Files.

Rackspace
Incident: Cloud Queues (Cloud Queues | 500 Errors on Cloud Queues over ServiceNet | IAD Region)

Resolved: On 22 September 2016, starting at approximately 00:49 CDT, engineers worked to resolve issues which affected Cloud Queues in the IAD Region. Engineers determined at 03:18 CDT that the API errors have resolved without intervention and logs show that expected responses (200s) were coming in. Engineers continue to monitor the environment for stability.

Rackspace
Incident: Cloud Queues (Cloud Queues | 500 Errors on Cloud Queues over ServiceNet | IAD Region)

Unresolved: On 22 September 2016, starting at approximately 00:49 CDT, engineers became aware of issues affecting Cloud Queues in the IAD Region. Engineers have been engaged and are investigating the issue. During this time, customers may see repeated '500 Errors' when contacting Cloud Queues over ServiceNet.

Rackspace
Incident: Cloud Sites (Cloud Sites | Maintenance Impact - Cloud Sites Inaccesible | ORD Region)

Resolved: The issue affecting Cloud Sites databases has been confirmed resolved. Thank you or your patience.

Rackspace
Incident: Cloud Sites (Cloud Sites | Maintenance Impact - Cloud Sites Inaccesible | ORD Region)

Unresolved: The issue affecting Cloud Sites databases has been confirmed resolved. Thank you or your patience.

Rackspace
Incident: Cloud Sites (Cloud Sites | Maintenance Impact - Cloud Sites Inaccesible | ORD Region)

Unresolved: On 21 September 2016, at approximately 03:20 CDT, Cloud Sites engineers reported that a scheduled maintenance which affected Cloud Sites went out of scope. Engineers determined that a database node was full down and needed go beyond the maintenance window to restore. Engineers successfully restored the database at 05:44 CDT. Currently, engineers continue to monitor the stability of the environment. During time of impact, customers may have not been able to access their Cloud Sites' databases in the affected environments.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Loss of Network Connectivity | DFW Region)

Resolved: On 21 September 2016, starting at approximately 01:30 CDT, engineers began work to resolve issues affecting Cloud Servers in the DFW Region. Engineers determined that a scheduled maintenance affected PublicNet and ServiceNet for a subset of Cloud Servers in the DFW Region. Engineers restored service at 02:17 CDT. During time of impact, a subset of customers in the DFW Region may have experienced loss of connectivity with ServiceNet and PublicNet, experienced high latency and packet loss, and my find their Cloud Block Storage devices in read-only status.

Rackspace
Incident: Control Panels (Cloud Billing | Unable to Access Transaction History | All Regions)

Resolved: On 21 September 2016, at approximately 02:19 CDT, engineers worked to resolve issues which affected Cloud Billing. Engineers resolved the issue as of 04:38 CDT. During time of impact, customers may have experienced difficulty accessing customer transaction history using customer portals.

Rackspace
Incident: Cloud Sites (Cloud Sites | Maintenance Impact - Cloud Sites Inaccesible | ORD Region)

Unresolved: On 21 September 2016, at approximately 03:20 CDT, Cloud Sites engineers report that a scheduled maintenance affecting Cloud Sites has gone out of scope. During this time, a subset of customers in the ORD Region may not be able to access Cloud Sites in the affected environment.

Rackspace
Incident: Control Panels (Cloud Billing | Unable to Access Transaction History | All Regions)

Unresolved: On 21 September 2016, starting at approximately 01:00 CDT, engineers began work to resolve issues affecting Cloud Billing. During this time, customers may experience difficulty accessing customer transaction history using Customer Cloud Control Panel.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Loss of Network Connectivity | DFW Region)

Unresolved: On 21 September 2016, starting at approximately 01:30 CDT, engineers began work to resolve issues affecting Cloud Servers in the DFW Region. During this time, a subset of customers in the DFW Region may experience loss of connectivity with ServiceNet and PublicNet, and my find their Cloud Block Storage devices in read-only status.

Rackspace
Incident: Rackspace Email (Cloud Office Rackspace Email | Unable to Access Webmail | All regions)

Resolved: On 20 September 2016, from 11:24 to 11:55 CDT, engineers worked to resolve an issue affecting Rackspace Email in all regions. During this time, customers may have experienced latency when attempting to access the login portal and a portion of customers may have been unable to access webmail. Customers were able to access their mail via the IMAP or/and the POP protocol. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud DNS (Resol;ved: Cloud DNS API Issues | All Regions)

Resolved: On 20 September 2016, between 11:10 CDT and 12:27 CDT, engineers worked to resolve an issue affecting Cloud DNS. During the time of impact, customers may have experienced intermittent errors or latent requests to the Cloud DNS API, affecting creates/reads/updates/deletes. This issue did not effect DNS resolution.

Rackspace
Incident: Cloud DNS (Cloud DNS API Issues | All Regions)

Unresolved: Our engineers are aware of an issue affecting Cloud DNS. At this time customers may intermittent errors or latent requests to the Cloud DNS API, affecting creates/reads/updates/deletes. This does not have an effect on DNS resolution.

Rackspace
Incident: Rackspace Email (Cloud Office Rackspace Email | Unable to Access Webmail | All regions)

Unresolved: On 21 September 2016, at 11:24 CDT, engineers were alerted to an issue affecting Rackspace Email in all regions. At this time, engineers have engaged developers have been engaged and are currently troubleshooting the issue. During this time, customers may experience latency when attempting to access the login portal, however, customers are unable to access webmail. Customers are able to access their mail via the IMAT or/and the POP protocol. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | NextGen Cloud Servers API Degradation | LON Region)

Resolved: On 20 September 2016, between 07:30 UTC and 10:45 UTC , engineers worked to resolve an issues affecting the Cloud Servers NextGen API in the LON Region. During time of impact, a subset of customers may have experienced the inability to perform API actions on their Standard Flavor servers.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss | LON Region)

Unresolved: Engineers continue work to resolve issues affecting Cloud Files in the LON Region. During this time, affected customers may experience timeouts or slow loading times when interacting with their Cloud Files environments.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss | LON Region)

Unresolved: On 20 September 2016, at 09:30 UTC , Cloud Engineers started investigating intermittent Cloud Files API issues in the LON Region. During this time, affected customers may experience 503 errors or increased loading times when interacting with Cloud Files.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | NextGen Cloud Servers API Degradation | LON Region)

Unresolved: On 20 September 2016, at approximately 07:30 UTC , engineers began work to resolve issues affecting the Cloud Servers NextGen API in the LON Region. During this time, a subset of customers may experience the inability to perform API actions on their Standard Flavor servers.

Rackspace
Incident: Cloud Sites (Cloud Sites | Cloud Sites FTP Connections Degraded | All Regions)

Resolved: On 19 September 2016, at approximately 19:15 CDT, engineers began work to resolve issues which affected Cloud Sites FTP. Engineers reported FTP was degraded and connections failed. Engineers restored service at 21:38 CDT. During time of impact, some users may have experienced issues connecting to their Cloud Sites using FTP.

Rackspace
Incident: Cloud Sites (Cloud Sites | Cloud Sites FTP Connections Degraded | All Regions)

Unresolved: On 19 September 2016, at approximately 21:05 CDT, engineers began work to resolve issues affecting Cloud Sites FTP. Engineers report FTP is degraded and connections are failing. During this time, some users may experience issues connecting to their Cloud Sites using FTP.

Rackspace
Incident: Cloud Sites (Cloud Sites | Cloud Sites FTP Connections Degraded | All Regions)

Unresolved: On 19 September 2016, at approximately 21:05 CDT, engineers began work to resolve issues affecting Cloud Sites FTP. Engineers report FTP is degraded and connections are failing. During this time, some users may experience issues connecting to their Cloud Sites using FTP.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss | LON and DFW Regions)

Unresolved: Beginning at approximately 13:20 CDT, engineers began working to resolve an issue affecting Cloud Files in the LON region. During this time, affected customers may experience 503 errors or increased loading times when interacting with Cloud Files.

Rackspace
Maintenance: Cloud Sites | DFW MariaDB Maintenance | Sep 22 @ 10pm

Cloud Sites Engineers will be performing maintenance on mariadb-077.wc2.dfw3 and mariadb-078.wc2.dfw3 to resolve device failures on the host(s). Maintenance is expected to last up to 30 minutes. Databases on these hosts will be placed into read-only for the duration of the maintenance. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Control Panels (Cloud DNS | Intermittent DNS Errors | All Regions)

Resolved: On 19 September 2016, starting at approximately 01:41 CDT, engineers began work to resolve issues which affected Cloud DNS. Engineers restored service at 03:08 CDT. During time of impact, a subset of customers may have experienced "500 Errors" when updating DNS records via the customer control panel or API

Rackspace
Incident: Cloud DNS (Cloud DNS | Intermittent 500 Errors | All Regions)

Resolved: On 19 September 2016, starting at approximately 01:41 CDT, engineers began work to resolve issues which affected Cloud DNS. Engineers restored service at 03:08 CDT. During time of impact, a subset of customers may have experienced "500 Errors" when updating DNS records via the customer control panel or API

Rackspace
Incident: Control Panels (Cloud DNS | Intermittent DNS Errors | All Regions)

Unresolved: On 19 September 2016, starting at approximately 01:41 CDT, engineers began work to resolve issues affecting DNS. During this time a subset of customers may experience "500 Errors" when updating DNS records via the customer control panels or API.

Rackspace
Incident: Cloud DNS (Cloud DNS | Intermittent 500 Errors | All Regions)

Unresolved: On 19 September 2016, starting at approximately 01:41 CDT, engineers began work to resolve issues affecting Cloud DNS. During this time a subset of customers may experience "500 Errors" when updating DNS records via the customer control panel or the Cloud DNS API.

Rackspace
Incident: Cloud Sites (Cloud Sites | Read Only Mode | DFW)

Resolved: On 18 September 2016, starting at approximately 20:11 CDT, engineers began work to resolve issues affecting Cloud Sites in the DFW Region. Engineers determined that customers' databases went into read-only mode. Cloud Sites engineers restored full service at 22:42 CDT. During time of impact, customers may have found their Cloud Sites in read-only mode; Cloud Sites may have also generated errors when performing database transactions.

Rackspace
Incident: Cloud Sites (Cloud Sites | Read Only Mode | DFW)

Unresolved: Our engineers are aware of an issue affecting Cloud Sites in the DFW region and are working to resolve the problem. During this time, a subset of Cloud Sites customers may find their databases in read only mode.If you have any further questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss | LON and DFW Regions)

Unresolved: The Cloud Files environment in the LON region remains stable. Engineers continue to monitor for further impact. During this time, a small portion of Cloud Files customers in the LON region may experience delays when attempting to serve origin requests to the Cloud Files CDN.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: On 17 September 2016, at 18:20 UTC to 18 September 2016, at 02:30 CDT Engineers worked to resolve a disruption in Cloud Files in the LON region. During this time, a small portion of Cloud Files customers in the LON region may have experienced delays when attempting to serve origin requests to the Cloud Files CDN. Additionally, some Cloud Files users in the region may have experienced longer than normal connection times. Engineers continue to monitor the environment for stability.

Rackspace
Incident: Cloud Sites (Issues with HTTPS access | ORD1)

Resolved: Engineers resolved this issue at 17:53 CDT. HTTPS should again be accessible.

Rackspace
Incident: Cloud Sites (Issues with HTTPS access | ORD1)

Unresolved: On 17 September 2016, at 16:40 CDT, Rackspace is aware of an issue affecting Cloud Sites in our ORD1 data center and our engineers are working to resolve it as quickly as possible. Currently some customers will be unable to access their sites by https; http is unaffected. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: As of 20:15 UTC Engineers have made progress towards resolution and customers may see improvement in performance. During this time, a small portion of Cloud Files customers in the LON region may experience delays when attempting to serve origin requests to the Cloud Files CDN. Additionally some Cloud Files users in the region may continue to experience longer than normal connection times. Engineers continue to work towards a complete resolution of the issue.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: At 18:20 UTC Engineers became aware of a recurrence in the disruption to Cloud Files in the LON region. During this time, a small portion of Cloud Files customers in the LON region may experience delays when attempting to serve origin requests to the Cloud Files CDN. Additionally some Cloud Files users in the region may continue to experience longer than normal connection times. Engineers are actively troubleshooting the issue.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: Engineers have removed rate limiting for Cloud Files in the LON region, with the exception of a problematic source IP which has been limited to 250m. Connections are handling upwards of 10,500 requests, which is a positively increasing trend. All KPIs appear to be healthy at this time. Engineers will continue to monitor the issue throughout the rest of the evening. During this time, a small portion of Cloud Files customers in the LON region may experience delays when attempting to serve origin request to the Cloud Files CDN. Additionally some Cloud Files users in the region may continue to experience longer than normal connection times.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: On 16 September 2016, at approximately 08:00 CDT, engineers became aware of an issue affecting Cloud Files in our LON3 data center. Engineers determined that Cloud Files in the DFW1 and ORD1 data centers were impacted as well. Engineers resolved the issues within DFw1 and ORD1 at 11:09 CDT. Engineers continue to work towards stabilizing the LON region and resolve the issue. During this time, Cloud Files customers in London may continue to experience delays when attempting to serve origin request to the Cloud Files CDN. Additionally some Cloud Files users in the region may continue to experience longer than normal connection times. If you have any other questions, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: On 16 September 2016, at approximately 08:00 CDT, Rackspace became aware of an issue affecting Cloud Files in our LON3 data center and our engineers are working to resolve it as quickly as possible. Engineers determined that Cloud Files in the DFW 1 and ORD1 data center were being impacted as well. As of 11:09 CDT, engineers confirmed that Cloud Files in DF1 and ORD1 are currently operational. As of 16:09 CDT, engineers are working to stabilize the environment and have noted an improvement in response times for Cloud Files in the LON3 region. During this time, customers may receive delays when attempting to upload and downloading files via the API in the LON3 region. Customers attempting to create new Cloud Orchestration stacks may be unable to access the catalog in LON3, and may see latency in creating stacks that contain Cloud Files options in DFW. Customers utilizing Cloud Backup in LON3 may experience significant delays or dropped connections during this time. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Files Packet Loss | LON3)

Resolved: On 16 September 2016, at approximately 08:00 CDT, Rackspace became aware of an issue affecting Cloud Files in our LON3 data center and our engineers are working to resolve it as quickly as possible. Engineers determined that Cloud Files in the DFW 1 and ORD1 data center were being impacted as well. As of 11:09 CDT, engineers confirmed that Cloud Files in DF1 and ORD1 are currently operational. As of 13:50 CDT, engineers have confirmed that Cloud Server builds in LON3 are working at this time. During this time, customers may receive delays when attempting to upload and downloading files via the API in the LON3 region. Customers attempting to create new Cloud Orchestration stacks may be unable to access the catalog in LON3, and may see latency in creating stacks that contain Cloud Files options in DFW. Customers utilizing Cloud Backup in LON3 may experience significant delays or dropped connections during this time. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: On 16 September 2016, at approximately 08:00 CDT, Rackspace became aware of an issue affecting Cloud Files in our LON3 data center and our engineers are working to resolve it as quickly as possible. Engineers determined that Cloud Files in the DFW 1 and ORD1 data center were being impacted as well. As of 11:09 CDT, engineers confirmed that Cloud Files in DF1 and ORD1 are currently operational. As of 13:50 CDT, engineers have confirmed that Cloud Server builds in LON3 are working at this time. During this time, customers may receive delays when attempting to upload and downloading files via the API in the LON3 region. Customers attempting to create new Cloud Orchestration stacks may be unable to access the catalog in LON3, and may see latency in creating stacks that contain Cloud Files options in DFW. Customers utilizing Cloud Backup in LON3 may experience significant delays or dropped connections during this time. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Files Packet Loss | LON3)

Unresolved: On 16 September 2016, at approximately 08:00 CDT, Rackspace became aware of an issue affecting Cloud Files in our LON3 data center and our engineers are working to resolve it as quickly as possible. Engineers determined that Cloud Files in the DFW 1 and ORD1 data center were being impacted as well. As of 11:09 CDT, engineers confirmed that Cloud Files in DF1 and ORD1 are currently operational. As of 13:20 CDT, engineers have identified Cloud Server images are impacted by the Cloud Files issue in LON. During this time, customers may receive delays when attempting to upload and downloading files via the API in the LON3 region. Customers attempting to create new Cloud Orchestration stacks may be unable to access the catalog in LON3, and may see latency in creating stacks that contain Cloud Files options in DFW. Customers utilizing Cloud Backup in LON3 may experience significant delays or dropped connections during this time. Customers may be unable to build servers from custom images at this time. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: On 16 September 2016, at approximately 08:00 CDT, Rackspace became aware of an issue affecting Cloud Files in our LON3 data center and our engineers are working to resolve it as quickly as possible. Engineers determined that Cloud Files in the DFW 1 and ORD1 data center were being impacted as well. As of 11:09 CDT, engineers confirmed that Cloud Files in DF1 and ORD1 are currently operational. As of 13:20 CDT, engineers have identified Cloud Server images are impacted by the Cloud Files issue in LON. During this time, customers may receive delays when attempting to upload and downloading files via the API in the LON3 region. Customers attempting to create new Cloud Orchestration stacks may be unable to access the catalog in LON3, and may see latency in creating stacks that contain Cloud Files options in DFW. Customers utilizing Cloud Backup in LON3 may experience significant delays or dropped connections during this time. Customers may be unable to build servers from custom images at this time. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: On 16 September 2016, at approximately 08:00 CDT, Rackspace became aware of an issue affecting Cloud Files in our LON3 data center and our engineers are working to resolve it as quickly as possible. Engineers determined that Cloud Files in the DFW 1 and ORD1 data center were being impacted as well. As of 11:09 CDT, engineers confirmed that Cloud Files in DF1 and ORD1 are currently operational. During this time, customers may receive delays when attempting to upload and downloading files via the API in the LON3 region. Customers attempting to create new Cloud Orchestration stacks may be unable to access the catalog in LON3, and may see latency in creating stacks that contain Cloud Files options in DFW. Customers utilizing Cloud Backup in LON3 may experience significant delays or dropped connections during this time.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: On 16 September 2016, at approximately 08:00 CDT, Rackspace became aware of an issue affecting Cloud Files in our LON3 data center and our engineers are working to resolve it as quickly as possible. During this time, customers may receive delays when attempting to upload and downloading files via the API. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss| LON & DFW Regions)

Unresolved: On 16 September 2016, at approximately 08:00 CDT, Rackspace became aware of an issue affecting Cloud Files in our LON & DFW regions and our engineers are working to resolve it as quickly as possible. During this time, customers are receiving errors when attempting to upload files via the API. If you have any other questions or concerns, please contact a member of your support team.�

Rackspace
Incident: Cloud Block Storage (Resolved: Cloud Block Storage | Storage Nodes Unavailable | LON Region)

Resolved: On 16 September 2016, between 13:28 UTC to 13:54 UTC , engineers worked to resolve issues which affected Cloud Block Storage in the LON Region. During time of impact, a subset of customers in the LON Region may have experienced difficulty accessing their CBS volumes or find their volumes in "read-only" mode.

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Storage Nodes Unavailable | LON Region)

Unresolved: On 16 September 2016 at approximately 08:44, our engineers became aware of issue impacting Cloud Block Storage and are working to resolve the issue. We will provide additional information as it becomes available.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss | LON Region)

Resolved: Hello, On 15 September 2016, from 18:10 UTC to 22:46 UTC engineers worked to resolve an issue affecting Cloud Files in the LON region. The team determined that this was being caused by excessive amounts traffic across the Cloud Files network and overloading the load balancers. During the affected time, some customers may have noticed latency, packet loss and possibly errors in creating new instances or actions for Cloud Files, Cloud Backup, Cloud Orchestration or Glean. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud Backup (Cloud Backup | Packet Loss | LON Region)

Resolved: Hello, On 15 September 2016, from 18:10 UTC to 22:46 UTC engineers worked to resolve an issue affecting Cloud Files in the LON region. The team determined that this was being caused by excessive amounts traffic across the Cloud Files network and overloading the load balancers. During the affected time, some customers may have noticed latency, packet loss and possibly errors in creating new instances or actions for Cloud Files, Cloud Backup, Cloud Orchestration or Glean. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Packet Loss | LON Region)

Resolved: Hello, On 15 September 2016, from 18:10 UTC to 22:46 UTC engineers worked to resolve an issue affecting Cloud Files in the LON region. The team determined that this was being caused by excessive amounts traffic across the Cloud Files network and overloading the load balancers. During the affected time, some customers may have noticed latency, packet loss and possibly errors in creating new instances or actions for Cloud Files, Cloud Backup, Cloud Orchestration or Glean. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss | LON Region)

Unresolved: Engineers confirm that there is now no noticeable impact to the LON Cloud Files environment and the team is continuing to monitor the situation for full stability.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Packet Loss | LON Region)

Unresolved: Rackspace is aware of an issue affecting Cloud Files in our LON region. This is also impacting access to server images. Our engineers have identified the issue and are working to resolve it as quickly as possible. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Backup | Packet Loss | LON Region)

Unresolved: Rackspace is aware of an issue affecting Cloud Files in our LON region. This is also impacting that use Cloud Backups. Our engineers have identified the issue and are working to resolve it as quickly as possible. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss | LON Region)

Unresolved: Rackspace is aware of an issue affecting Cloud Files in our LON region. Our engineers have identified the issue and are working to resolve it as quickly as possible. During this time customers may be experiencing issues when attempting to upload files via the API. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Files (Cloud Files | Packet Loss | LON Region)

Unresolved: Rackspace is aware of an issue affecting Cloud Files in our LON region and our engineers are working to resolve it as quickly as possible. During this time, customers are receiving errors when attempting to upload files via the API. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Cloud Servers Downtime | DFW2)

Resolved: On 14 September 2016, from approximately 00:06 CDT to 02:52 CDT, engineers worked to resolve issues affecting Cloud Servers in the DFW2 data center. During time of impact, a subset of customers in the DFW Region may have had Cloud Server downtime or had difficulty accessing their Cloud Servers.

Rackspace
Incident: Cloud Servers (First Generation) (Cloud Servers | Cloud Servers Downtime | DFW Region)

Resolved: Engineers determined that FirstGen servers were not affected.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Cloud Servers Downtime | DFW2)

Unresolved: Jan Santos Customer Approved Comments 2016-09-14 01:31:30 Hello, On 14 September 2016, at approximately 00:06 CDT, engineers began work to resolve issues affecting Cloud Servers in the DFW2 data center.Engineers are continuing work to resolve the issue. During this time, a subset of customers in the DFW Region may have Cloud Server downtime or have difficulty accessing their Cloud Servers. Updates to follow as more information becomes available.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Cloud Servers Downtime | DFW2)

Unresolved: On 14 September 2016, at approximately 00:06 CDT, engineers began work to resolve issues affecting Cloud Servers in the DFW2 data center. Engineers are continuing work to resolve the issue. During this time, a subset of customers in the DFW Region may have Cloud Server downtime or have difficulty accessing their Cloud Servers. Updates to follow as more information becomes available.

Rackspace
Incident: Cloud Servers (First Generation) (Cloud Servers | Cloud Servers Downtime | DFW Region)

Unresolved: Engineers are currently investigating issues affecting a subset of Cloud Servers in the DFW Region. During this time, customers may be experiencing Cloud Server downtime. For more information, please contact a member of your support team.

Rackspace
Incident: Rackspace Email (Resolved: Webmail Connectivity)

Resolved: Engineers resolved the Webmail connectivity issues at approximately 17:21 CDT. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Rackspace Email (Webmail Connectivity)

Unresolved: Engineers are continuing work to resolve the Webmail issue. For further updates and current information, please visit status.apps.rackspace.com

Rackspace
Incident: Rackspace Email (Webmail Connectivity)

Unresolved: Our engineers have implemented a change to resolve the connectivity issues. Affected users may still experience degraded page loads when attempting to access hosted email however that will subside here shortly. We will continue to monitor the system and provide further updates as they become available.

Rackspace
Incident: Rackspace Email (Webmail Connectivity)

Unresolved: Engineering has identified the issue for Webmail connectivity. We are actively working towards a resolution. Affected users will experience a lack of connectivity when attempting to access email via the web. Mail clients, such as Outlook and mobile devices are not impacted and are recommended to access your hosted email during the incident. Mail delivery is not impacted.

Rackspace
Incident: Control Panels (Resolved: MyRackspace Customer Portal Issues)

Resolved: As of 16:30 CDT, all portal functions were accessible and completing as expected.

Rackspace
Incident: Control Panels (MyRackspace Customer Portal Issues)

Unresolved: On 12 September 2016, at approximately 15:30 CDT, engineers began working to resolve an issue impacting the MyRackspace customer portal. During this time, customers may be unable to view data in the MyRack portal, including, but not limited to Cloud consolidation, transactions, device upgrades, contracts (e-signature), payments, invoice PDF and paperless sign up. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: MS Exchange 2010 (Cloud Office - Exchange | MEX05 Database Issue | ORD2)

Resolved: On 07 September 2016, at 13:45 CDT, Rackspace engineers became aware of an issue impacting the MEX05 environment in our ORD1 data center. Engineers found the issue to be with a mailstore database, and began restoring mailboxes to a new database to allow the reception of incoming emails. On 08 September 2016, at 23:37 CDT, engineers completed restoring the mailboxes, resolving the issue. During the time of impact, a portion of customers may have experienced issues accessing a portion of their Inboxes. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Cloud Block Storage Nodes Unavailable | LON Region)

Resolved: Engineers restored Cloud Block Storage services at 11:39 UTC

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Cloud Block Storage Nodes Unavailable | LON Region)

Unresolved: On 12 September 2016, at approximately 10:35 UTC , engineers began work to resolve issues affecting Cloud Block Storage in the LON Region. During this time, a subset of customers in the LON Region may experience difficulty accessing their CBS volumes or find their volumes in "read-only" mode.

Rackspace
Incident: MS Exchange 2010 (Cloud Office - Exchange | MEX05 Database Issue | ORD2)

Unresolved: On 07 September 2016, at 13:45 CDT, Rackspace engineers became aware of an issue impacting the MEX05 environment in our ORD1 data center and are working to resolve it as quickly as possible. Engineers mounted a dial tone database to allow affected customers to receive incoming emails. During this time, customers are unable to access previous messages, but customers are able use their mailbox while the full data restore is taking place. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Maintenance: Cloud Networks | All Regions | Starting Monday, September 12, 2016

Rackspace Engineering will be performing a scheduled maintenance for our Cloud Networks in all regions at the following day and time: SYD – Sept 12, 2016 9:00 AM CDT to Sept 13, 2016 1:00 PM CDT (Sept 13, 2016 12:00 AM ASET to Sept 14, 2016 4:00 AM ASET) DFW – Sept 12, 2016 10:00 PM CDT to Sept 13, 2016 4:00 AM CDT HKG – Sept 13, 2016 9:00 AM CDT to Sept 14, 2016 1:00 PM CDT (Sept 13, 2016 10:00 PM HKT to Sept 14, 2016 2:00 AM HKT) LON - Sept 13, 2016 5:00 PM CDT to Sept 13, 2016 9:00 PM CDT (Sept 13, 2016 11:00 PM BST to Sept 13, 2016 3:00 AM BST) ORD - Sept 13, 2016 10:00 PM CDT to Sept 14, 2016 4:00 AM CDT IAD - Sept 14, 2016 10:00 PM CDT to Sept 15, 2016 4:00 AM CDT (Sept 14, 2016 11:00 PM EDT to Sept 15, 2016 5:00 AM EDT) For approximately 30 minutes, this maintenance will impact customers’ ability to utilize the API directly as well as make networking changes through the Cloud Servers account via Reach (mycloud.rackspace.com). This means that new Cloud Servers builds will go into error and new Cloud Networks creation requests will fail while Neutron related services are unavailable. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: MS Exchange 2010 (Cloud Office - Exchange | MEX05 Database Issue | ORD2)

Unresolved: On 07 September 2016, at 13:45 CDT, Rackspace engineers became aware of an issue impacting the MEX05 environment in our ORD1 data center and are working to resolve it as quickly as possible. During this time, customers who are behind the database are unable to access their mailboxes. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Control Panels (Expired SSL Cert)

Resolved: On 5 September 2016, from 19:30 CDT to 22:01 CDT, engineers worked to resolve issues which affected the MyRackspace customer portal. During time of impact, customers may have experienced errors when accessing the MyRackspace customer portal. For further assistance, please contact a member of your support team.

Rackspace
Incident: Control Panels (Expired SSL Cert)

Unresolved: On 5 September 2016, at 19:30 CDT engineers identified an issue with an Identity related SSL cert. Currently, customers may experience errors when attempting to log in to the Portal. Please contact your support team if you have any further questions.

Rackspace
Incident: RackConnect (Cloud Networks | Intermittent Cloud Networks Connectivity | ORD1)

Resolved: On 3 September 2016, from 13:26 CDT to 17:20 CDT, Cloud Engineers worked to resolve and issue which affected Cloud Networks in the ORD1 data center. During time of impact, customers may have experienced high latency, packet loss, or loss of connectivity with Cloud Networks or RackConnect v3.

Rackspace
Incident: Cloud Networks (Cloud Networks | Intermittent Cloud Networks Connectivity | ORD1)

Resolved: On 3 September 2016, from 13:26 CDT to 17:20 CDT, Cloud Engineers worked to resolve and issue which affected Cloud Networks in the ORD1 data center. During time of impact, customers may have experienced high latency, packet loss, or loss of connectivity with Cloud Networks or RackConnect v3.

Rackspace
Incident: RackConnect (Cloud Networks | Intermittent Cloud Networks Connectivity | ORD1)

Unresolved: On 3 September 2016, starting at approximately 13:26 CDT, Cloud Engineers began work to resolve issues affecting Cloud Networks in the ORD1 Data Center. During this time, customers may experience high latency, packet loss, or loss of connectivity with Cloud Networks or RackConnect v3.

Rackspace
Incident: Cloud Networks (Cloud Networks | Intermittent Cloud Networks Connectivity | ORD1)

Unresolved: On 3 September 2016, starting at approximately 13:26 CDT, Cloud Engineers began work to resolve issues affecting Cloud Networks in the ORD1 Data Center. During this time, customers may experience high latency, packet loss, or loss of connectivity with Cloud Networks or RackConnect v3.

Rackspace
Incident: RackConnect (Cloud Networks | Intermittent Cloud Networks Connnectivity | ORD1)

Unresolved: On 3 September 2016, starting at approximately 14:15 CDT, Cloud Engineers began work to resolve issues affecting Cloud Networks in the ORD1 Data Center. During this time, customers may experience high latency, packet loss, or loss of connectivity with Cloud Networks or RackConnect v3.

Rackspace
Incident: Cloud Networks (Cloud Networks | Intermittent Cloud Networks Connnectivity | ORD1)

Unresolved: On 3 September 2016, starting at approximately 14:15 CDT, Cloud Engineers began work to resolve issues affecting Cloud Networks in the ORD1 Data Center. During this time, customers may experience high latency, packet loss, or loss of connectivity with Cloud Networks or RackConnect v3.

Rackspace
Incident: Cloud Servers (Next Generation) (Resolved: Cloud Servers | Interminttent Connectivity Issues | LON Region)

Resolved: Between 31 August 2016, at 11:00 UTC and 9:43 UTC , on 1 September 2016, engineers worked to resolve an issue affecting a portion Cloud Block Storage, Cloud Datastores and Cloud Servers customers in the LON region. During time of impact, a portion of customers may have experienced packet loss and latency between their affected Cloud Servers, Cloud Block Storage volumes and Cloud Databases.

Rackspace
Maintenance: Cloud Sites | DFW & ORD Windows Maintenance | Sept 5 - 16

At 2am each night of the maintenance Cloud Sites Engineers will be performing maintenance on the Windows/IIS hosting platforms to apply routine patches issued by Microsoft. The length of each maintenance will vary depending on the node. There should be no visible ill effects, however, it is possible that a server being rebooted message may show up in some applications logs or sessions may be lost due to a node rebooting. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Cloud Sites | ORD Maintenance | Sept 7 - 21

At 9pm each day Cloud Sites Engineers will be performing maintenance on Cloud sites Databases to upgrade from MySQL 5.1 to MariaDB 10.1. The schedule for each host is below: Wed, Sept 7 mysql51-001-021 Thur, Sept 8 mysql51-022-041 Tue, Sept 13 mysql51-042-061 Wed, Sept 14 mysql51-062-081 Thur, Sept 15 mysql51-082-101 Tue, Sept 20 mysql51-102-122 Wed, Sept 21 mysql51-122-130 Maintenance is expected to last up to 7 hours each night (ending at 4am) to allow time for the switchover. There is little to no downtime expected for each server, however, there is the possibility that a databases could be in read only mode for an extended time. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Interminttent Connectivity Issues | LON Region)

Unresolved: Engineers are monitoring intermittent connectivity issues affecting Cloud Servers in the LON Region. Please contact a member of your support team for further assistance.

Rackspace
Incident: Cloud Databases (New build, restore, and resize errors.)

Resolved: Engineers have confirmed this issue as resolved.

Rackspace
Incident: Cloud Databases (New build, restore, and resize errors.)

Unresolved: Engineers have confirmed that the affected operations are currently working and are monitoring to ensure stability.

Rackspace
Incident: Cloud Databases (New build, restore, and resize errors.)

Unresolved: Hello, Rackspace is aware of an issue affecting Cloud Datastores in our IAD data center region and our engineers are working to resolve it as quickly as possible. Some customers may experience errors when attempting ne data base builds, restores, or resize actions. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud Databases (Resolved: Cloud Datastores | Data Disks in Read Only | ORD Region)

Resolved: On 31 August 2016, at 05:18 CDT, Cloud Datastores engineers were alerted to an issue affecting multiple data disks in the ORD region. Further investigation determined that affected data disks had gone into read only mode following a planned network maintenance. Engineers have restored read-write access to the affected data disks as of 07:28 CDT. If you have questions, please contact a member of your support team.

Rackspace
Incident: Cloud Databases (Cloud Datastores | Data Disks in Read Only | ORD Region)

Unresolved: Our engineers are aware of an issue affecting Cloud Databases in the ORD Region and are working to resolve the problem. During this time customers may have their data disks in read-only which may cause MySQL to crash or not come back gracefully after reboot.

Rackspace
Incident: Cloud Servers (Next Generation) ('503' Errors in Glance on Import/Export)

Resolved: Hello, From 26 August 2016, at 22:00, to 27 August 2016, at 11:40 CDT, engineers worked to resolve an issue affecting Cloud Servers in our IAD data center region. During the affected time some customers may have received '503' connection errors when attempting to import or export server images. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud Servers (Next Generation) ('503' Errors in Glance on Import/Export)

Unresolved: Hello, Rackspace is aware of an issue affecting Cloud Servers in the IAD region and our engineers are working to resolve it as quickly as possible. Some customers may experience '503' errors and be unable to import or export sever images through Glance. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud Backup (Cloud - Back Up | Control Panel Issues | All Regions)

Resolved: On 25 August 2016, between 07:40 and 10:09 CDT, engineers worked to resolve an issue impacting the Cloud Control Panel in ORD, IAD, DFW, HKG, and SYD regions. Engineers did a rolling reboot of all webheads outside the load balancer and then re-attached the webheads to the load balancer to resolve the issue. During the time of impact, customers may have experienced errors when trying to access the back up section of the Cloud Control Panel.

Rackspace
Incident: Cloud Backup (Cloud - Back Up | Control Panel Issues | All Regions)

Unresolved: On 25 August 2016, between 07:40 and 10:09 CDT, engineers worked to resolve an issue impacting the Cloud Control Panel in ORD, IAD, DFW, HKG, and SYD regions. Engineers did a rolling reboot of all webheads outside the load balancer and then re-attached the webheads to the load balancer to resolve the issue. At this time, engineers continue to monitor the environment. During the time of impact, customers may have experienced errors when trying to access the back up section of the Cloud Control Panel. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud - Back Up | Control Panel Issues | All Regions)

Unresolved: On 25 August 2016, at 07:40 CDT, engineers were alerted to an issue impacting the Cloud Control Panel in all regions. Engineers are working to resolve the issue. During this time, customers may experience service unavailable errors when trying to access the back up section of the Cloud Control Panel. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud - Back Up | Control Panel Issues | All Regions)

Unresolved: On 25 August 2016, at 07:40 CDT, engineers were alerted to an issue impacting the Cloud Control Panel in all regions. Engineers are working to resolve the issue. During this time, customers may experience errors when trying to access the back up section of the Cloud Control Panel. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Sites (HTTPS not resolving in DFW3 WC2)

Resolved: As of 11:52am this issue has been fully resolved.

Rackspace
Incident: Cloud Sites (HTTPS not resolving in DFW3 WC2)

Unresolved: As of 11:05am Cloud Sites Engineers have resolved the SSL resolution issue. We are continuing to monitor the ensure full resolution of the problem. Thank you for your patience.

Rackspace
Incident: Cloud Sites (HTTPS not resolving in DFW3 WC2)

Unresolved: Cloud Sites in DFW3 WC2 are currently experiencing SSL resolution failure on sites using SSL certificates. Sites may not resolve at all or will have a privacy warning that the certificate is invalid. Engineers are currently investigating the situation and will resolve the issue as soon as possible. If you have any further questions please feel free to contact a member of our support team.

Rackspace
Incident: Cloud Monitoring (Cloud - Rackspace Monitoring | Cloud Monitoring 503 Errors | All Regions)

Resolved: Engineer resolved the Rackspace Monitoring errors at 02:49 CDT.

Rackspace
Incident: Cloud Monitoring (Cloud - Rackspace Monitoring | Cloud Monitoring 503 Errors | All Regions)

Unresolved: 0n 23 August 2016, starting at approximately 19:00 CDT, Cloud Engineers became aware of an issue affecting Rackspace Monitoring and are working to resolve the problem. During this time, customers may experience intermittent errors when accessing Rackspace Monitoring API or via the Customer Portals.

Rackspace
Incident: Cloud Monitoring (Cloud - Rackspace Monitoring | Cloud Monitoring 503 Errors | All Regions)

Resolved: Engineers resolved the issue on 23 August 2016 at 00:50 CDT. During time of impact, customers may have experienced 503 Errors when trying to access the Rackspace Monitoring API or via the customer portals.

Rackspace
Incident: Cloud Monitoring (Cloud - Rackspace Monitoring | Cloud Monitoring 503 Errors | All Regions)

Unresolved: On 22 August 2016, at 22:09 CDT, Network Operations became aware of an issue affecting network connectivity in the DFW1 data center. Engineers are engaged and are working to resolve the issue. During this time, a subset of customers in the DFW region may experience, high latency, packet loss, and loss of connectivity.

Rackspace
Incident: Control Panels (Resolved: DNS Updates Unavailable | All Regions)

Resolved: Engineers have confirmed that DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API have been working normally since 19 August 2016. This issue is now considered resolved.

Rackspace
Maintenance: Cloud Sites | ORD Maintenance | Aug 22 @ 9pm

Cloud Sites Engineers will be performing maintenance on PHP nodes to prepare for deployment of PHP7 as a hosting option. While this is a background update to prepare for deploying PHP7 as a service option alongside PHP5.6, the changes should have no visible impact. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Rackspace Network Services | IAD | August 20th, 2016

Rackspace Network Services will be conducting a maintenance on our DNS core infrastructure on August 21st, 2016 from 00:00 to 04:00 EDT. Customers should expect a sub-second disruption to the Rackspace DNS cache.

Rackspace
Incident: Cloud DNS (Monitoring: DNS Updates Unavailable | All Regions)

Resolved: Hello, On 19 August 2016, from 16:30 to 19:00 CDT, engineers worked to resolve an issue affecting DNS. Customers will have been unable to make DNS changes, but DNS queries would resolve as normal. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud Backup (Backup Jobs Sticking in Queue)

Resolved: On 19 August 2016, at 18:00 CDT/23:00 UTC , engineers remediated the failure across all regions. The backup agent should automatically update to ensure the issue does not present going forward. Please note, some agents may have jobs stuck in a queued status - these jobs should be restarted to ensure they operate correctly. Help with restarting the agent can be found here: https://community.rackspace.com/products/f/25/t/7780.

Rackspace
Incident: Cloud DNS (Monitoring: DNS Updates Unavailable | All Regions)

Unresolved: Our engineers are aware of an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. DNS resolution is not impacted. If you have further questions, please contact a member of your support team.

Rackspace
Incident: Control Panels (Monitoring: DNS Updates Unavailable | All Regions)

Unresolved: Our engineers are aware of an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. DNS resolution is not impacted. If you have further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Sites (Resolved: Cloud Sites | Database Server Issues | ORD1)

Resolved: On 19 August 2016, at approximately 12:55 CDT, engineers were alerted to an issue affecting a MySQL database server in the ORD1 data center. Engineers have restored read-write access to the affected MySQL database server as of 14:00 CDT. During the time of impact, database instances on the affected server may have been unavailable or in read-only mode.

Rackspace
Incident: Cloud Sites (Cloud Sites | Database Server Issues | ORD1)

Unresolved: On 19 August 2016, at approximately 12:55 CDT, engineers were alerted to an issue affecting a MySQL database server in the ORD1 data center. At this time, database instances on the affected server may be unavailable or in read-only mode. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Backup (Backup Jobs Sticking in Queue)

Unresolved: On 18 August 2016, at 18:30 CDT, Engineers found that jobs were queuing and failing to execute for a portion of Cloud Backup customers in all region. Engineers are working to resolve the issue. During this time, a portion of Cloud Backup customers in all regions may experience stuck processes in preparing when attempting to perform a cleanup, backup or restore job. �If you have any further questions, please reach out to a member of support.�

Rackspace
Incident: Control Panels (Cloud Sites | Legacy Control Panel Unavailable | All Regions)

Resolved: The Cloud Sites Control Panel functionality has been restored.

Rackspace
Incident: Control Panels (Cloud Sites | Legacy Control Panel Unavailable | All Regions)

Unresolved: On 19 August 2016, at approximately 09:35 UTC , engineers became aware of an issue affecting the Cloud Sites Legacy Control Panel. Engineers are engaged and working to resolve the issue. At this time, customers browsing to managed.rackspacecloud.com will be unable to load the Cloud Sites Control Panel. If you have any questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Sites (Cloud Sites | Legacy Control Panel Unavailable | All Regions)

Resolved: Please follow the issue under Cloud Control Panels.

Rackspace
Incident: Cloud Sites (Cloud Sites | Legacy Control Panel Unavailable | All Regions)

Unresolved: On 19 August 2016, at approximately 09:35 UTC , engineers became aware of an issue affecting the Cloud Sites Legacy Control Panel. Engineers are engaged and working to resolve the issue. At this time, customers browsing to managed.rackspacecloud.com will be unable to load the Cloud Sites Control Panel. If you have any questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Backup (Backup Jobs Sticking in Queue)

Unresolved: On 18 August 2016, at 18:30 CDT, Engineers found that jobs were queuing and failing to execute for a portion of Cloud Backup customers in the ORD region. Engineers found that the cleanup process is getting stuck for some customers in the preparing stage, and needs to be manually relaunched. Engineers are investigating the cause of the issue. During this time, a portion of Cloud Backup customers in all regions may experience stuck processes in preparing when attempting to perform a cleanup job. Backup and Restore processes are unaffected at this time. If you have any further questions, please reach out to a member of support.

Rackspace
Incident: Cloud Backup (Backup Jobs Sticking in Queue)

Unresolved: Hello, Rackspace is aware of an issue affecting Cloud Backup in our ORD1 data center and our engineers are working to resolve it as quickly as possible. Currently, some customers may experience their backup jobs getting stuck in the queue and unable to finish. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Maintenance: Cloud Networks | All Regions | Starting Monday, August 22, 2016

Rackspace Engineering will be performing a scheduled maintenance for our Cloud Networks in all regions at the following day and time: SYD – Aug 22, 2016 9:00 AM CDT to Aug 22, 2016 1:00 PM CDT (Aug 23, 2016 12:00 AM ASET to Aug 23, 2016 4:00 AM ASET) DFW - Aug 22, 2016 10:00 PM CDT to Aug 23, 2016 4:00 AM CDT HKG - Aug 23, 2016 9:00 AM CDT to Aug 23, 2016 1:00 PM CDT (Aug 23, 2016 10:00 PM HKT to Aug 24, 2016 2:00 AM HKT) LON – Aug 23, 2016 5:00 PM CDT to Aug 23, 2016 9:00 PM CDT (Aug 23, 2016 11:00 PM BST to Aug 24, 2016 3:00 AM BST) ORD - Aug 23, 2016 10:00 PM CDT to Aug 24, 2016 4:00 AM CDT IAD - Aug 24, 2016 10:00 PM CDT to Aug 25, 2016 4:00 AM CDT (Aug 24, 2016 11:00 PM EDT to Aug 25, 2016 5:00 AM EDT) For approximately 30 minutes, this maintenance will impact customers’ ability to utilize the API directly as well as make networking changes through the Cloud Servers account via Reach (mycloud.rackspace.com). This means that new Cloud Servers builds will go into error and new Cloud Networks creation requests will fail while Neutron related services are unavailable. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Cloud Sites (FTP login)

Resolved: Cloud Sites Engineers have resolved the problem with FTP connections at this time. Thank you for your patience.

Rackspace
Incident: Cloud Sites (FTP login)

Unresolved: We have identified an issue causing intermittent connections for customers trying to access FTP in DFW3 WC2. Steps have been taken to resolve this as the day has progressed and, as of now, the connections should be stable. We are continuing to monitor the situation to ensure resolution. If you need immediate assistance, please contact a member of our support team by visiting us in live-chat or by calling 1.877.934.0407 or INTL +1.210.581.0407.

Rackspace
Incident: Cloud Sites (Cloud Sites FTP - Connection)

Resolved: Engineers have confirmed that all FTP connectivity issues have ceased. The incident will now be resolved.

Rackspace
Incident: Cloud Sites (Cloud Sites FTP - Connection)

Unresolved: We have received reports of intermittent FTP issues in regards to logging in. Customers may be unable to access their websites via FTP. We are currently investigating the situation and will resolve the issue as soon as possible. If you have any further questions please feel free to contact a member of our support team.

Rackspace
Incident: Cloud Sites (Cloud Sites FTP - Connection)

Unresolved: We have received reports of intermittent FTP issues in regards to logging in. Customers may be unable to access their websites via FTP. We are currently investigating the situation and will resolve the issue as soon as possible. If you have any further questions please feel free to contact a member of our support team.

Rackspace
Incident: Cloud Sites (Cloud Sites – FTP - Connection)

Unresolved: Affected Product: Cloud Sites – FTP Incident Summary: We have received reports of intermittent FTP issues in regards to logging in. Customers may be unable to access their websites via FTP. We are currently investigating the situation and will resolve the issue as soon as possible. If you have any further questions please feel free to contact a member of our support team.

Rackspace
Incident: Control Panels (Monitoring: DNS Updates Unavailable | All Regions)

Unresolved: Engineers have resolved the issue affecting DNS updates, however, they will continue to monitor for further impact.

Rackspace
Incident: Cloud DNS (Monitoring: DNS Updates Unavailable | All Regions)

Unresolved: Engineers have resolved the issue affecting DNS updates, however, they will continue to monitor for further impact.

Rackspace
Incident: Control Panels (DNS Updates Unavailable | All Regions)

Unresolved: Our engineers are aware of an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. DNS resolution is not impacted. If you have further questions, please contact a member of your support team.

Rackspace
Incident: Cloud DNS (DNS Updates Unavailable | All Regions)

Unresolved: Our engineers are aware of an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. DNS resolution is not impacted. If you have further questions, please contact a member of your support team.

Rackspace
Incident: Control Panels (Resolved: DNS Update Issues | All Regions)

Resolved: As of approximately 17:30 CDT on 15 August 2016, DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API have been functioning normally.

Rackspace
Incident: Cloud DNS (Resolved: DNS Update Issues | All Regions)

Resolved: As of approximately 17:30 CDT on 15 August 2016, DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API have been functioning normally.

Rackspace
General Notice: DNS Updates Unavailable | All Regions

Our engineers are aware of an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. DNS resolution is not impacted. If you have further questions, please contact a member of your support team.

Rackspace
Incident: Control Panels (Monitoring: DNS Update Issues | All Regions)

Unresolved: As of approximately 16:58 CDT, DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API are succeeding. At this time, engineers are continuing to monitor for any additional issues.

Rackspace
Incident: Cloud DNS (Monitoring: DNS Update Issues | All Regions)

Unresolved: As of approximately 16:58 CDT, DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API are succeeding. At this time, engineers are continuing to monitor for any additional issues.

Rackspace
Incident: Control Panels (DNS Update Issues | All Regions)

Unresolved: Our engineers are aware of an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. DNS resolution is not impacted. Additional updates will be posted as new information becomes available.

Rackspace
Incident: Cloud DNS (DNS Update Issues | All Regions)

Unresolved: Our engineers are aware of an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. DNS resolution is not impacted. Additional updates will be posted as new information becomes available.

Rackspace
Maintenance: Cloud Sites | DFW Emergency Maintenance | Aug 15 @ 10pm

Engineers will be performing an emergency maintenance on storage in our DFW Datacenter. While this is for internal systems, there is a possibility of disruption of some internal systems that may affect provisioning, system logs and other non-customer-data systems. Maintenance is expected to last up to 2 hours. If you have any further questions please feel free to contact a member of our support team.

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Read Only Volumes | IAD)

Resolved: Incident Resolved.

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Read Only Volumes | IAD)

Unresolved: On 14 August 2016, from 07:46 to 07:55 CDT, a network issue that affected connectivity to Cloud Block Storage volumes in the IAD3 data center. We strongly suggest that you check the status of the CBS volume(s) attached to your Cloud Server instances. Your CBS volumes may be in read-only mode due to the network interruption. Full network connectivity is restored.� If you do find your volume to be in read-only mode, unmount the volume, run a filesystem check (linux: fsck, windows: chkdsk), and then remount the volume in read-write mode. Your storage must be unmounted prior to fsck or there is a risk of data corruption/loss. If you need additional assistance, please contact Rackspace Support.

Rackspace
General Notice: ServiceNet Connectivity Issues | IAD3

On 14 August 2016, from 07:46 to 07:55 CDT, an issue affected ServiceNet connectivity in the IAD3 data center. �During this time, customers may have experienced an increase in monitoring alerts. �

Rackspace
Incident: Cloud Servers (Next Generation) (Intermittent '401' errors on Reach console access connections to servers.)

Resolved: On 13 August 2016, from 16:18 to 21:18 CDT, engineers worked to resolve an issue affecting Cloud Servers in the ORD1 data center. Engineers found that there were two active consoles in the region when there should only have been one. Engineers shut down requests sent to the 02 node to resolve the issue. During the time of impact, a portion of customers may have encountered intermittent 404 errors when accessing the Reach control panel, however, customers would have still had console access via the API. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Intermittent '401' errors on Reach console access connections to servers.)

Unresolved: Hello, Rackspace is aware of an issue affecting Cloud Servers in our ORD1 data center and our engineers are working to resolve it as quickly as possible. Currently some customers may experience intermittent '401' errors when attempting to connect via console through the Reach 'Server Details' menu. Console access is still consistently available through API for anyone encountering this error. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud Block Storage (Storage Nodes set to Read Only)

Resolved: This incident has been resolved.

Rackspace
Incident: Cloud Block Storage (Storage Nodes set to Read Only)

Unresolved: Hello, During a planned non-impacting maintenance, a bug was triggered which caused ServiceNet impact that caused Cloud Block Storage (CBS) volumes to go into read-only mode. We strongly suggest that you check the status of the CBS volume(s) attached to your Cloud Server instances. Your CBS volumes may be in read-only mode due to the network interruption which occurred during the maintenance. Full network connectivity is restored, and the maintenance is fully completed. If you do find your volume to be in read-only mode, unmount the volume, run a filesystem check (linux: fsck, windows: chkdsk), and then remount the volume in read-write mode. Your storage must be unmounted prior to fsck or there is a risk of data corruption/loss. If you need additional assistance, please contact Rackspace Support. Sincerely, Rackspace

Rackspace
Incident: Cloud Sites (Cloud Sites | SSL Connectivity | ORD - PHP 56-30)

Resolved: Issue Recap: On 11 August 2016, at 03:40 CDT, Operations became aware of dropped SSL Site connections who are hosted in the ORD1 data center. Engineers found that a cluster had failed and required a rebuild of the traffic group for the load balancer, as well as manually re-add the SSL bindings to the cluster. The Operations team completed the rebuild at 05:44 CDT, resolving the issue. During the time of impact, Cloud Sites customers hosting SSL-enabled sites behind the affected cluster may have experienced failures when attempting to load their hosted Sites. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Sites (Cloud Sites | SSL Connectivity | ORD - PHP 56-30)

Unresolved: All PHP 56-30 SSL sites are connecting normally at this time.

Rackspace
Incident: Cloud Sites (Cloud Sites | SSL Connectivity | ORD - PHP 56-30)

Unresolved: At this time our Operations team is working to resolve SSL failures for some ORD PHP 56-30 websites. Additional details will be provided as they become available.

Rackspace
Maintenance: Cloud Sites | ORD Emergency Maintenance MySQL 51-050 | Aug 10 @ 9pm

Our Engineers will be performing an emergency maintenance on MySQL 51-050 in our ORD Datacenter. During this time databases on the host will be in a read-only mode. If you have any further questions please feel free to contact a member of our support team.

Rackspace
Incident: Rackspace CDN (Resolved: DNS Update Issues | All Regions)

Resolved: On 10 August 2016, between 08:53 and 10:52 CDT, engineers worked to resolve an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API and Rackspace CDN. During this time, customers would have been unable to create a new Rackspace CDN object containing a DNS entry. However, DNS resolution was not impacted at any time.

Rackspace
Incident: Rackspace CDN (Resolved: DNS Update Issues | All Regions)

Resolved: On 10 August 2016, between 08:53 and 10:52 CDT, engineers worked to resolve an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API and Rackspace CDN. During this time, customers would have been unable to create a new Rackspace CDN object containing a DNS entry. However, DNS resolution was not impacted at any time.

Rackspace
Incident: Cloud DNS (Resolved: DNS Update Issues | All Regions)

Resolved: On 10 August 2016, between 08:53 and 10:52 CDT, engineers worked to resolve an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. During this time, DNS resolution was not impacted.

Rackspace
Incident: Cloud DNS (Resolved: DNS Update Issues | All Regions)

Resolved: On 10 August 2016, between 08:53 and 10:52 CDT, engineers worked to resolve an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. During this time, DNS resolution was not impacted.

Rackspace
Incident: Control Panels (Resolved: DNS Update Issues | All Regions)

Resolved: On 10 August 2016, between 08:53 and 10:52 CDT, engineers worked to resolve an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. During this time, DNS resolution was not impacted.

Rackspace
Incident: Control Panels (DNS Update Issues | All Regions)

Unresolved: On 10 August 2016, at approximately 08:53 CDT, engineers became aware of an issue affecting DNS updates through the MyRackspace and Cloud Control Panels, as well as the Cloud DNS API. DNS resolution is not impacted. Additional updates will be posted as new information becomes available.

Rackspace
Incident: Cloud Monitoring (Resolved: Rackspace Monitoring | Device Poller Issue | All Regions)

Resolved: On 4 August 2016, from 08:37 to 08:44 UTC , Rackspace Monitoring experienced an issue affecting global device pollers. During this time, customers may have received alert tickets incorrectly identifying devices as being down. At this time, engineers have cleared a majority of the false positive alert tickets. Due to the large influx of tickets generated by this issue, customers may have experienced delayed support response times.

Rackspace
Incident: Cloud Monitoring (Rackspace Monitoring | Device Poller Issue | All Regions)

Unresolved: On 4 August 2016, from 08:37 to 08:44 UTC , Rackspace Monitoring experienced an issue affecting global device pollers. During this time, customers may have received alert tickets incorrectly identifying devices as being down. Engineers are continuing to make progress clearing the false positive alert tickets. Due to the large influx of tickets generated by this issue, customers may experience delayed support response times. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Networks (Cloud Networking | Networks Not Attaching to New Builds | DFW)

Resolved: On 04 August 2016, between 04:20 and 11:15 CDT, engineers worked to resolve an issue affecting Cloud Servers and Cloud Networks in the DFW region. Engineers deployed a fix to resolve this issue. During the time of impact, a portion of customers who had attach a Cloud Network to a new Server build may have found that the Network does not appear after the build completed. Further, a portion of customers may have experienced issues when rebooting their established Server, and the attached Network not appearing after the boot. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Networks (Cloud Networking | Networks Not Attaching to New Builds | DFW)

Unresolved: Engineers are currently developing a fix to resolve this issue in the DFW region. During this time, a portion of customers who attach a Cloud Network to a new Server build may find that the Network does not appear after the build completes. Further, a portion of customers may experience rebooting their established Server, and the attached Network not appearing after the boot. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Monitoring (Rackspace Monitoring | Device Poller Issue | All Regions)

Unresolved: On 4 August 2016, from 08:37 to 08:44 UTC , Rackspace Monitoring experienced an issue affecting global device pollers. During this time, customers may have received alert tickets incorrectly identifying devices as being down. Engineers are currently working to clear false positive alert tickets. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Networks (Cloud Networking | Networks Not Attaching to New Builds | DFW)

Unresolved: On 04 August 2016, at approximately 04:20 CDT, engineers were alerted to an issue affecting Cloud Servers and Cloud Networks in the DFW region. Engineers are engaged and working to resolve this issue. During this time, a portion of customers who attach a Cloud Network to a new Server build may find that the Network does not appear after the build completes. Further, a portion of customers may experience rebooting their established Server, and the attached Network not appearing after the boot. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Sites (Monitoring: Cloud Sites | FTP Issue | ORD Region)

Resolved: On 3 August 2016, from 17:01 to 18:00 CDT, our engineers worked to resolve an issue affecting Cloud Sites in the ORD Region. During the time of impact, a portion of customers may have been intermittently unable to access FTP.

Rackspace
Incident: Cloud Sites (Monitoring: Cloud Sites | FTP Issue | ORD Region)

Unresolved: Our engineers believe the issue affecting Cloud Sites in the ORD Region has been resolved, however they are continuing to monitor for further impact. An update will be posted if there are any status changes. If you have further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Sites (Cloud Sites | FTP Issue | ORD Region)

Unresolved: Our engineers are aware of an issue affecting Cloud Sites in the ORD Region. During this time, a potion of customers may be unable to access FTP. If you have further questions, please contact a member of your support team.

Rackspace
Maintenance: Cloud Sites | DFW Maintenance | Aug 3 @ 5pm CDT

Cloud Sites Engineers will be performing maintenance on the firewall in DFW to resolve logging problems. No impact is expected, however new connections may drop temporarily while the change is made. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Rackspace CDN (Resolved: Intermittent Delayed Metrics, Billing, and Log Delivery)

Resolved: Between 28 June 2016 11:00 and 20 July 2016 17:09 CDT, engineers worked to resolve an issue affecting delivery of Metrics, Billing and Log data for Rackspace CDN. CDN engineers rolled out a configuration change to resolve the issue. During the time of impact, customers may have experienced intermittent delays in delivery of Metrics, Billing and Log data for Rackspace CDN.

Rackspace
Incident: Cloud Databases (Resolved: Cloud Database Issue | LON Region)

Resolved: On 1 August 2016, at approximately 17:15 UTC , Cloud Datastores engineers became aware of an issue affecting MySQL and ObjectRocket Redis connectivity in the LON region. Engineers restored connectivity to all affected databases at 23:05 UTC . During the time of impact, affected database instances may have been inaccessible. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Databases (Cloud Database Issue | LON Region)

Unresolved: Engineers are continuing to work to restore services to the remaining subset of affected Cloud Database instances. Currently affected customers have received tickets regarding their individual instances. If you have further questions, please contact a member of your support team.

Rackspace
Maintenance: Next Gen Cloud Servers | IAD | Starting Wednesday, August 3rd at 9:00 PM CDT

The Rackspace Open Cloud system engineers will perform a priority maintenance to the control infrastructure of our Next Generation Cloud Servers in IAD during the following date and time: CHG0066034 - August 3rd from 9:00 PM - August 4th 4:00 AM CDT (August 3rd from 10:00 PM EDT - August 4th 5:00 AM EDT) During this time, customers accessing management level services (public APIs for these regions) may experience errors for a period of up to 30 minutes. This includes requests sent from the MyCloud Control Panel as well as those sent to the Next Gen Cloud Servers API directly (First Gen Cloud Servers management will not be affected). This maintenance will NOT pose any impact to existing Next Gen Cloud Servers under your account which are located in this region. However, certain operations being performed during this period may be interrupted (such as server builds, resizes, or snapshots). Customers are urged to perform these operations before or after this maintenance event. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Cloud Databases (Cloud Database Issue | LON Region)

Unresolved: Engineers have completed deployment of the patch and have restored services for the majority of DBaaS customers in the LON region. Engineers are continuing to work to restore services for the remaining affected database instances.

Rackspace
Incident: Cloud Databases (Cloud Database Issue | LON Region)

Unresolved: Engineers will apply a patch to restore services for all DBaaS customers in LON. This patch will require a reboot to complete. Following application of the patch, we will update the status once again to confirm the new state of services.

Rackspace
Incident: Cloud Databases (Cloud Database Issue | LON Region)

Unresolved: As of 18:05 UTC , engineers have restored connectivity to affected non-HA MySQL and Redis instances.� At this time, HA enabled instances continue to experience connectivity issues.� Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Databases (Cloud Database Issue | LON Region)

Unresolved: As of 18:05 UTC , engineers have restored connectivity to affected non-HA MySQL and Redis instances.� At this time, HA enabled instances continue to experience connectivity issues.� Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Databases (Cloud Database Issue | LON Region)

Unresolved: On August 1 2016, at 17:30 UTC , engineers became aware of issue affecting Cloud Databases in the LON region. During this time, customers may experience issues when connecting to their affected databases.

Rackspace
Incident: Cloud Servers (Next Generation) (30gb Standard Slots Unavaiable)

Resolved: This message was posted in error, please ignore.

Rackspace
Incident: Cloud Servers (Next Generation) (30gb Standard Slots Unavaiable)

Unresolved: Hello, Rackspace is aware of an issue affecting Cloud Servers in our IAD region. Currently, there are no available slots for new Cloud Servers 30gb Standard instance builds. Customers are advised to select 30gb Performance builds when creating a new instance in this region. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Control Panels (Identity Errors Accessing MyCloud from MyRackspace )

Resolved: Hello, From 28 July 2016, at 09:13 CDT to 29 July 2016, at 12:25 CDT engineers worked to resolve an issue affecting access to MyCloud from the MyRackspace portal. Engineers made a configuration change to address the "400 errors" being received in the portal. During the affected time, customers who received 400 errors while accessing the MyCloud control panel from the MyRackspace portal were advised to reload the screen to resolve the error. If you have any further questions, please reach out to a member of your support team. Regards, Rackspace

Rackspace
Incident: Control Panels (Identity Errors Accessing MyCloud from MyRackspace )

Unresolved: On 28 July 2016, at 09:13 CDT, engineers became aware of an issue affecting access to MyCloud from the MyRackspace portal. Engineers made a configuration change to address the "400 errors" being received in the portal. Engineers continue to monitor the configuration to ensure resolution remains in place. During this time, customers who receive 400 errors while accessing the MyCloud control panel from the MyRackspace portal are advised to reload the screen to resolve the error. If you have any further questions, please reach out to a member of your support team.

Rackspace
Maintenance: Cloud Sites | ORD DFW Maintenance | August 1

At 10pm CDT Cloud Sites Engineers will perform updates to SSL handling within our infrastructure in both datacenters. All customers utilizing SSL for their sites are advised to resolve any mixed content warnings on their sites prior to this to avoid down time. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Control Panels (Identity Errors Accessing MyCloud from MyRackspace )

Unresolved: Rackspace is aware of an issue affecting MyRackspace portal and our engineers are working to resolve it as quickly as possible. Currently,some customers may experience '400' errors while attempting to access MyCloud, from the MyRackspace Portal. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Unable to Provision Cloud Servers in the LON Region | LON Region)

Resolved: On 26 July 2016, between 08:15 and 13:00 UTC , Cloud Server engineers worked to resolve an issue with provisioning servers in the LON Regions. Engineers determined the builds were successful, however, they were stuck in a "building" state. During the time of impact, customers may have not be able to build Cloud Servers in the LON region. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Unable to Provision Cloud Servers in the LON Region | LON Region)

Unresolved: On 26 July 2016, at 08:15 UTC , Cloud Server engineers identified an issue with provisioning servers in the LON Regions. Engineers are engaged an are working to resolve the issue. During this time, Cloud Server builds in the LON region may take up to an hour. For further assistance, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Unable to Provision Cloud Servers in the LON Region | LON Region)

Unresolved: On 26 July 2016, at 08:15 UTC , Cloud Server engineers identified an issue with provisioning servers in the LON Regions. Engineers are engaged an are working to resolve the issue. During this time, customers may not be able to build Cloud Servers in the LON region. For further assistance, please call a member of your support team.

Rackspace
Maintenance: Cloud Sites | ORD Emergency MySQL Maintenance | July 27 @ 11pm CDT

Cloud Sites Engineers will be performing performing an emergency maintenance on mysql51-101 in our ORD datacenter. Maintenance is expected to last up to an hour for a RAM replacement. Databases on this host will be in read only mode while the RAM replacement is performed. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Servers (Next Generation) (Cell Database Failover in ORD1)

Resolved: Hello, On 23 July 2016, from 16:50 to 20:01 CDT Rackspace engineers worked to resolve an issue in with Cloud Servers in our ORD1 data center. During the affected time some customers may have been unable to complete API actions to their Cloud Servers. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud Servers (Next Generation) (Cell Database Failover in ORD1)

Unresolved: On 23 July 2016, at 16:50 CDT engineers identified an issue with Cloud Servers in ORD1 and are working to resolve the problem. Some customers, those with servers in the affected cell, may be unable to reach the API or perform any API related functions. If you have any additional questions or concerns please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Intermittent '500' Errors)

Resolved: This issue has now been resolved.

Rackspace
Incident: Cloud Backup (Intermittent '500' Errors)

Unresolved: Rackspace is aware of an issue affecting Cloud Backups in our LON data centers and our engineers are working to resolve it as quickly as possible. Customers may experience intermittent '500' errors when attempting to access Cloud Backups from the Cloud Control Panel. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Maintenance: Cloud Sites | DFW & ORD Windows Maintenance | July 25 through 31

At 8pm CDT each night of the maintenance Cloud Sites Engineers will be performing maintenance on the Windows/IIS hosting platforms to apply routine patches issued by Microsoft. The length of each maintenance will vary depending on the node but is expected to last up to 2 hours each night. There should be no visible ill effects, however, it is possible that a server being rebooted message may show up in some applications logs or sessions may be lost due to a node rebooting. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Backup (Cloud Backup | "Unavailable" Errors on Cloud Backup )

Resolved: On 21 July 2016, from 03:20 CDT to 04:11 CDT, Rackspace engineers worked to resolve an issue affecting Cloud Backups. During time of impact, customers may have experienced "Not Available" errors when trying to access Cloud Backup.

Rackspace
Incident: Cloud Backup (Cloud Backup | "Unavailable" Errors on Cloud Backup )

Unresolved: Rackspace is aware of an issue affecting Cloud Backup and our engineers are working to resolve it as quickly as possible. Currently, any attempts to access the service via Cloud Control Panel are returning 'Service Unavailable' Errors. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
General Notice: Intermittent Connectivity Issues with SalesForce

On 21 July 2016, starting at approximately 02:00 CDT, Engineers began investigations regarding issues affecting Live Chat support. During this time customers may be disconnected unexpectedly from their Live Chat sessions. Phone support is unaffected and available by calling 800-961-4454.

Rackspace
Incident: Cloud Sites (Cloud Sites | Connectivity Issues | ORD )

Resolved: On 19 July 2016, from 09:30 to 15:04 CDT, engineers worked to mitigate customer impact from a series of DDoS attacks (Distributed Denial of Service) within the ORD1 data center. During the time of impact, Cloud Sites customers may have experienced latency and or packet loss. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Backup 'Service Unavailable' Errors)

Resolved: Engineers restored service at 21:00 CDT. During time of impact, customers may have experienced "Service Not Available" errors when trying to access Cloud Backup from the Cloud Control Panel.

Rackspace
Incident: Cloud Backup (Cloud Backup 'Service Unavailable' Errors)

Unresolved: Rackspace is aware of an issue affecting Cloud Backup and our engineers are working to resolve it as quickly as possible. Currently, any attempts to access the service via Cloud Control Panel are returning 'Service Unavailable' Errors. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Maintenance: Next Gen Cloud Servers | LON, IAD, ORD & DFW | Starting Thursday, July 25th at 4:00 PM CDT

The Rackspace Open Cloud system engineers will perform a priority maintenance to the control infrastructure of our Next Generation Cloud Servers regions during the following dates and times: CHG0065601 – LON Region – July 25th from 4:00PM – 10:00PM CDT (May 25th from 10:00 PM - May 26th to 4:00 AM BST) CHG0065602 - IAD Region - July 26th from 9:00 PM - July 27th 4:00 AM CDT (July 26th from 10:00 PM EDT - July 27th 5:00 AM EDT) CHG0065646 - ORD Region - July 27th from 10:00 PM - July 28th 4:00 AM CDT CHG0065648 - DFW Region - July 28th from 10:00 PM - July 29th 4:00 AM CDT During these times, customers accessing management level services (public APIs for these regions) may experience errors for a period of up to 30 minutes. This includes requests sent from the MyCloud Control Panel as well as those sent to the Next Gen Cloud Servers API directly (First Gen Cloud Servers management will not be affected). This maintenance will NOT pose any impact to existing Next Gen Cloud Servers under your account which are located in this region. However, certain operations being performed during this period may be interrupted (such as server builds, resizes, or snapshots). Customers are urged to perform these operations before or after this maintenance event. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Control Panels (MyRackspace Portal Login Issues)

Resolved: On 20 July 2016, from 10:30 CDT to 11:25 CDT, engineers worked to resolve an issue affecting the MyRackspace portal. During the time of impact, customers may have experienced issues with logging into the MyRackspace portal.

Rackspace
Incident: Cloud Sites (Inbound DDoS)

Unresolved: Cloud Sites continues to experience a DDoS to some targets in the ORD datacenter. Engineers have placed mitigation and during this time some customers may have sites that intermittently load or fail to load entirely. If you have further questions please contact a member of our support team by visiting us in live chat or by calling 1.877.934.0407 or INTL +1.210.581.0407

Rackspace
Incident: Control Panels (MyRackspace Portal Login Issues)

Unresolved: Our engineers are aware of an issue affecting the MyRackspace portal and are investigating. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Cloud Sites (Inbound DDoS)

Unresolved: At this time the traffic from the DDoS has leveled out and mitigation has been lifted. Engineers will continue to monitor the situation and take appropriate action. Thank you for your patience.

Rackspace
Incident: Cloud Sites (Inbound DDoS)

Unresolved: Cloud Sites continues to experience a DDoS to some targets in the ORD datacenter. Engineers have placed mitigation and during this time some customers may have sites that intermittently load or fail to load entirely. If you have further questions please contact a member of our support team by visiting us in live chat or by calling 1.877.934.0407 or INTL +1.210.581.0407

Rackspace
General Notice: British Telecom Down | London Region

On 20 July 2016, at 08:30 UTC , Major London provider British Telecom reported outages in the London area. The British Telecom outage did not affect Rackspace's internal networking in the LON region. During this time, customers in London may not be able to access their Rackspace products and other internet services via the due to the British Telecom outage.

Rackspace
General Notice: British Telecom Down | London Region

On 20 July 2016, at 08:30 UTC , Major London provider British Telecom reported outages in the London area. The British Telecom outage did not affect Rackspace's internal networking in the LON region. During this time, customers in London may not be able to access their Rackspace products via the internet due to the outage. Please contact a member of your support team for more information.

Rackspace
Incident: Control Panels (MyRackspace Portal | Intermittent Downtime Errors | All Regions)

Resolved: No Downtime at 23:30 CDT

Rackspace
Incident: Control Panels (MyRackspace Portal | Intermittent Downtime Errors | All Regions)

Unresolved: Starting at 23:30 CDT engineers are investigating reports of the MyRackspace portal having intermittent downtime. During this time, customers may experience errors when trying to access the MyRackspace customer portal.

Rackspace
Incident: Control Panels (MyRackspace Portal | Errors When Logging In | All Regions)

Resolved: resolved

Rackspace
Incident: Control Panels (MyRackspace Portal | Errors When Logging In | All Regions)

Unresolved: Our engineers are aware of an issue impacting the MyRackspace customer portal. During this time, customers may experience errors when attempting to login to the portal. If you have further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Sites (Cloud Sites | Network Issue | ORD Region)

Unresolved: Our engineers are aware of a network issue that is affecting Cloud Sites in the ORD region. During this time, a portion of Cloud Sites customers may experience latency or packet loss until the issue is resolved. If you have further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Sites (Intermittent Latency)

Resolved: The Cloud Sites Engineers have not observed any further activity in relation to this event and we are considering this issue resolved. We thank you for your patience as we worked through this disruption.

Rackspace
Incident: Cloud Sites (Intermittent Latency)

Unresolved: Cloud Sites Engineers have cleared the issue causing intermittent latency issue in the ORD datacenter. They will continue to monitor this situation.

Rackspace
Incident: Cloud Sites (Intermittent Latency)

Unresolved: Cloud Sites engineers have identified an inbound DDoS in the ORD datacenter. Mitigation has been enabled for the affected systems. Customers with websites hosted in ORD may experience intermittent latency and possible timeouts until the issue is resolved. Our engineers are actively engaged in troubleshooting the issue. If you have any further questions please feel free to contact a member of our support team.

Rackspace
Incident: Cloud Sites (Intermittent Latency)

Resolved: Cloud Sites Engineers have cleared and resolved the issue causing intermittent latency issue in the ORD data center. Thank you for your patience.

Rackspace
Incident: Cloud Sites (Intermittent Latency)

Unresolved: Cloud Sites Engineers have cleared and resolved the issue causing intermittent latency issue in the ORD datacenter. They will continue to monitor this situation.

Rackspace
Incident: Cloud Sites (Intermittent Latency)

Unresolved: Cloud Sites engineers have identified an inbound DDoS in the ORD datacenter. Mitigation has been enabled for the affected systems. Customers with websites hosted in ORD may experience intermittent latency and possible timeouts until the issue is resolved. Our engineers are actively engaged in troubleshooting the issue. If you have any further questions please feel free to contact a member of our support team.

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Small Subset of CBS Volumes Unreachable | IAD Region)

Resolved: On 19 July 2016, at 05:44 CDT, engineers became aware of an issue which affected a Cloud Block Storage node IAD3 region. Engineers restored service at 06:23 CDT. During time of impact, customers may not be able to access their Cloud Block Storage volumes in the affected node.

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Small Subset of CBS Volumes Unreachable | IAD Region)

Unresolved: On 19 July 2016, at 05:44 CDT. engineers became aware of an issue affecting Cloud Block Storage in the IAD region. Cloud Block Storage engineers are engaged and are working to resolve the issue. During this time, a small subset of customers may not be able to access their Cloud Block Storage volumes.

Rackspace
General Notice: GDCI - Network | Loss of Network Connectivity | LON5

On 18 July 2016, at 01:09 CDT, Network Operations became aware of an issue affecting a network device in the LON5 data center. Engineers are engaged and are working to resolve the issue. During this time, customers may experience loss of connectivity in the affected environment. For further information, please contact a member of your support team.

Rackspace
General Notice: Cloud Signup Service | Signup Service Errors | All Regions

On 17 July 2016, at approximately 01:50 CDT, engineers were alerted to issues affecting the Cloud Signup page. Engineers are currently engaged and investigating. During this time, customers trying to access the Cloud Signup page may encounter errors and not be able to complete the signup process. For immediate assistance, please call 1-877-934-0409

Rackspace
Maintenance: Next Gen Cloud Servers | HKG | Starting Thursday, July 20th at 9:00 AM CDT

The Rackspace Open Cloud system engineers will perform a priority maintenance to the control infrastructure of our Next Generation Cloud Servers regions during the following dates and times: CHG0065230 - HKG Region - July 20th from 9:00 AM - 3:00 PM CDT (July 20th from 10:00 PM - July 21st to 4:00 AM HKT) During these times, customers accessing management level services (public APIs for these regions) may experience errors for a period of up to 30 minutes. This includes requests sent from the MyCloud Control Panel as well as those sent to the Next Gen Cloud Servers API directly (First Gen Cloud Servers management will not be affected). This maintenance will NOT pose any impact to existing Next Gen Cloud Servers under your account which are located in this region. However, certain operations being performed during this period may be interrupted (such as server builds, resizes, or snapshots). Customers are urged to perform these operations before or after this maintenance event. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Maintenance: Rackspace Billing Scheduled Maintanance

Rackspace will be performing maintenance on our Rackspace Billing environment between the hours of Friday July 15th, 2016 11:00 AM CDT and Saturday July 16th, 2016 1:00 PM CDT. Customers navigating to the functions below may receive a "System Under Maintenance" message. We have taken precautions in preparation for this maintenance and do not anticipate a disruption to the listed services below lasting longer than 26 hours. Listed below are functions on the Rackspace Control Panel that will be affected during this window: Make One time Payment Newly signed up Cloud Sites Customer login Billing & invoice Information Time of impact: DFW: Between 11:00 CDT on July 15, 2016 and 03:00 CDT on July 18, 2016 ORD: Between 11:00 CDT on July 15, 2016 and 03:00 CDT on July 18, 2016 IAD: Between 12:00 EDT on July 15, 2016 and 04:00 EDT on July 18, 2016 LON: Between 17:00 BST on July 15, 2016 and 09:00 BST on July 18, 2016

Rackspace
Incident: Cloud Load Balancers (Resolved: LBaaS State Changes Causing Errors )

Resolved: Between 7 July and 13 July 2016, engineers worked to resolve an issue affecting a portion of Cloud LBaas customers provisioned to a single cluster in the IAD region. During this time, state changes to load balancers within that cluster may have caused the devices to go into an unrecoverable error state. If you have questions, please contact a member of your support team.

Rackspace
Incident: Rackspace CDN (Intermittent Delayed Metrics, Billing, and Log Delivery)

Unresolved: Hello, Our engineers are aware of an issue affecting delivery of Metrics, Billing and Log data for Rackspace CDN and are working to resolve the problem. At this time, customers may experience intermittent delays in delivery of Metrics, Billing and Log data for Rackspace CDN. If you have questions, please contact a member of your support team. Regards, Rackspace

Rackspace
Incident: Cloud Files CDN (Intermittent Delayed Metrics, Billing, and Log Delivery)

Resolved: This actually affected Rackspace CDN, not Cloud Files CDN

Rackspace
Incident: Cloud Files CDN (Intermittent Delayed Metrics, Billing, and Log Delivery)

Unresolved: Hello, Our engineers are aware of an issue affecting delivery of Metrics, Billing and Log data for Rackspace CDN and are working to resolve the problem. At this time, customers may experience intermittent delays in delivery of Metrics, Billing and Log data for Rackspace CDN. If you have questions, please contact a member of your support team. Regards, Rackspace

Rackspace
Incident: Cloud Load Balancers (LBaaS State Changes Causing Errors )

Unresolved: Hello, Rackspace engineers are aware of an issue affecting a portion of Cloud LBaas customers provisioned to a single cluster in the IAD region. At this time, state changes to load balancers within that cluster may cause the devices to go into an unrecoverable error state. The only available workaround for load balancers in this error state is to recreate the load balancer which will be provisioned to a different cluster. If you have questions, please contact a member of your support team. Regards, Rackspace

Rackspace
Maintenance: Cloud Block Storage | LON | Starting July 14th, 2016

Rackspace Network Services will be performing a disruptive maintenance in our LON data center to migrate the Cloud Block Storage control plane from 00:01 and 04:00 BST on July 15, 2016. We have taken precautions in preparation for this maintenance and do not anticipate a disruption lasting longer than 30 minutes. Ref: CHG0065246

Rackspace
Incident: Cloud Backup (Cloud Backup Intermittent issues in DFW and ORD)

Resolved: As of 14:10 CDT this issue has been resolved and there should be no more intermittent 500 errors.

Rackspace
Incident: Cloud Backup (Cloud Backup Intermittent issues in DFW and ORD)

Unresolved: On 8 July 2016, at 13:40 CDT, Our engineers became aware of an issue affecting Cloud Backup and are working to resolve the problem. At this time, customers may receive intermittent 500 errors accessing Cloud Backup information in the control panel. Additional updates will be provided as new information becomes available.

Rackspace
Maintenance: Cloud Block Storage | LON | Starting July 10th, 2016

Rackspace Network Services will be performing a disruptive maintenance in our LON data center to migrate the Cloud Block Storage control plane from 00:01 and 04:00 BST on July 11, 2016. We have taken precautions in preparation for this maintenance and do not anticipate a disruption lasting longer than 30 minutes. Ref: CHG0061991

Rackspace
Maintenance: Cloud Sites | Control Panel | 07-12 @10pm CDT

At 10PM CDT on July 12 Cloud Sites Engineers will be performing maintenance on the Cloud Sites control panel. The maintenance is expected to last about 30 minutes. During this time period customers will not be able to log into the Cloud Sites control panel and will see a maintenance page. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Cloud Sites | ORD Datacenter | 07-11 @ 10pm

At 10pm CDT on July 11 Cloud Sites Engineers will be performing maintenance on networking equipment in our environment that may require a reboot on Windows based devices only. There isn't any anticipated customer impact. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Loss of Connectivity in ORD Region | ORD Region)

Resolved: On 5 July 2016 from 00:21 CDT to 01:19 CDT, an aggregation router associated with your devices became unstable. During this time, you may have experienced loss of connectivity in the ORD region. Our engineers are investigating the device to determine the cause and will take appropriate action to ensure we maintain a stable network environment. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Loss of Connectivity in ORD Region | ORD Region)

Resolved: On 5 July 2016 from 00:21 CDT to 01:19 CDT, an aggregation router associated with your devices became unstable. During this time, you may have experienced loss of connectivity in the ORD region. Our engineers are investigating the device to determine the cause and will take appropriate action to ensure we maintain a stable network environment. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Backup | "500 Errors" in Cloud Backup Control Panel | All Regions.)

Resolved: On 4 July 2016, from 01:15 CDT to 02:00 CDT, Rackspace Engineers worked to resolve an issue which affected Cloud Backup in all regions. During time of impact, customers may have seen "500 Error" messages when accessing Cloud Backup in the Cloud Control Panel; customers were still able to perform backup management actions using the Cloud Backup API.

Rackspace
Incident: Cloud Backup (Cloud Backup | "500 Errors" in Cloud Backup Control Panel | All Regions.)

Unresolved: On 4 July 2016, at approximately 01:15 CDT, Engineers were alerted to issues affecting Cloud Backup in all regions and are working to resolve the issue. During this time, customers may see "500 Error" messages when accessing Cloud Backup in the Cloud Control Panel; customers are still able to perform backup management actions using the Cloud Backup API.

Rackspace
Incident: Cloud Backup (Cloud Backup | "500 Errors" in Cloud Backup Control Panel | All Regions.)

Unresolved: On 4 July 2016, at approximately 01:15 CDT, Engineers were alerted to issues affecting Cloud Backup in all regions. During this time, customers may see "500 Error" messages when accessing Cloud Backup in the Cloud Control Panel. Engineers are engaged and are working to resolve the issue.

Rackspace
General Notice: Major ISP Issue

Our network engineers are aware of an issue impacting a major Internet Service Provider (ISP) in the California region. This issue is occurring outside of our internal network, and at no point has the internal network been affected. Our data centers are designed to leverage multiple circuits of varying sizes in order to distribute and balance traffic efficiently. Rackspace cannot control the paths customer traffic takes outside of our network, and customers may continue to experience latency, packet loss, or dropped connections impacting traffic traveling over the affected provider. If you have any further questions, please contact a member of your support team.

Rackspace
Maintenance: Cloud Load Balancer | ORD| Thursday, July 6th, 2016

Rackspace Cloud Internal Networking team will be performing a disruptive maintenance (CHG0064477 & CHG0064431) to a Cloud Load Balancer aggr and top of rack switches in cabinet, f13-16 in our ORD data center between 10pm and 11pm July 6th, 2016 & 11:30PM on July 6, 2016 CDT to 1:05AM on July 7, 2016 CDT. There will be intermittent connectivity interruptions on your Cloud Load Balanced devices expected to total 15 minutes during the course of the maintenance window. This should be shown by packet loss during the course of the maintenance. We apologize for any inconvenience this may cause.

Rackspace
Incident: Cloud Backup (Resolved: Cloud Backup | "504 Gateway Timeout" Errors | All Regions)

Resolved: On 29 June, 2016, from 06:00 to 11:12 CDT, engineers worked to resolve an issue affecting the Cloud Backup Control Panel and API for the IAD region. During this time, customers may have encountered "504 Gateway Timeout" errors when accessing Cloud Backup via the Cloud Control Panel or the Cloud Backup API.

Rackspace
Incident: Cloud Backup (Cloud Backup | "504 Gateway Timeout" Errors | All Regions)

Unresolved: Engineers have isolated the issue affecting Cloud Backup to the IAD region. During this time, customers may encounter "504 Gateway Timeout" errors when accessing Cloud Backup via the Cloud Control Panel or the Cloud Backup API.

Rackspace
Incident: Cloud Backup (Cloud Backup | "504 Gateway Timeout" Errors | All Regions)

Unresolved: On 29 June 2016, at 06:00 CDT, Rackspace engineers have identified an issue affecting Cloud Backup. During this time, customers may encounter "504 Gateway Timeout" errors when accessing Cloud Backup via the Cloud Control Panel or the Cloud Backup API.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | API Operations Limited | IAD3)

Resolved: Services restored at 00:31 CDT

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | API Operations Limited | IAD3)

Unresolved: On 29 June 2016, at 00:01 CDT, Rackspace engineers became aware of an issue affecting API operations for Cloud Servers in the IAD3 data center. During this time, customers may experience performing API operations (create, delete, image, etc.) in the affected nodes.

Rackspace
General Notice: Live Chat Support Disruption

On 29 June 2016, at 00:20, Rackspace engineers have identified an issue affecting Live Chat support. During this time, Live Chat may not be available for some Rackspace Customers. For further assistance, please contact us via telephone at (800) 961-4454

Rackspace
General Notice: Live Chat Support Disruption

On 29 June 2016, at 00:20, Rackspace engineers have identified an issue affecting Live Chat support. During this time, Live Chat may not be available for Rackspace Customers. For further assistance, please contact us via telephone at (800) 961-4454

Rackspace
Maintenance: Cloud Sites | ORD DFW Maintenance | June 28 @ 4pm CDT

At 4 PM Cloud Sites Engineers will be performing performing updates to web servers within our infrastructure in both datacenters. The maintenance is expected to last an hour. There should be no visible impact, however, it is possible that POST requests for a site can take longer than expected. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Cloud Sites | ORD DFW Maintenance | June 28 @ 3pm CDT

At 3 PM Cloud Sites Engineers will be performing maintenance on our load balancers. Maintenance is expected to last a maximum of 30 minutes. There should be no visible impact. However, there is potential for impact for sites using SSL. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Databases (Resolved: Cloud Databases | Control Plane Issues | HKG)

Resolved: On 27 June 2016, from 19:30 to 21:26 UTC , engineers worked to resolve an issue affecting the Cloud Datastores API in the HKG region. During the time of impact, customers may have been unable to create, modify, or resize database instances in the affected region. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Databases (Cloud Databases | Control Plane Issues | HKG)

Unresolved: Our engineers are working to resolve an issue affecting the Cloud Databases API in the HKG region. At this time, customers may be unable to create, modify, or resize database instances in the affected region.

Rackspace
Incident: Cloud Sites (GDCI Network | aggr170b-2 OSPF Flap | DFW3)

Resolved: On 24 June 2016, from 22:34 to 23:27 CDT, engineers worked to resolve a recurring Open Shortest Path First (OSPF) flap with an aggregation router in the DFW3 data center. Engineers filtered off traffic to the affected aggregation router to resolve the issue. During the time of impact, a small portion of Cloud Sites customers may have encountered packet loss and or latency when connecting to their sites. If you have any questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Sites (GDCI Network | aggr170b-2 OSPF Flap | DFW3)

Unresolved: On 24 June 2016, at approximately 22:34 CDT, engineers detected a recurring Open Shortest Path First (OSPF) flap with an aggregation router in the DFW3 data center. Engineers are engaged and working to resolve the issue. During this time, a small portion of Cloud Sites customers may encounter packet loss and or latency when connecting to their sites. If you have any questions, please reach out to a member of your support team.

Rackspace
Incident: Control Panels (Resolved: MyRackspace Portal | Intermittent Login Issues | ORD1)

Resolved: On 22 June 2016, from 10:03 to 10:41 CDT, engineers worked to resolve an issue affecting the MyRackspace portal. During this time, customers may have experienced intermittent issues logging into the MyRackspace portal. If you have questions, please contact a member of your support team.

Rackspace
Incident: Control Panels (MyRackspace Portal | Intermittent Login Issues | ORD1)

Unresolved: Our engineers are aware of an issue affecting the MyRackspace portal and are working to resolve the problem. At this time, customers may experience intermittent issues logging into the MyRackspace portal. If you have questions, please contact a member of your support team.

Rackspace
General Notice: Cloud Office | Status Page Maintenance | All Regions

As part of our efforts to continually improve our product offerings, we will be performing a scheduled maintenance on the Rackspace Cloud Office (Email & Apps) Status Page located at http://status.apps.rackspace.com and http://status.emailsrvr.com. The maintenance window is scheduled for 25 June 2016, from 12:00 to 14:00 CDT. During the maintenance window, the following services will be offline and inaccessible: Status Page Status Page API Status Page RSS Feed If you have any further questions, please contact a member of your support team.

Rackspace
Maintenance: Cloud Data Stores | ORD | June 22, 2016

Rackspace Network Services will be performing a non-disruptive emergency maintenance (CHG0064632) to replace hardware on our switching infrastructure supporting Cloud DataStores in our ORD data center between 02:00 and 06:00 CDT, on June 22, 2016. This maintenance is designed to increase stability, network resiliency, and scalability. We have taken precautions in preparation for this maintenance and do not anticipate any disruption of service during this time.

Rackspace
Incident: Cloud Servers (Next Generation) (Resolved: Cloud Servers | API Functions Degraded | LON Region)

Resolved: On 21 June 2016, at approximately 07:32 UTC , Cloud Server began working to resolve an issue affecting Cloud Servers in the LON region. During the time of impact, a small subset of customers may have experienced API errors or may have been unable to perform NextGen Cloud Servers API functions (create, delete, etc.) for several minutes. If you have additional questions, please contact a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | API Functions Degraded | LON Region)

Unresolved: On 21 June 2016, at approximately 07:32 UTC , Cloud Server engineers reported issues affecting Cloud Servers in the LON region. Engineers are engaged and are working to resolve the issue. During this time, a small subset of customers may experience API errors or may be unable to perform NextGen Cloud Servers API functions (create, delete, etc.) in the LON Region.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | API Functions Degraded | LON Region)

Unresolved: On 21 June 2016, at approximately 07:32 UTC , Cloud Server engineers reported issues affecting Cloud Servers in the LON region. Engineers are engaged and are working to resolve the issue. During this time, a small subset of customers may experience API errors or may be unable to perform NextGen Cloud Servers API functions (create, delete, etc.) in the LON Region.

Rackspace
Incident: Cloud Files (Cloud Files | Service Unavailable Errors | HKG Region)

Resolved: incident resolved

Rackspace
Incident: Cloud Files (Cloud Files | Service Unavailable Errors | HKG Region)

Unresolved: On 21 June 2016, at 01:50 CDT, Cloud Files engineers became aware of issues affecting Cloud Files in the HKG Region. Engineers are engaged and troubleshooting to resolve the issue. During this time, customers may encounter '503 Service Unavailable' errors when accessing their Cloud Files environment using the Cloud Control Panel or the Cloud Files API.

Rackspace
Incident: Cloud Files (Cloud Files | Service Unavailable Errors | HKG Region)

Unresolved: On 21 June 2016, at 01:50 CDT, Cloud Files engineers became aware of issues affecting Cloud Files in the HKG Region. Engineers are engaged and troubleshooting to resolve the issue. During this time, customers may encounter '503 Service Unavailable' errors.

Rackspace
Incident: Cloud Files (Cloud Files | Service Unavailable Errors | HKG Region)

Resolved: Event Resolved at 10:32 CDT

Rackspace
Incident: Cloud Files (Cloud Files | Service Unavailable Errors | HKG Region)

Unresolved: On 20 June 2016, at 03:15 UTC , Cloud Files engineers became aware of issues affecting Cloud Files in the HKG Region. Engineers are engaged and troubleshooting to resolve the issue. During this time, customers may encounter '503 Service Unavailable' errors.

Rackspace
Incident: Cloud Databases (Cloud Datastores | ORD)

Resolved: Event resolved.

Rackspace
Incident: Cloud Databases (Cloud Datastores | ORD)

Unresolved: As of 00:58 on 19 June 2016, Cloud Datastores engineers have identified issues affecting Cloud Databases in the ORD region. During this time, customers may experience difficulties accessing their Cloud Database instances.

Rackspace
Maintenance: Cloud Sites | ORD Maintenance | June 21 @ 10pm CDT

Cloud Sites Engineers will be performing maintenance on load balancers in the ORD datacenter. Maintenance is expected to last up to 2 hours. There should be no visible impact, however there is potential for some intermittent latency while traffic is routed on fewer load balancers. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Cloud Load Balancers | ORD | CR7 API Database migration | June 15th

The Rackspace Cloud Load Balancer Engineers will be performing a scheduled maintenance to move the Cloud Load Balancer API database in an effort to help accommodate additional growth and expansion within our ORD Datacenter.�� This maintenance will take place on the following date and time: Wednesday, June 15th at 10:00pm Central Customers may see up to 5 minutes of inaccessibility to the API where they will not be able to make any changes via the API, they will only be able to have view/read access.� This will not affect customers Load Balancers or devices; only access to the API itself. If customers have any questions or concerns in regards to this maintenance, please do not hesitate to contact a member of our support team via live chat or by telephone 24 hour toll free 1.877.934.0407.

Rackspace
General Notice: Resolved: Network Provider Issue | DFW Region

Please see the revised comments below reflecting the correct incident start time. On 14 June 2016, from approximately 16:01 to 19:25 UTC , our network engineers became aware of an issue impacting an external network provider for the DFW region. This issue occurred outside of our internal network, and at no point has the internal network been affected. Our data centers are designed to leverage multiple circuits of varying sizes in order to distribute and balance traffic efficiently. Rackspace cannot control the paths customer traffic takes outside of our network. Engineers filtered traffic from the affected provider to resolve impact. During time of impact, customers may have experienced latency, packet loss, or dropped connections impacting traffic traveling over the affected provider.

Rackspace
General Notice: Network Provider Issue | DFW Region

On 14 June 2016, at approximately 11:01 UTC , our network engineers became aware of an issue impacting an external network provider for the DFW region. This issue is occurring outside of our internal network, and at no point has the internal network been affected. Our data centers are designed to leverage multiple circuits of varying sizes in order to distribute and balance traffic efficiently. Rackspace cannot control the paths customer traffic takes outside of our network, and customers may continue to experience latency, packet loss, or dropped connections impacting traffic traveling over the affected provider.

Rackspace
Incident: Cloud Sites (Cloud Sites | Unable to Create Databases | ORD )

Resolved: Engineers restored service at 23:20 CDT.

Rackspace
Incident: Cloud Sites (Cloud Sites | Unable to Create Databases | ORD )

Unresolved: On 13 June 2016, at 22:00 CDT, engineers were alerted to issues affecting Cloud Sites in the ORD region. Cloud Sites engineers have been engaged and are investigating. During this time, customers may not be able to create databases and use one-click installs in the ORD data center.

Rackspace
Maintenance: Cloud Datastores | MySQL Host Evacuation | ORD Region

Our Engineers will be performing a planned emergency maintenance to the environment on June 16th from 2:00 AM to 6:00 AM CDT. During this maintenance, affected customers may experience 15 - 30 minutes of downtime. Additionally, affected customers will receive ticket notifications. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Rackspace CDN (Resolved: Rackspace CDN | Issues With Akamai CDN Edge Nodes | All Regions)

Resolved: On 13 June 2016, at approximately 07:08 CDT, our vendor, Akamai, began working to resolve issue affecting the Rackspace CDN. Akamai identified an issue replicating policy data across their edge data servers. The issue was resolved at 18:22 CDT. During the time of impact, a subset of customers may have experienced intermittent errors when routed to the affected edge data servers. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Rackspace CDN (Rackspace CDN | Issues With Akamai CDN Edge Nodes | All Regions)

Unresolved: On 13 June 2016, at approximately 07:08 CDT, engineers became of an issue affecting the Rackspace CDN. Our vendor, Akamai, identified an issue replicating policy data across edge data servers. During this time, a subset of customers may experience intermittent errors when routed to the affected edge data servers. Akamai engineers are working to resolve the issue. If you have any further questions, please contact a member of your support team.

Rackspace
Incident: Cloud Block Storage (Resolved: Cloud Block Storage | Cloud Block Storage API Degraded | DFW Region)

Resolved: From 12 June 2016, at 22:31 CDT, to 13 June 2016, at 13:00 CDT, engineers worked to resolve an issue affecting Cloud Block Storage (CBS) in the DFW region. During time of impact, customers may experience delays when performing CBS API functions (create, delete, etc.).

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Cloud Block Storage API Degraded | DFW Region)

Unresolved: Cloud Block Storage engineers confirmed that they are still experiencing issues and continue to investigate the CBS API issues. During this time, customers may experience delays when performing CBS API functions (create, delete, etc.).

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Cloud Block Storage API Degraded | DFW Region)

Unresolved: Cloud Block Storage engineers have restored API services; however, usability will remain degraded while queues catch up. During this time, customers may experience delays when performing CBS API functions(create/delete/etc.).

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Cloud Block Storage API Unavailable | DFW Region)

Unresolved: On 12 June 2016, at 22:31 CDT, engineers were alerted to issues affecting Cloud Block Storage (CBS) in the DFW region. Cloud Block Storage engineers are engaged and are investigating. During this time, CBS API functions (create, delete, etc.) are not available. Updates to follow as more information becomes available

Rackspace
General Notice: LiveChat Maintenance

On 11 June 2016, from 10:00 - 10:15 CDT (03:00 - 03:15 CDT), the vendor host for LiveChat, our Chat Support software, will be undergoing a maintenance window. During this time, chat support will be offline and customers may communicate with support via phone or ticket submission.

Rackspace
Incident: Control Panels (Resolved: Cloud Control Panel Billing Details Page Unavailable)

Resolved: On 10 June 2016, from 11:46 to 14:10 CDT, engineers worked to resolve an issue affecting Invoice Details in the Cloud Control Panel. During the affected time, customers may have been unable to access detailed billing information.

Rackspace
Incident: Control Panels (Cloud Control Panel Billing Details Page Unavailable)

Unresolved: Rackspace is aware of an issue affecting the Cloud Control Panel invoice details and our engineers are working to resolve it as quickly as possible. Customers may be unable to access detailed billing information. This information can still be provided to you by your support team. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Control Panels (Resolved: MyRackspace Maintenance)

Resolved: A MyRackspace maintenance is scheduled for today, Thursday, June 9th, at 21:00 CDT through 22:00PM CDT. The maintenance window is for 1 hour with an anticipated downtime of 30 Minutes.

Rackspace
Incident: Control Panels (Resolved: Cloud Control Panel Issues | LON3, LON5)

Resolved: On 10 June 2016, at approximately 08:26 UTC , engineers were alerted to an issue affecting the mycloud.rackspace.com portal. Engineers are currently engaged and working to resolve the issue. During this time, a small portion of Cloud customers may experience errors when attempting to log into mycloud.rackspace.com.

Rackspace
Incident: Control Panels (Cloud Control Panel Issues | LON3, LON5)

Unresolved: On 10 June 2016, at approximately 08:26 UTC , engineers were alerted to an issue affecting the mycloud.rackspace.com portal. Engineers are currently engaged and working to resolve the issue. During this time, a small portion of Cloud customers may experience errors when attempting to log into mycloud.rackspace.com.

Rackspace
Incident: Cloud Sites (Live Agent | Live Agent Not Assigning New Chats | SAT6)

Resolved: On 10 June 2016, from 02:55 to 04:00 CDT, engineers were alerted to an issue affecting Live Chat. Engineers were able to confirm with our vendor that a connectivity issue was experienced on their side and that the issue is now resolved. Engineers will continue to work with the vendor to determine the root cause of the issue. During the time of impact, Rackers were able to log into chat, but were unable to retrieve incoming customer chats. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Control Panels (Cloud Sites | FTP Upload Not Functioning | ORD1)

Resolved: On 10 June 2016, between 00:09 and 03:01 CDT, engineers addresses an issue affecting FTP uploads within the Cloud Sites Control Panel. Engineers found that updates within local software caused a change to the configuration of Anti-Virus (AV) nodes. Engineers edited the AV configuration to original settings in order to resolve the issue. During the time of impact, a portion of Cloud Sites customers may have been unable to use FTP to upload data into the Cloud Sites Control Panel. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Sites (Live Agent | Live Agent Not Assigning New Chats | SAT6)

Unresolved: On 10 June 2016, at approximately 02:30 CDT, engineers were alerted to an issue affecting Live Agent Chat Support. Engineers have been engaged and are working to resolve the issue. At this time, Rackers are able to log into chat, but are unable to retrieve incoming customer chats. You will need to call into phone queues or submit tickets to receive support at this time. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Control Panels (Cloud Sites | FTP Upload Not Functioning | ORD1)

Unresolved: The FTP issue has been corrected, however FTP uploads and performance continue to be monitored at this time.

Rackspace
Incident: Control Panels (Cloud Sites | FTP Upload Not Functioning | ORD1)

Unresolved: On 10 June 2016, at approximately 00:17 CDT, engineers were alerted to an issue with Cloud Sites FTP in the ORD1 data center. Engineers have been alerted and are working to resolve the issue. During this time, a portion of Cloud Sites customers may receive 500 errors when attempting to upload via FTP. If you have any questions, please reach out to a member of your support team.

Rackspace
Incident: Control Panels (MyRackspace Maintenance)

Unresolved: A MyRackspace maintenance is scheduled for today, Thursday, June 9th, at 21:00 CDT through 22:00PM CDT. The maintenance window is for 1 hour with an anticipated downtime of 30 Minutes.

Rackspace
Maintenance: Cloud Sites | ORD Maintenance | June 15 @ 10pm CDT

Cloud Sites Engineers will be performing maintenance on load balancers in the ORD datacenter. Maintenance is expected to last up to 2 hours. There should be no visible impact, however there is potential for some intermittent latency while traffic is routed on fewer load balancers. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
General Notice: Resolved: Support Group Phone Issues | LON Region

On 9 June 2016, at approximately 09:40 CDT, engineers became aware of an issue affecting LON Avaya hunt groups and worked to resolve the problem. As of 11:01 CDT, UK phone hunt service has been fully restored. During this time, calls to UK hunt groups may have been disrupted.

Rackspace
General Notice: Support Group Phone Issues | LON Region

On 9 June 2016, at approximately 09:40 CDT, Rackspace engineers became aware of an issue affecting the LON Region support group phones and are working to resolve the problem. During this time, calls to UK support groups may be disrupted and dropped.

Rackspace
Incident: Control Panels (Cloud Sites control panel impaired)

Resolved: All issues have been confirmed resolved as of 5:05am CDT.

Rackspace
Incident: Control Panels (Cloud Sites control panel impaired)

Unresolved: Our engineers have resolved all outstanding issues, however they continue to monitor performance closely.

Rackspace
Incident: Control Panels (Cloud Sites control panel impaired)

Unresolved: In addition to direct control panel issues, we have confirmed that SFTP is currently failing to connect. At this time FTP connections are currently available via port 21. Our engineers are working to resolve these issues as quickly as possible.

Rackspace
Incident: Cloud Files (Cloud Files | Cloud Files API Returns Errors | ORD and DFW Regions)

Resolved: On 8 June 2016, at 01:51 CDT, Cloud Files engineers worked to resolve issues affecting Cloud Files in the ORD and DFW regions. Engineers restored service at 03:20 CDT. During time of impact, customers trying to access their Cloud Files environment via the Control Panel or API may have encountered API errors.

Rackspace
Incident: Control Panels (Cloud Sites control panel impaired)

Unresolved: At this time our engineering team is working to resolve provisioning and features tab failures within the control panel. Additional information will be posted as soon as it is available.

Rackspace
Incident: Cloud Files (Cloud Files | Cloud Files API Returns Errors | ORD and DFW Regions)

Unresolved: On 8 June 2016, at 01:51 CDT, Cloud Files engineers were alerted to issues affecting Cloud Files in the ORD and DFW regions. During this time, customers trying to access their Cloud Files environment via the Control Panel or API may encounter API errors.

Rackspace
General Notice: Resolved: MyRackspace Portal | Issues viewing latest backups | All Regions

On 6 June 2016, from 07:30 to 23:48 CDT, Rackspace engineers worked to resolve an issue with MyRackspace Portal. During time of impact, customers may have been unable to view their latest backups via the MyRackspace Portal. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Databases (Cloud Databases | Database Instance Availability | ORD1)

Resolved: On 07 June 2016, at 07:11 CDT, Datastores engineers determined that the issue was not affecting any Rackspace DBaaS instances. There was no customer impact reported.

Rackspace
Incident: Cloud Databases (Cloud Databases | Database Instance Availability | ORD1)

Unresolved: On 7 June 2016, at 05:19 CDT, Rackspace engineers became aware of an issue affecting Cloud Database instances in the ORD region. During this time, customers may find their Cloud Database instances in a 'shutdown' state or may see their instances in 'read-only' status.

Rackspace
Incident: Cloud Block Storage (Resolved: Cloud Block Storage | Low Capacity 1TB Slots for CBS SSD | DFW Region)

Resolved: From 3 June 2016, at approximately 09:50 CDT, to 6 June 2016, at approximately 11:01 CDT, our engineers worked to restore capacity for 1 TB slots of CBS SSD in the DFW region. During the time of impact, customers who attempted to build 1 TB volumes in the DFW Region may have experienced intermittent build failures, if no 1 TB slots were available.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Low Capacity 90 and 120GB Performance Flavors | ORD1)

Resolved: From 31 May 2016, at 13:30 CDT, to 03 June 2016, at 06:41 CDT, Cloud Servers engineers detected that capacity for 90 and 120GB "High I/O" (Performance) flavors was low in the ORD region. Additional capacity was added to resolve the issue. During time of impact, there was potential that customers would experience intermittent build failures had available capacity been exhausted. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Databases (Resolved: Cloud Datastores | Cloud Database Status Issues | ORD Region)

Resolved: On 6 June 2016, at 05:09 CDT, Rackspace engineers became aware of an issue affecting Cloud Database instances in the ORD region. As of approximately 7:35 CDT, Cloud Database engineers have reported additional database instances in read only that went into 'read-only' status. During this time, customers may find their Cloud Database or Redis instances in a 'shutdown' state or may see their instances in 'read-only' status. Engineers confirmed this issue to be resolved at 9:00 CDT. During this time, customers may have experienced their Cloud Database instances in a 'shutdown' state or may see their instances in 'read-only' status until the issue was resolved.

Rackspace
Incident: Cloud Backup (Cloud Backup | 500 and 502 Errors | All Regions)

Resolved: From 02 June 2016, at 20:29, to 03 June 2016, at 00:51 CDT, engineers encountered an issue affecting the Cloud Backup Control Panel. Engineers were able to stabilize the environment by restarting processes and removing an affected node from rotation. During time of impact, some customers may have encountered intermittent 500 or 502 errors when accessing the Cloud Backup Control Panel. If you have any further questions, please reach out to a member of your support team.

Rackspace
General Notice: MyRackspace Portal | Issues viewing latest backups | All Regions

Rackspace is aware of an issue with MyRackspace Portal and our engineers are working to resolve it as quickly as possible. During this time, customers may have difficulty viewing their latest backups via the MyRackspace Portal. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Databases (Cloud Datastores | Cloud Database Status Issues | ORD Region)

Unresolved: As of approximately 7:35 CDT, Cloud Database engineers have reported additional database instances in read only that went into 'read-only' status. During this time, customers may find their Cloud Database or Redis instances in a 'shutdown' state or may see their instances in 'read-only' status.

Rackspace
General Notice: MyRackspace Portal | Unable to view latest backups | All Regions

Rackspace is aware of an issue with MyRackspace Portal and our engineers are working to resolve it as quickly as possible. During this time, customers may have difficulty viewing their latest backups via the MyRackspace Portal. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Databases (Cloud Datastores | Cloud Database Status Issues | ORD Region)

Unresolved: On 6 June 2016, at 05:09 CDT, Rackspace engineers became aware of an issue affecting Cloud Database instances in the ORD region. During this time, customers may find their Cloud Database instances in a 'shutdown' state or may see their instances in 'read-only' status. For further assistance, please contact a member of your support team.

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Reboot and Update of Switch F19-42-1 | IAD3)

Resolved: Resolved

Rackspace
Incident: Control Panels (New Virtual Machine Builds Intermittent failure)

Resolved: Resolved

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Reboot and Update of Switch F19-42-1 | IAD3)

Unresolved: On 04 June 2016, from 22:18 to 22:22 CDT, engineers updated the code to address a code bug for a Cloud Server switch in the IAD3 data center. Engineers rebooted the switch after the code update to resolve the issue. During this time, a small portion of Cloud Server customers may be unable to access their hosted data. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Back Ups SSL Certificate Expired)

Resolved: On 04 June 2016, from 18:59 to 22:12 CDT, Cloud Backup encountered an issue with the SSL certificate for clouddrive.rackspace.com expiring. Engineers were engaged and the SSL certificate was re-processed and installed, resolving the issue. During the time of impact, Cloud Back Up customers would have encountered a 'Certificate Expired' notification. Had they clicked to accept the expired certificate, everything would have processed as normal. If you have any further questions or concerns, please reach out to a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Back Ups SSL Certificate Expired)

Unresolved: Customers accessing Cloud Back Ups through MyRackspace may see notification of expired certificate. clicking to accept will still bring up the Cloud Back Ups panel.

Rackspace
Incident: Cloud Databases (Cloud DBaaS | Multiple Host Servers Down | LON3)

Resolved: On 04 June 2016, from 00:40 to 02:51 UTC , engineers worked to resolve an issue affecting three host servers for Cloud Datastores in the LON3 data center. Engineers found that after a host reboot a few mount points were left in a read-only state. Engineers manually re-pointed the mount points back correctly and restarted the affected containers to resolve the issue. During the time of impact, a small portion of Cloud Datastores customers hosted in the LON3 data center may have been unable to access their datastores. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Databases (Cloud DBaaS | Multiple Host Servers Down | LON3)

Unresolved: On 04 June 2016, at approximately 00:40 UTC , engineers detected an issue with Cloud DBaaS servers in the LON 3 data center. Engineers found that three hosts went down and rebooted. Engineers are engaged and currently working to restore all affected databases. During this time, some Cloud DBaaS customers hosted in the LON3 data center may be unable to access their datastores. If you have any other questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Block Storage (Cloud DBaaS | Multiple Host Servers Down | LON3)

Resolved: Please refer to Cloud DBaaS to follow the details on this issue.

Rackspace
Incident: Cloud Block Storage (Cloud DBaaS | Multiple Host Servers Down | LON3)

Unresolved: On 04 June 2016, at approximately 00:40 UTC , engineers detected an issue with Cloud DBaaS servers in the LON 3 data center. Engineers found that three hosts went down and rebooted. Engineers are engaged and currently working to restore all affected databases. During this time, some Cloud DBaaS customers hosted in the LON3 data center may be unable to access their datastores. If you have any other questions, please reach out to a member of your support team.

Rackspace
Maintenance: Cloud Sites | ORD & DFW Network Maintenance | June 6 @ 9pm CDT

At 9pm Cloud Sites Engineers will be performing network maintenance in both datacenters. Maintenance is expected to last up to 2 hours. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: IT Infrastructure Engineering | All Regions | June 7th, 2016

On 2016-06-07 at 02:00CDT (07:00UTC ), Cloud DNS management and provisioning of new services for Rack Connect servers, Databases, Big Data, Orchestration and CDN will be unavailable for a 3 hour maintenance. There is no impact to already provisioned services and DNS resolution. If customer have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Low Capacity 1TB Slots for CBS SSD | DFW Region)

Unresolved: Our engineers are working to bring additional capacity online for 1 TB slots of CBS SSD in the DFW region. During this time, customers who attempt to build 1 TB volumes in the DFW region may experience intermittent build failures, if no 1 TB slots are available. If you have any further questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Backup | 500 and 502 Errors | All Regions)

Unresolved: From 02 June 2016, at 20:29, to 03 June 2016, at 00:51 CDT, engineers encountered an issue affecting the Cloud Backup Control Panel. Engineers were able to stabilize the environment by restarting processes and removing an affected node from rotation. Engineers continue to monitor the stability of the environment. During the time of impact, some customers may have encountered intermittent 500 or 502 errors when accessing the Cloud Backup Control Panel. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Backup | 500 and 502 Errors | All Regions)

Unresolved: On 02 June 2016, at 20:29CDT, engineers detected an issue affecting the Cloud Backup Control Panel. Engineers have been engaged and are working to resolve the issue. During this time, customers attempting to access the Cloud Backup Control Panel may intermittently encounter 500 or 502 errors. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Backup | 500 and 502 Errors | All Regions)

Resolved: On 02 June 2016, from 20:29 to 22:02 CDT, engineers encountered an issue affecting the Cloud Backup Control Panel. Engineers were able to stabilize the environment by restarting processes and removing an affected node from rotation. During the time of impact, some customers may have encountered intermittent 500 or 502 errors when accessing the Cloud Backup Control Panel. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Backup (Cloud Backup | 500 and 502 Errors | All Regions)

Unresolved: On 02 June 2016, at 20:29CDT, engineers detected an issue affecting the Cloud Backup Control Panel. Engineers have been engaged and are working to resolve the issue. During this time, customers attempting to access the Cloud Backup Control Panel may intermittently encounter 500 or 502 errors. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Backup (Resolved: Cloud Backup | 505 Errors in Control Panel | All Regions)

Resolved: On 2 June 2016, from approximately 12:00 CDT to 16:00 CDT, Rackspace engineers worked to resolve an issue affecting the Cloud Backup control panel. During this time, customers attempting to access the Cloud Backup control panel may have received 505 errors. If you have further questions, please contact a member of your support team.

Rackspace
Maintenance: Cloud Sites | ORD Maintenance | June 7 @ 8pm CDT

Cloud Sites Engineers will be performing maintenance on load balancers in the ORD datacenter. Maintenance is expected to last up to 3 hours. There should be no visible impact, however there is potential for some intermittent latency while traffic is routed on fewer load balancers. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Backup (Cloud Backup | 505 Errors in Control Panel | All Regions)

Unresolved: Our engineers are aware of an issue affecting Cloud Backup and are working to resolve the problem. At this time, customers may receive intermittent 505 errors accessing Cloud Backup information in the control panel. Additional updates will be provided as new information becomes available.

Rackspace
Incident: Control Panels (New Virtual Machine Builds Intermittent failure)

Unresolved: Engineers are aware of an issue affecting new VM builds through MyRackspace. The team is investigating reports of intermittent new build failures.

Rackspace
Incident: Cloud Load Balancers (Cloud Load Balancer | Intermittent Connectivity | DFW Region)

Resolved: On 1 June 2016, at approximately 08:38 CDT, our engineers worked to resolve an issue affecting Cloud Load Balancers in the DFW Region. Engineers identified a high load on a Load Balancer and resolved the issue at 09:37 CDT. During time of impact, customers may have experienced intermittent connectivity issues to their Load Balancer instances. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Load Balancers (Cloud Load Balancer | Intermittent Connectivity | DFW Region)

Unresolved: On 1 June 2016, at approximately 08:38 CDT, our engineers are aware of an issue affecting Cloud Load Balancer in the DFW Region and our engineers are working to resolve it as quickly as possible. During this time, customers may experience intermittent connectivity issues to their Load Balancer instances. If you have any other questions or concerns, please contact a member of your support team.

Rackspace
Incident: Cloud Block Storage (Resolved: Cloud Block Storage | Volumes in Read-Only Mode | DFW)

Resolved: On 26 May 2016, at 21:26 CDT, Rackspace engineers were alerted to a switching loop issue affecting communication between Cloud Servers and Cloud Block Storage in our DFW region. Further investigation determined that the routing issues resulted in intermittent loss of ServiceNet connectivity for several nodes. During this time, customers may have been unable to access or change their storage volumes on the affected server. Additionally, volumes may have come back online in read-only mode requiring manual intervention. Customers utilizing Boot From Volume: To restore full read-write access to affected systems, customers should perform a reboot of their server. Please note that you may also need to perform a file system check (linux: fsck, Windows: chkdsk) of your disk if any corruption has occured. This should resolve any issues but, if you encounter other problems, please reach out to a member of your support team. Customers utilizing attached storage only: To restore full read-write access to affected storage volumes, you should take the following actions in listed order: (1) Unmount the storage volume (2) Run a file system check (linux: fsck, Windows: chkdsk) (3) Remount the volume in read-write mode Please Note: to avoid risk of data corruption, customers must unmount affected storage volumes PRIOR TO the file system check. Additional details can be found on the Rackspace Community: https://community.rackspace.com/products/f/25/t/7212 If you have any further questions or concerns, please reach out to a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Low Capacity 90 and 120GB Performance Flavors | ORD1)

Unresolved: Our engineers are working to bring additional capacity online for 90 and 120GB Performance 2 Cloud Servers in our ORD region. During this time, customers attempting to create new 90 or 120GB Performance 2 "High I/O" instances may experience build failures. We appreciate your patience during this time. If you have any further questions or concerns, please contact a member of your support team.

Rackspace
Maintenance: Cloud Block Storage | Planned Emergency | Starting Thursday, June 2nd, 2016 to April 26th, 2016

Rackspace Cloud Block Storage engineers will perform a planned emergency maintenance on a portion Cloud Block Storage environment in the following regions: CHG0063762 - ORD - June 2, 2016 10:00 PM CDT to June 3, 2016 1:00 AM CDT CHG0063774 - ORD - June 2, 2016 10:00 PM CDT to June 3, 2016 1:00 AM CDT CHG0063801 - IAD - June 7, 2016 10:00 PM CDT to June 8, 2016 1:00 AM CDT (June 7, 2016 11:00 PM EDT to June 8, 2016 2:00 AM EDT) CHG0063804 - IAD - June 8, 2016 10:00 PM CDT to June 9, 2016 1:00 AM CDT (June 8, 2016 11:00 PM EDT to June 9, 2016 2:00 AM EDT) CHG0063803 - IAD - June 9, 2016 10:00 PM CDT to June 10, 2016 1:00 AM CDT (June 9, 2016 11:00 PM EDT to June 10, 2016 2:00 AM EDT) CHG0063788 - IAD - June 13, 2016 10:00 PM CDT to June 14, 2016 1:00 AM CDT (June 13, 2016 11:00 PM EDT to June 14, 2016 2:00 AM EDT) CHG0063787 - LON - June 13, 2016 4:00 PM CDT to 11:00 PM CDT (June 13, 2016 10:00 PM BST to June 14, 2016 5:00 AM BST) CHG0063791 - ORD -June 14, 2016 10:00 PM CDT to June 15, 2016 1:00 AM CDT CHG0063786 - ORD -June 14, 2016 10:00 PM CDT to June 15, 2016 1:00 AM CDT CHG0063789 - IAD - June 14, 2016 10:00 PM CDT to June 15, 2016 1:00 AM CDT (June 14, 2016 11:00 PM EDT to June 15, 2016 2:00 AM EDT) During this maintenance, the Operating System will be reinstalled which will cause Cloud Block Storage volumes will disappear and become inaccessible. Those customers who have been identified as being impacted by this maintenance have been contacted and have been provided guidance on actions to take in order to avoid impact. If customer have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Maintenance: Cloud Block Storage | ORD | June 2nd, 2016

Rackspace Cloud Block Storage engineers will perform a planned emergency maintenance on a portion Cloud Block Storage environment in ORD. CHG0063762 - Thursday, June 2, 2016 10:00pm CDT - June 3, 2016 12:01am CDT During this maintenance, the Operating System will be reinstalled which will cause Cloud Block Storage volumes will disappear and become inaccessible. Those customers who have been identified as being impacted by this maintenance have been contacted and have been provided guidance on actions to take in order to avoid impact. If customer have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
General Notice: MyRackspace Portal | Connection Issues | All Regions

Rackspace is aware of performance issues with the my.rackspace.com portal and is currently investigating. Should you need to contact your support team please call 888-480-7640 or 0800 587 2306, +44(0)20 8734 2700 (UK). If you have any further questions, please contact a member of your support team.

Rackspace
Maintenance: IT Infrastructure Engineering | IAD | June 2nd, 2016

Rackspace Engineering team will be performing a disruptive emergency maintenance to our internal infrastructure in IAD. CHG0063702 - Thursday, June 2, 2016 2:00am CDT - 5:00am CDT (June 2, 2016 3:00am EDT - 6:00am EDT) During this time, customers will not be able to provision servers or modify DNS records. We have taken precautions in preparation for this maintenance and do not anticipate disruption to these services lasting longer than 3 hours. There will be no impact to customer environments during this maintenance. � If customer have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Cloud Block Storage (Cloud Block Storage | Volumes in Read-Only Mode | DFW)

Unresolved: On 26 May 2016, at 21:26 CDT, Rackspace engineers were alerted to a switching loop issue affecting communication between Cloud Servers and Cloud Block Storage in our DFW region. Further investigation determined that the routing issues resulted in intermittent loss of ServiceNet connectivity for several nodes. During this time, customers may have been unable to access or change their storage volumes on the affected server. Additionally, volumes may have come back online in read-only mode requiring manual intervention. Customers utilizing Boot From Volume: To restore full read-write access to affected systems, customers should perform a reboot of their server. Please note that you may also need to perform a file system check (linux: fsck, Windows: chkdsk) of your disk if any corruption has occured. This should resolve any issues but, if you encounter other problems, please reach out to a member of your support team. Customers utilizing attached storage only: To restore full read-write access to affected storage volumes, you should take the following actions in listed order: (1) Unmount the storage volume (2) Run a file system check (linux: fsck, Windows: chkdsk) (3) Remount the volume in read-write mode Please Note: to avoid risk of data corruption, customers must unmount affected storage volumes PRIOR TO the file system check. If you have any further questions or concerns, please reach out to a member of your support team.

Rackspace
General Notice: Switching Loop in DFW1

From 27 May 2016, at 21:26 to 00:34 CDT, engineers worked to resolve a switching loop issue occurring withing the DFW1 region. Engineers identified the loop occurring within RackConnect and disconnected RackConnect interfaces to isolate the loop and restore stability to the network. Interfaces and port channels were brought back online slowly to maintain network stability. The final port channel was restored at 00:34 CDT. Many services have been restored at this point. During the time of impact, customers may have experienced 400 errors when managing PTR records for Cloud DNS. Customers configured through RackConnect connections may have experienced downtime as the interfaces were brought back online. Cloud Block Storage customers and other bootable volume services may be currently in a read-only state, engineers continue to work towards resolving these issues. If you have any further questions or concerns, please reach out to a member of your support team.

Rackspace
General Notice: Switching Loop in DFW1

On 26 May 2016, from 21:26 to 23:00 CDT, engineers worked to resolve a switching loop with RackConnect within the DFW region. The interface that the loop was occurring within has been isolated, and other interfaces are being tested for confirmation of resolution. During this time, impact has been mitigated, however, services may experience latency or loss of connection intermittently during testing. Some customers who utilize RackConnect may still experience downtime as their interfaces are brought back online. If you have any further questions, please reach out to a member of your support team.

Rackspace
General Notice: Switching Loop in DFW1

On 26 May 2016, from 21:26 to 23:00 CDT, engineers worked to resolve a switching loop with RackConnect within the DFW region. The interface that the loop was occurring within has been isolated, and other interfaces are being tested for confirmation of resolution. During this time, impact has been mitigated, however, services may experience latency or loss of connection intermittently during testing. If you have any further questions, please reach out to a member of your support team.

Rackspace
General Notice: Switching Loop in DFW1

Engineers continue to work with DCOPS in isolating the switching loop occurring in RackConnect within the DFW region. Engineers have begun to remove interfaces to help alleviate impact to customers and help in isolating the switching loop. During this time, customers may be unable to access their Cloud instances hosted within the DFW1 region, Cloud DNS records pointed to DFW may give errors, and may be unable to reach parts of the dedicated environment through RackConnect, If you have any further questions, please reach out to a member of your support team.

Rackspace
General Notice: Switching Loop in DFW1

On 26 May 2016, at 21:26 CDT, engineers were alerted to a switching loop occurring in the DFW1 data center. Engineers are engaged and working to resolve the issue. During this time, Customers may be unable to access their Cloud instances hosted within the DFW1 data center. If you have any further questions, please reach out to a member of your support team.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | New Builds Delayed| ORD1)

Resolved: This issue has been resolved. New builds are now processing normally.

Rackspace
Maintenance: Cloud Sites | DFW1 Maintenance | June 1

At 9pm Cloud Sites Engineers will be disabling unused network devices in the old DFW1 datacenter infrastructure. Maintenance is expected to last for up to an hour. There is no expected impact as this is intended to identify any final systems that may still be in use. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Cloud Sites | DFW & ORD Windows Maintenance | May 30 through June 10

At 2am each night of the maintenance Cloud Sites Engineers will be performing maintenance on the Windows/IIS hosting platforms to apply routine patches issued by Microsoft. The length of each maintenance will vary depending on the node. There should be no visible ill effects, however, it is possible that a server being rebooted message may show up in some applications logs or sessions may be lost due to a node rebooting. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | New Builds Delayed| ORD1)

Unresolved: Hello, Rackspace is aware of an issue affecting new Cloud Servers builds in our ORD1 data center and our engineers are working to resolve it as quickly as possible. Customers may see new builds get delayed or stuck in the scheduling queue. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Issue Affecting Ubuntu Versions 12 and 14 Running Apache | All Regions)

Resolved: This issue has been resolved. Manual restart of Apache was required on the affected devices after completion of the Ubuntu updates.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud Servers | Issue Affecting Ubuntu Versions 12 and 14 Running Apache | All Regions)

Unresolved: Our engineers are aware of an issue affecting a portion of servers running Ubuntu versions 12 and 14 that are also running Apache. Further investigation has determined that this issue appears to be related to a recent Ubuntu update. After updating, Apache will not automatically start following a reboot, and requires manual intervention. Additional updates will be provided as new information becomes available.

Rackspace
General Notice: Cloud Block Storage | Cloud Image to Cloud Block Storage Volume Creation Degraded

On 24 May 2016, at approximately 22:01 CDT, Rackspace engineers identified an issue affecting Cloud Block Storage. During this time, customers may not be able to create a Boot From Volume instance or a bootable Cloud Block Storage device.

Rackspace
General Notice: Cloud Blcok Storage | Cloud Image to Cloud Block Storage Volume Creation Degraded

On 24 May 2016, at approximately 22:01 CDT, Rackspace engineers identified an issue affecting Cloud Block Storage. During this time, customers may not be to create a Boot From Volume instance or a bootable Cloud Block Storage device.

Rackspace
General Notice: Cloud Blcok Storage | Cloud Image to Cloud Block Storage Volume Creation Degraded

On 24 May 2016, at approximately 22:30 CDT, Rackspace engineers identified an issue affecting Cloud Block Storage. During this time, customers may not be to create a Cloud Server which boots from a Cloud Block Storage instance.

Rackspace
General Notice: Cloud Blcok Storage | Cloud Image to Cloud Block Storage Volume Creation Degraded

On 24 May 2016, at approximately 22:30 CDT, Rackspace engineers identified an issue affecting Cloud Block Storage. During this time, customers may not be able to create a Cloud Block Storage device from a Cloud Image using the Cloud Control Panel or the Rackspace NextGen API.

Rackspace
Incident: Cloud Sites (FTP - Network Latency and Timeouts)

Resolved: After monitoring the FTP servers and verifying service is working as usual, the system is now being marked as normal operation. Thank you for your patience.

Rackspace
Incident: Cloud Sites (FTP - Network Latency and Timeouts)

Unresolved: The FTP login issue has been resolved at this time. Thank you for your patience.

Rackspace
Incident: Cloud Sites (FTP - Network Latency and Timeouts)

Unresolved: The FTP login issue has been resolved at this time. Thank you for your patience.

Rackspace
Incident: Cloud Sites (FTP - Network Latency and Timeouts)

Unresolved: We have received reports of intermittent FTP and site timeout issues. Customers may be unable to access their websites via FTP. We are currently investigating the situation and will resolve the issue as soon as possible. If you have any further questions please feel free to contact a member of our support team.

Rackspace
Incident: Cloud Sites (Resolved: LiveChat | LiveChat unavailable | All Regions)

Resolved: On 22 May 2016, between 04:00 and 14:33 UTC , engineers worked to resolve an issue affecting Live Chat access. During the time of impact, chat support was intermittently unavailable through multiple Rackspace site locations. Engineers confirmed that LiveChat could be accessed through the Sales Chat link located on Rackspace.com. If you have any further questions, please contact a member of your support team.

Rackspace
General Notice: Resolved: LiveChat | LiveChat Intermittently Unavailable | All Regions

On 22 May 2016, between approximately 04:00 and 09:50 CDT, engineers worked to resolve an issue affecting Live Chat access. During the time of impact, chat support was intermittently unavailable through multiple Rackspace site locations. Engineers confirmed that LiveChat could be accessed through the Sales Chat link located on Rackspace.com throughout this time. If you have further questions, please reach out to a member of your support team.

Rackspace
General Notice: LiveChat | LiveChat Intermittently Unavailable | All Regions

On 22 May 2016, at approximately 04:00 CDT, engineers were alerted to an issue affecting Live Chat access from Rackspace sites. Engineers are engaged and working to resolve the issue. During this time, chat support is intermittently unavailable through multiple Rackspace site locations. Engineers have confirmed that LiveChat can be accessed through the Sales Chat link located on Rackspace.com. If you need urgent support, please reach out to a member of your support team via phone or ticket.

Rackspace
Incident: Cloud Sites (LiveChat | LiveChat unavailable | All Regions)

Unresolved: On 22 May 2016, at approximately 04:00 UTC , engineers were alerted to an issue affecting Live Chat access from Rackspace sites. Engineers are engaged and working to resolve the issue. During this time, chat support is intermittently unavailable through multiple Rackspace site locations. If you have any further questions, please reach out to a member of your support team.

Rackspace
General Notice: LiveChat | LiveChat Intermittently Unavailable | All Regions

On 22 May 2016, at approximately 04:00 UTC , engineers were alerted to an issue affecting Live Chat access from Rackspace sites. Engineers are engaged and working to resolve the issue. During this time, chat support is intermittently unavailable through multiple Rackspace site locations. Engineers have confirmed that LiveChat can be accessed through the Sales Chat link located on Rackspace.com. If you need urgent support, please reach out to a member of your support team via phone or ticket.

Rackspace
Incident: Control Panels (Cloud Sites Control Panel)

Resolved: On 19 May 2016, from 20:23 to 21:56 CDT, engineers detected an issue affecting the Cloud Sites Control Panel. Engineers determined that the issue was caused by a recent update pushed out to Cloud Sites load balancer software, which have been reverted to resolve the issue. During the time of impact, a portion of Cloud Sites customers may have been unable to access the Cloud Sites Control Panel. If you have any further questions, please reach out to a member of your support team.

Rackspace
Maintenance: RackConnect | All Regions | Tuesday, May 24th @ 9:45 PM CST

Rackspace RackConnect Engineering will be performing a non-service disrupting maintenance in all regions. CHG0063344 - All Regions - May 24th 9:45 PM to 11:00 PM CST This maintenance is planned as non-service disruptive; however, customers may encounter up to 15 minutes of event delays without events being dropped. If you have any questions or concerns in regards to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407 and INTL +1.210.581.0407.

Rackspace
Incident: Control Panels (Cloud Sites Control Panel)

Unresolved: At this time the Cloud Sites control panel is currently inaccessible. No websites are impaired at this time however if you need immediate assistance our technicians are available via telephone at 1-855-348-9060.

Rackspace
General Notice: Chat Support Inaccessible

Our team is working to resolve an issue causing Chat Support to appear offline. Please contact your support team directly via ticket or telephone for immediate assistance.

Rackspace
Maintenance: Cloud Sites | ORD DNS Maintenance | May 23 @ 8pm

Cloud Sites Engineers will be performing maintenance on the internal DNS systems in the ORD datacenter. Maintenance is expected to last up to an hour, however there is no expected impact. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Cloud Block Storage | Planned Emergency | IAD| Tuesday, May 24th, 2016

Rackspace Cloud Block Storage Engineers will perform a planned emergency maintenance on a portion Cloud Block Storage environment in IAD. CHG0063359 - May 24, 2016 11:30 AM CDT to 12:30 PM CDT (12:30 PM EST - 1:30pm EST) During this maintenance, Cloud Block Storage volumes will become inaccessible. Those customers who have been identified as being impacted by this maintenance have been contacted and have been provided guidance on actions to take in order to avoid impact. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud - Servers | A Small Subset of Customer Images Not Available | DFW region)

Resolved: This update was a false alarm. No actual customer impact was seen during this incident. Please contact a member of your support team if you have any questions.

Rackspace
Incident: Cloud Servers (Next Generation) (Cloud - Servers | A Small Subset of Customer Images Not Available | DFW region)

Unresolved: Hello, Rackspace is aware of an issue with Cloud Servers in our DFW data centers and our engineers are working to resolve it as quickly as possible. During this time a small portion of customers may be unable to access their saved image files. If you have any other questions or concerns, please contact a member of your support team. Sincerely, Rackspace

Rackspace
Incident: MS Exchange 2007 (Resolved: Hosted Exchange | MEX07 MBX18.dfw1 Database Corruption | DFW1)

Resolved: On 27 February 2016 at 18:00 CST, Exchange engineers identified an issue with an Exchange database in the DFW1 data center. The team determined that the database was corrupted and elected to schedule an emergency maintenance to migrate all mailboxes to a stable cluster. The Exchange team began the migration at 23:00 CST. Engineers monitored the migration of all affected mailboxes until the process was complete on 3 March 2016 at 17:47 CST. During this time, customers may have been unable to access their Exchange mailbox, but only during the migration window for a specific affected mailbox.

Rackspace
Maintenance: Next Gen Cloud Servers | All regions | Starting Thursday, May 19th at 9:00 AM CDT

The Rackspace Open Cloud system engineers will perform a priority maintenance to the control infrastructure of our Next Generation Cloud Servers regions during the following dates and times: CHG0062961 - HKG Region - May 19th from 9:00 AM - 3:00 PM CDT (May 19th from10:00 PM - May 20th to 4:00 AM HKT) During these times, customers accessing management level services (public APIs for these regions) may experience errors for a period of up to 30 minutes. This includes requests sent from the MyCloud Control Panel as well as those sent to the Next Gen Cloud Servers API directly (First Gen Cloud Servers management will not be affected). This maintenance will NOT pose any impact to existing Next Gen Cloud Servers under your account which are located in this region. However, certain operations being performed during this period may be interrupted (such as server builds, resizes, or snapshots). Customers are urged to perform these operations before or after this maintenance event. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Incident: Cloud Sites (Resolved: Cloud Sites - Intermittent Site Latency)

Resolved: On 16 May 2016, from 10:10 to 10:20 CDT, Cloud Sites engineers worked to resolve an issue causing intermittent latency for a portion of sites hosted in the ORD region. If you need immediate assistance, please contact a member of your support team by accessing live-chat or by calling 1.877.934.0407 or INTL +1.210.581.0407.

Rackspace
Incident: Cloud Sites (Cloud Sites - Intermittent Site Latency)

Unresolved: We have identified an issue causing intermittent delays for customers trying to access some sites hosted in the ORD datacenter. We are currently investigating the situation and will resolve the issue as soon as possible. If you need immediate assistance, please contact a member of our support team by visiting us in live-chat or by calling 1.877.934.0407 or INTL +1.210.581.0407.

Rackspace
Maintenance: Cloud Sites | ORD & DFW Load Balancer Maintenance | May 16, 17, 19 @ 8pm

Cloud Sites Engineers will be performing maintenance on the load balancers to update their core systems to the most recent releases for their respective software. Maintenance is expected to last for up to 2 hours each night. There should be no visible impact, however, there is potential for some latency when accessing sites in their respective datacenters. May 16: DFW3.wc1 May 17: DFW3.wc2 May 19: ORD load balancers If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: Network | DFW | May 17th 2016

Rackspace Engineering will be performing a scheduled maintenance for our Cloud Networks in DFW. CHG0062629 - Tuesday, May 17, 2016 10:00pm Central - May 18, 2016 12:01am Central The purpose of this maintenance is to ensure the newest network security measures are in place. During this maintenance, the isolated networks control plane will be down which means no new isolated networks can be created or changes to additional ones for DFW during this time. Additionally Any Broadcast, Unicast, and unknown multicast traffic will fail. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Maintenance: Cloud Data Stores | LON | May 25, 2016

The Rackspace Cloud Stores Engineers will be performing scheduled maintenance to migration for your Cloud Databases instance. Please review the following times associated with this maintenance events: CHG0062866 - LON - Wednesday, May 25, 2016, from 4:00 PM Central to 8:00 PM Central (May 25, 2016 10:00 PM BST to May 26, 2016 2:00 AM BST) During this maintenance, customers database(s) will experience a minimal downtime of up to ~5 minutes. Those customers who have been identified as being impacted by this maintenance have been contacted and however, this event does not require any action on their behalf. If you have any questions or concerns in regards to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407 and INTL +1.210.581.0407.

Rackspace
Incident: Cloud Databases (Cloud Databases| Storage Issues for DBAAS MySQL | IAD Region)

Resolved: This incident has been resolved.

Rackspace
Maintenance: RackConnect | ORD | May 12, 2016

Rackspace Engineers will be performing a required maintenance which will place a portion of RackConnect in read only status. Thursday - May 12, 2016 between 12:00pm Central - 1:00pm Central For approximately 1hr customers will not conduct any new server builds, renames, deletes, etc. Also, adding a public IP in RackConnect v3 will all be delayed for several minutes. If you have any questions or concerns in regards to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407 and INTL +1.210.581.0407.

Rackspace
Maintenance: Live Chat Maintenance | 22 May 2016

Our chat system will undergo a scheduled maintenance on Sunday, May 22nd between 1:00 AM - 1:20 AM US Central Time (06:00–06:20 UTC ). This event does not require any action on your behalf. During this time, the live chat functionality will be unavailable. Any open chat conversations will be disconnected at the start of the maintenance window. Once the maintenance is complete, the live chat function will once again be available. We apologize for any inconvenience this may cause. If you have any questions or concerns, please contact a member of your Sales or Support team.

Rackspace
Maintenance: Cloud Sites | DFW Emergency Storage Maintenance | May 10, 2016 @ 10pm CDT

Cloud Sites Engineers will be performing an emergency RAM swap on a storage unit in DFW at 10pm CDT. Maintenance is expected to last up to 2 hours. There should be no visible impact as the traffic is handed to the cluster. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Databases (Cloud Databases| Storage Issues for DBAAS MySQL | IAD Region)

Unresolved: On 9 May 2016, at 10:05 CDT, Datastores Engineers became aware of storage issues affecting DBAAS MySQL in the IAD region. During this time, customers may experience connection failures to their MySQL cloud databases or find their database instances in a "shutdown" status.

Rackspace
Maintenance: Systems DNS | All Regions | Starting May 11th 2016

Rackspace DNS Infrastructure Engineers will be performing a non-disruptive maintenance to our DNS servers in our datacenters. We have taken precautions in preparation for this maintenance and do not anticipate any disruption of service during this time. Please review the following times associated with this regional maintenance events: CHG0062942 - DFW - Wednesday, May 11, 2016 between 9:00am Central - May 12, 2016 2:00am Central ORD - Wednesday, May 11, 2016 between 9:00am Central - May 12, 2016 2:00am Central IAD - Wednesday, May 11, 2016 between 9:00am Central - May 12, 2016 2:00am Central (May 11, 2016 10:00am ET - May 12, 2016 3:00am ET) LON - Wednesday, May 11, 2016 between 9:00am Central - May 12, 2016 2:00am Central (May 11, 2016 3:00pm BST - May 12, 2016 8:00am BST) CHG0062975 - DFW - Thursday, May 12th between 11:00am Central - May 13, 2016 4:00am Central ORD - Thursday, May 12th between 11:00am Central - May 13, 2016 4:00am Central IAD - Thursday, May 12th between 11:00pm Central - May 13, 2016 4:00am Central (May 13, 2016 12:00am ET - May 13, 2016 5:00am ET) LON - Thursday, May 12th between 11:00am Central - May 13, 2016 4:00am Central (May 12, 2016 5:00pm BST - May 13, 2016 10:00am ET) The purpose of this maintenance is to ensure the newest network security measures are in place. During this maintenance, the isolated networks control plane will be down which means no new isolated networks can be created or changes to additional ones for DFW during this time. Additionally Any Broadcast, Unicast, and unknown multicast traffic will fail. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Maintenance: Rackconnect | Planned Emergency | SYD | Wednesday, May 11th, 2016

Rackspace Engineers will be performing a planned emergency maintenance in SYD region. CHG0062922 - Wednesday, May 11, 2016, from 09:01 AM Central to 09:15 AM Central (May 12, 2016 00:01 AM ASET to 00:15 AM ASET) During this maintenance window, customers may experience latency or a small number (typically this has been less than 5) of lost packets. If you have any questions or concerns in regard to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407.

Rackspace
Maintenance: Cloud Sites | ORD Storage Maintenance | May 24-26, 2016 @ 10pm CDT

Cloud Sites Engineers will be performing maintenance on the storage units in the ORD datacenter. This will enhance performance and stability with the platform. Maintenance is expected to last for up to 2 hours each night. During the maintenance impact should be minimal, however there will be brief periods of read only access and then a moment of unavailability while the system is pointed to use the new storage. The schedule for which units are affected each night is below. May 24: /mnt/Target01, /mnt/target05 May 25: /mnt/target02. /mnt/target03 May 26: /mnt/target06, /mnt/stor09-wc1-ord1, /mnt/stor11-wc1-ord1, /mnt/stor12-wc1-ord1 If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Maintenance: RackConnect | All Regions | Thursday, May 10th @ 9:50 PM CST

Rackspace RackConnect Engineering will be performing a non-service disrupting maintenance in ORD region. CHG0062797 - All Regions - May 10th 9:50 PM to 11:00 PM CST This maintenance is planned as non-service disruptive; however, customers may encounter up to 15 minutes of event delays without events being dropped. If you have any questions or concerns in regards to this maintenance, please do not hesitate to contact a member of our support team via live-chat or by telephone 24-hour toll free 1.877.934.0407 and INTL +1.210.581.0407.

Rackspace
Maintenance: Cloud Sites | DFW & ORD Emergency Maintenance | May 5, 2016 @ 8pm CDT

Cloud Sites Engineers will be performing emergency maintenance on the load balancers in the both the DFW and ORD datacenters. Maintenance is expected to last up to an hour for each datacenter for a total of 2 hours, during which it may cause intermittent connectivity issues for sites as the load balancers are rebooted. If you have any questions, please do not hesitate to contact a member of our support team via live-chat or by toll free phone at 1.877.934.0407.

Rackspace
Incident: Cloud Sites (mysql51-061.wc1.ord1.stabletransit.com: Databases in Read Only)

Resolved: The new master has been working as expected, so this is being marked as resolved.

Rackspace
Incident: Cloud Sites (mysql51-061.wc1.ord1.stabletransit.com: Databases in Read Only)

Unresolved: At this time the database host has been set to the new master and databases should be functioning normally. Please contact a member of support should you require further assistance.