Past Incidents

We are aware that SEA137KVM is currently experiencing connectivity issues.

We are currently looking into this node further and will provide additional updates on this matter once we have more information.

UPDATE: This is now resolved. If you are still experiencing any issues please open a support ticket and we'd be happy to assist.

We are aware that P007LAKVM is currently experiencing connectivity issues. We are looking into this node further and will provide additional updates once we have more information.

UPDATE: This is now resolved. If you are still experiencing any issues please open a support ticket and we'd be happy to assist.

We are investigating a potential hardware issue with SEA100KVM - one of our KVM VPS host nodes in Seattle. We will update this status incident with additional information once available.

In the meantime, please note that you may notice intermittent connectivity if you have a VPS hosted on this node.

UPDATE: This issue is still being actively worked on. We appreciate your patience.

UPDATE: SEA100KVM is experiencing instability due to multiple hardware issues. Our investigation indicates that the motherboard and CPU are likely the source of the problem. We want to assure you that data integrity is not at risk, and storage systems remain unaffected. Our team is actively working closely with the Seattle datacenter remote hands team on resolving these hardware complications to restore full functionality.

We appreciate your patience and will provide further updates as we make progress.

UPDATE: We have completed work on replacing the faulty hardware components and the server is in a stable condition.

UPDATE: We may need to reboot this server one last time to apply some updates. We will update once we are fully completed with our work on this host node.

UPDATE Aug/4/2024 10:30 AM PDT:

We have successfully transplanted the drives on SEA100KVM over to another physical server, eliminating all hardware issues. The server is now stable with all data/settings intact; however, we've detected intermittent packet loss following the transplant operation.

This appears to be an unrelated issue or a networking conflict that emerged during or after the transfer process. As such, it is no longer considered a hardware problem, and this is not connected to the original hardware problem. We have escalated this matter to our upstream's Engineering team to review.

Current Status:

• The physical server is stable from a hardware perspective
• Your virtual machine (VM) should be accessible
• You may experience minimal packet loss, but overall functionality should not be significantly impacted

We are closely monitoring the situation and will provide another update once the issue is fully resolved. We appreciate your patience during this process.

If you experience any critical issues, please don't hesitate to contact our support team.

UPDATE Aug/4/2024 6:00 PM PDT: Status: Resolved

The numerous issues affecting SEA100KVM has been resolved. All services have been restored to normal operation. We will continue to closely monitor the stability of this node to ensure optimal performance. Thank you for your patience during this incident.

A scheduled maintenance window event is currently ongoing within one of our cabinets in our Chicago datacenter, which impacts 2x physical hypervisors in this location (7950XCHI301, CHI166KVM). Affected clients were sent an e-mail notification regarding this scheduled maintenance event earlier along with full details.

This maintenance is now in progress, and being actively worked on. We will update this status incident once fully resolved.

UPDATE: This node CHI166KVM is now resolved. If you are still experiencing any issues please open a support ticket and we'd be happy to assist.

UPDATE: This node 7950XCHI301 is now resolved. If you are still experiencing any issues please open a support ticket and we'd be happy to assist.

The below email has been sent to all affected customers via email.

DATE: Friday, August 23, 2024

START TIME: 10:30 AM Los Angeles Time (UTC-7)

END TIME: 1:00 PM Los Angeles Time (UTC-7)

Hello,

Specialized electricians will be performing power maintenance on electrical circuits within cabinets located in the nerd5 section of the Los Angeles DC-02 datacenter. While we have allocated a 2.5 hour maintenance window to allow extra room for any unexpected complications, we anticipate the work being completed quite faster than the stated end time.

SERVICE:

This maintenance is crucial to ensure future service continuity and stability. The work involves upgrading and reinforcing the power distribution units (PDUs) and electrical feeds to the nerd5 section cabinets. This proactive measure will enhance the resilience of our power infrastructure, reducing the risk of unexpected outages and improving overall system reliability.

IMPACT OF WORK:

During this time frame, physical host nodes (also referred to as "hypervisors") in the nerd5 section will be powered off and then powered back on as the circuit maintenance is completed.

IMPACTED NODE(S):

This maintenance will affect all nodes/hypervisors within the nerd5 section of RackNerd's Los Angeles DC-02 datacenter. You are receiving this email as our system has detected you have one or more VPS's located within the nerd5 section. To identify if your VPS is hosted on an affected node, please check if your node name contains "nerd5". For instructions on how to find the node name your VPS resides on, please refer to this video: https://www.youtube.com/watch?v=YXZhXkjSSdg

If you have any questions or concerns, please feel free to email [email protected] and we would be more than happy to assist you.

NOTE: This status incident is currently marked as resolved to serve as a advance notice (notification was also sent via email). We will create a new status incident again when the maintenance window is active on August 23, 2024.

We are aware that LAXSSD6015nerd7DC02 is currently experiencing connectivity issues. We are currently looking into this node further and will provide additional updates on this matter once we have more information.

UPDATE: This is now resolved. If you are still experiencing any issues please open a support ticket and we'd be happy to assist.

As a follow-up to https://status.racknerd.com/incident/2249 - please be aware that there is currently a scheduled maintenance event which impacts the following physical hypervisors:

P70LAKVM, P007LAKVM, P33LAKVM, P006LAKVM, P019LAKVM, P50LAKVM

We will update this status incident once the maintenance window has concluded. We anticipate this coming back online within the next 30-60 minutes. Thank you for your patience.

UPDATE: These should be back online shortly, affected cabinets are starting to get transitioned over to the temporary power feed now.

UPDATE: Significant progress is being made and a majority of these mentioned nodes are already back online. We'll update once this is fully concluded.

UPDATE: This should now be completed and these nodes are now back online. If you are still experiencing any issues, please feel free to open a support ticket and we'll be happy to assist.