Active Incident

Updated a few seconds ago

DNS Service Disruption - US-EAST-04Service Disruption

Incident Status

Service Disruption

Components

CoreWeave Cloud, CoreWeave Inference, CoreWeave Shared Filesystem Volumes, CoreWeave Object Storage, CoreWeave Services, CoreWeave Premium Shared Filesystem Volumes

Locations

US-EAST-04


September 9, 2024 6:20PM UTC
[Investigating] Hello, We are actively investigating a service disruption impacting customers in US-EAST-04, and causing nodes to go into an unready state. As the situation evolves, we will continue to update our customers on the matter. If you have any questions, we encourage you to reach out to support by email: support@coreweave.com We apologize for any inconvenience this may cause and thank you for your patience while we work to resolve the matter in a timely manner. Thank you, CoreWeave Support

September 9, 2024 6:58PM UTC
[Identified] We have identified connectivity issues with the clusters in US-EAST-04 and are actively working on a resolution.
Storage IncidentOperational

Incident Status

Operational

Components

CoreWeave Shared Filesystem Volumes

Locations

US-ORD1


September 6, 2024 5:47AM UTC
[Investigating] Hello, We are actively investigating a storage issue that may be impacting our storage services. As the situation evolves, we will continue to update our customers on the matter. If you have any questions, we encourage you to reach out to support by email: support@coreweave.com We apologize for any inconvenience this may cause and thank you for your patience while we work to resolve the matter in a timely manner. Thank you, CoreWeave Support

September 6, 2024 6:34AM UTC
[Monitoring] We believe the issue has been mitigated but we are continuing to actively monitor the affected services.

CoreWeave Cloud




Service Disruption

CoreWeave Inference




Service Disruption

CoreWeave Shared Filesystem Volumes




Service Disruption

CoreWeave Object Storage




Service Disruption

CoreWeave Block Storage Volumes




Operational

CoreWeave Services




Service Disruption

CoreWeave Premium Shared Filesystem Volumes




Service Disruption

0

Upcoming Maintenances

6

Incidents Last 30 Days

4

Maintenances Last 30 Days

External Services

Cloudflare

Docker

History (Last 7 days)

Slow Storage PVC CreationDegraded Performance

Incident Status

Degraded Performance


Components

CoreWeave Shared Filesystem Volumes, CoreWeave Block Storage Volumes


Locations

US-ORD1, US-LAS1, US-LGA1



September 7, 2024 7:38PM UTC
[Identified] We have identified a storage issue that may be impacting our storage services. This can result in the slow creation of PVCs during the next 48 hours for the affected storage types. As the situation evolves, we will continue to update our customers on the matter. If you have any questions, we encourage you to reach out to support by email: support@coreweave.com We apologize for any inconvenience this may cause and thank you for your patience while we work to resolve the matter in a timely manner.

September 8, 2024 2:48PM UTC
[Resolved] We have identified the issue and reached a resolution. Storage PVC creation abilities are running as expected again at this time. If you are experiencing an issue or have any further questions please reach out to support@coreweave.com.
Degraded Metrics PerformanceDegraded Performance

Incident Status

Degraded Performance


Components

CoreWeave Services


Locations

US-ORD1, US-LAS1, US-LGA1



September 4, 2024 8:20AM UTC
[Investigating] Hello, We are actively investigating a metrics issue that may be impacting the availability of our metrics. As the situation evolves, we will continue to provide our customers with updates on the matter. If you have any questions, we encourage you to reach out to support by email: [support@coreweave.com](mailto:support@coreweave.com) We apologize for any inconvenience this may cause and thank you for your patience while we work to resolve the matter in a timely manner. Thank you, CoreWeave Support

September 4, 2024 10:04AM UTC
[Monitoring] We believe the metrics issue has been mitigated but we are continuing to actively monitor the affected services.

September 4, 2024 12:23PM UTC
[Resolved] We believe the issue to be resolved and in a stable state.
Networking IncidentPartial Service Disruption

Incident Status

Partial Service Disruption


Components

CoreWeave Cloud, CoreWeave Inference, CoreWeave Shared Filesystem Volumes, CoreWeave Object Storage, CoreWeave Block Storage Volumes, CoreWeave Services, CoreWeave Premium Shared Filesystem Volumes


Locations

US-ORD1, US-LAS1, US-LGA1



September 4, 2024 12:51AM UTC
[Investigating] Hello, We are actively investigating a networking issue that may be impacting the availability of our services. As the situation evolves, we will continue to provide our customers with updates on the matter. If you have any questions, we encourage you to reach out to support by email: support@coreweave.com We apologize for any inconvenience this may cause and thank you for your patience while we work to resolve the matter in a timely manner. Thank you, CoreWeave Support

September 4, 2024 12:54AM UTC
[Investigating] We are investigating the network issue impacting LGA1, LAS1 and ORD1.

September 4, 2024 1:15AM UTC
[Identified] Our engineers have identified the issue and are continuing to work towards a resolution. As the situation evolves, we will continue to update our customers on the matter. If you have any questions, we encourage you to reach out to support by email: support@coreweave.com We apologize for any inconvenience this may cause and thank you for your patience while we work to resolve the matter in a timely manner. Thank you, CoreWeave Support

September 4, 2024 2:18AM UTC
[Monitoring] We believe the issue has been resolved and we are actively monitoring the situation. If you are still experiencing an issue please reach out to support@coreweave.com.

September 4, 2024 3:42AM UTC
[Resolved] All CoreWeave services are now operational. If you are continuing to experience issues please reach out to support@coreweave.com.
Scheduled CoreWeave Network Maintenance - ORD1Planned Maintenance

Description

Details: CoreWeave will be performing network maintenance on Tuesday, September 3 from 5:30 PM UTC to 6:00 PM UTC that will affect our ActiveLogic/FIP nodes. Location: ORD1 Scope: ActiveLogic/FIP nodes in ORD1 have recently encountered issues with NAT. A configuration change will be deployed to temporarily work around the issue until Sandvine releases an official firmware with the bug fix. Impact: Nat address translations will fail for around 30 seconds, and worst case for 2-3 minutes. We will be actively monitoring the situation during this time. We appreciate your patience and understanding. If you have any further questions or require assistance, please don't hesitate to reach out to our support team at support@coreweave.com This activity is deemed Planned Maintenance under the CoreWeave Terms of Service Maintenance Policy ( https://docs.coreweave.com/policies/terms-of-service/maintenance-policy )


Components

CoreWeave Services


Locations

US-ORD1


Schedule

September 3, 2024 5:30PM - September 3, 2024 6:00PM UTC


September 3, 2024 5:31PM UTC
[Update] Planned maintenance has started.

September 3, 2024 6:38PM UTC
[Update] Planned maintenance has been completed.