Active Incident

Updated a few seconds ago

Remediation: Degraded Metrics PerformancePartial Service Disruption

Incident Status

Partial Service Disruption

Components

CoreWeave Services

Locations

US-ORD1, US-LAS1, US-LGA1


April 17, 2024 2:20PM UTC
[Monitoring] We are actively working to remediate an issue that may be impacting the availability of our metrics. During this time, you may see interruptions in services such as: Grafana, Cloud Metrics, and Availability API. We apologize for any inconvenience this may cause and thank you for your patience while we work to resolve the matter in a timely manner.

April 18, 2024 4:11PM UTC
[Monitoring] We are still working on our efforts towards remediation, and we anticipate completing our mitigation work within the next 24 hours. Thank you for your patience, and please reach out to [email protected] if you have additional questions.

April 19, 2024 4:35PM UTC
[Monitoring] We are continuing our efforts to remediate this issue. In the interim, you may continue to see partial disruptions to our metrics. Thank you again for your patience as we continue to work through this issue.

CoreWeave Cloud




Operational

CoreWeave Inference




Operational

Concierge Render




Operational

CoreWeave Shared Filesystem Volumes




Operational

CoreWeave Object Storage




Operational

CoreWeave Block Storage Volumes




Operational

CoreWeave Services




Partial Service Disruption

CoreWeave Premium Shared Filesystem Volumes




Operational

0

Upcoming Maintenances

7

Incidents Last 30 Days

10

Maintenances Last 30 Days

External Services

Cloudflare

Docker

History (Last 7 days)

CoreWeave Metrics MaintenancePlanned Maintenance

Description

CoreWeave will perform unscheduled metrics maintenance in order to increase reliability and stability on client facing metrics. Query performance to Mimir will be degraded for the duration of the maintenance.


Components

CoreWeave Services


Locations

US-ORD1, US-LAS1, US-LGA1


Schedule

April 16, 2024 2:34PM - April 16, 2024 2:34PM UTC


April 16, 2024 2:39PM UTC
[Update] Maintenance is starting.

April 16, 2024 8:04PM UTC
[Update] The metrics maintenance is now completed.
Coreweave Metrics MaintenancePlanned Maintenance

Description

CoreWeave will perform unscheduled metrics maintenance in order to increase reliability and stability on client facing metrics. Query performance to Mimir will be degraded for the duration of the maintenance.


Components

CoreWeave Services


Locations

US-ORD1, US-LAS1, US-LGA1


Schedule

April 15, 2024 9:45PM - April 16, 2024 2:45AM UTC


April 15, 2024 9:45PM UTC
[Update] Unscheduled maintenance is starting.

April 16, 2024 2:45AM UTC
[Update] Scheduled maintenance is complete.
Degraded Metrics PerformanceDegraded Performance

Incident Status

Degraded Performance


Components

CoreWeave Services


Locations

US-ORD1, US-LAS1, US-LGA1



April 15, 2024 4:56PM UTC
[Investigating] Hello, We are actively investigating a metrics issue that is impacting the availability of our metrics. As the situation evolves, we will continue to provide our customers with updates on the matter. If you have any questions, we encourage you to reach out to support by email: [email protected]. We apologize for any inconvenience this may cause and thank you for your patience while we work to resolve the matter in a timely manner. Thank you,

April 15, 2024 5:33PM UTC
[Monitoring] We believe the metrics issue has been mitigated but we are continuing to actively monitor the affected services. As a result of this incident, there may be gaps in metrics when running queries. If you are continuing to experience issues please reach out to [email protected].

April 15, 2024 6:00PM UTC
[Resolved] We believe the issue to be resolved and in a stable state.
CoreWeave Scheduled Metrics MaintenancePlanned Maintenance

Description

CoreWeave will perform routine metrics maintenance. A brief (30 second) gap in metrics is possible, but not expected.


Components

CoreWeave Services


Locations

US-ORD1, US-LAS1, US-LGA1


Schedule

April 15, 2024 1:00PM - April 15, 2024 5:00PM UTC


April 15, 2024 1:00PM UTC
[Update] Scheduled maintenance is starting.

April 15, 2024 5:00PM UTC
[Update] Scheduled maintenance is complete.