PlanetScale
Infrastructure. Source: PlanetScale status page.
- Incidents, last 90 days
- 6
- Median duration
- 47m
- p95 duration
- 3h
- Naming an upstream provider
- 66%
- With a postmortem on the status page
- 0%
What failed, last 90 days
| Data delayed, stale, lost or corrupted, or needing replay after recovery | 2 |
| A provider or third-party service this vendor depends on failed | 1 |
| Orchestration, control plane, service discovery or load balancing failed | 1 |
| Network, DNS, routing or connectivity failure | 1 |
| A code release introduced the failure | 1 |
Tagged by claude-haiku-5-5 from each incident's updates. See the methodology.
Incidents per month
All recorded incidents
Gap in dashboard metrics for AWS us-east-1
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: AWS.
-
monitoring
From 19:20 - 19:30 UTC we had a delay with metrics in AWS us-east-1. For databases in this region you may see missing metrics in the dashboard. We've made a fix and are seeing metrics recover.
-
resolved
The issue has been resolved.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
AWS us-east-1 connectivity failures
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: AWS.
-
investigating
We are investigating reports of connectivity failures scoped to a single AZ in AWS us-east-1 causing replica delay and connectivity issues.
-
monitoring
A small number of database branches in AWS us-east-1 were impacted by cross-zone networking issues, for which the impact window has ended. If you continue to see impact, please reach out to PlanetScale support.
-
resolved
AWS us-east-1 cross-zone networking has fully recovered.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Branch creation delays in GCP europe-west-1
Failure mode: Orchestration, control plane, service discovery or load balancing failed. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: Google Cloud.
-
investigating
We have identified an issue and are investigating branch creation delays in GCP europe-west-1.
-
identified
We have identified a problem relating to scheduling of database branches and are rolling out a mitigation.
-
resolved
We have resolved the branch creation issue and no further impact is expected at this time.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Connectivity issues with Vitess databases in GCP
Failure mode: Network, DNS, routing or connectivity failure. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: Google Cloud.
-
investigating
We're currently experiencing issues with connectivity to Vitess databases in GCP. We're investigating the issue.
-
monitoring
We've identified an issue in our networking and deployed mitigation. Connectivity is back to normal. We're continuing to monitor.
-
resolved
We've identified an issue with database connectivity for Vitess databases in GCP. We've taken steps to resolve the issue and are making immediate improvements to address root-causes and detection. Databases connectivity is now restored.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Dashboard and API 500 errors for postgres databases
Failure mode: A code release introduced the failure. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
monitoring
For postgres databases, API requests and the dashboard were returning 500 errors. We've deployed a fix.
-
resolved
The incident has been resolved. Between 12:17 and 12:24 UTC, the dashboard and API were returning 500 errors for postgres database management pages and API endpoints.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Insights metrics underreporting
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
identified
Insights metrics are underreporting for Postgres and Vitess databases. Database traffic and connectivity are unaffected. We are actively investigating the issue and are deploying mitigations.
-
monitoring
Mitigations are in place and we're seeing signs of recovery. We continue to monitor the health of the system.
-
resolved
The incident has been resolved.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Insights metrics underreporting
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
Insights metrics are underreporting for Postgres and Vitess databases. Database traffic and connectivity are unaffected. We are actively investigating the Insights issue.
-
identified
We have identified the cause of reduced Query Insights metrics reporting and are working on remediations.
-
identified
We are continuing to work towards remediation.
-
identified
We have temporarily disabled Query Insights in Postgres development branches to relieve an overloaded component in the Query Insights processing pipeline. We are working to restore Query Insights to all branches as quickly as possible.
-
identified
We are seeing recovery of Query Insights across all branches, except for Postgres development branches which where we disabled Query Insights to relieve pressure on an overloaded component. We are working to restore Query Insights to development branches as quickly as possible.
-
identified
Query Insights is recovered across all branches except for Postgres development branches, where recovery is happening gradually. We are working to accelerate recovery of Query Insights Postgres development branches.
-
monitoring
Query Insights is gradually recovering across all Postgres development branches.
-
resolved
Query Insights functionality is restored on all Postgres development branches.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Connectivity issues in us-east-1
Failure mode: A zone, region or data center became unavailable. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
Names an upstream provider: AWS.
-
investigating
We are observing connectivity issues on Postgres in the us-east-1 region. We are remediating.
-
monitoring
We remediated the issue, and clients can now connect to their database branches in us-east-1 normally. We will continue monitoring the situation.
-
resolved
Connection issues have been resolved. If you experience any further issues, please contact our support team.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
API and dashboard errors
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are aware that both our API and dashboard are returning errors. We are investigating the cause and will restore service as soon as possible.
-
identified
We have identified the cause of the errors - a pattern of requests causing the application to run out of memory and crash - and are working to better handle this traffic pattern now.
-
monitoring
We have increased the memory available to the API and are monitoring the performance and stability of the API and dashboard to confirm service is restored.
-
resolved
API and dashboard service is restored.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Single Sign On (SSO) unavailable
Failure mode: Login, tokens, certificates or credentials failed. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
SSO login to the PlanetScale website and API is unavailable. We are investigating. Database operations are unaffected.
-
resolved
The issue is resolved. SSO is working fine again.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Development branches with MySQL Vectors not serving
Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
PlanetScale initiated a system wide upgrade of branches with Vectors enabled and running on MySQL 8.0 to MySQL 8.4. A number of development branches were disrupted and have not yet recovered. We are investigating and remediating.
-
identified
We have identified the issue and are rolling impacted development branches from 8.4 back to 8.0.
-
monitoring
Branches are recovering and we are monitoring the situation.
-
resolved
All impacted branches are recovered. PlanetScale upgraded development Vitess branches with Vectors enabled from MySQL 8.0.x to 8.4.x. PlanetScale runs an internal fork containing support for PlanetScale's MySQL Vectors indexes. A bug in the 8.4.x version of our Vectors builds...
Excerpts are shortened. Read the full incident on PlanetScale's status page.
There is an incident in PlanetScale GCP us-central1 region impacting Postgres database availability. We are actively investigating and will update as soon as we have more information.
Failure mode: Orchestration, control plane, service discovery or load balancing failed. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: Google Cloud.
-
investigating
A high availability component that Postgres clusters depend on is restarting unexpectedly, triggering unplanned failovers in Postgres clusters.
-
identified
We have identified the likely cause of unexpected restarts to the high availability component used by Postgres clusters, and are applying changes to prevent recurrences.
-
monitoring
We applied changes to prevent unexpected restarts of the high availability component shared by Postgres clusters. We have not seen further restarts of this component nor unplanned Postgres failovers since applying these changes. We are actively monitoring the situation.
-
resolved
The changes we applied are effectively preventing further unexpected restarts to the high availability component shared by Postgres clusters. We have not seen further restarts to this component nor unplanned failovers in Postgres clusters since applying these changes.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Database operations degraded in eu-west-2
Failure mode: A zone, region or data center became unavailable. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We're aware of a degradation in eu-west-2 where database operations such as resizes, branch creations or parameter changes may not complete. We're investigating the problem.
-
monitoring
We've identified the issue and have taken steps to mitigate it. Database operations will successfully complete again. We continue to monitor the situation.
-
resolved
PlanetScale has remediated the issue and it is fully resolved.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
AWS use1-az4 thermal event
Failure mode: Hardware, power, cooling or another physical failure. Root cause: Hardware or facility. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
Names an upstream provider: AWS.
-
monitoring
PlanetScale is aware of the AWS use1-az4 thermal event. We expect databases to be unaffected. Please contact support if you have any questions or notice any disruption.
-
resolved
PlanetScale is not observing any database impact resulting from the AWS use1-az4 thermal event. Please contact support if you have any questions or notice any disruption.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Errors with database webhooks
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We're investigating an issue with webhook deliveries failing.
-
monitoring
We've made a fix and are seeing webhooks trigger properly again.
-
resolved
The errors have been resolved.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Currently experiencing issues with creating/updating/deleting Vitess credentials
Failure mode: Login, tokens, certificates or credentials failed. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
All existing credentials still work and will continue to work. We are investigating an issue affecting only modifying or creating new ones.
-
monitoring
We have applied a fix and see recovery.
-
resolved
Some percentage of new credential creates, updates, and deletes errored or were very slow for approx 35 minutes.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
us-east-1 connection errors
Failure mode: CDN or edge layer failed or served bad content. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: AWS.
-
identified
We're investigating an issue with connection errors to Vitess databases in us-east-1.
-
resolved
At **12:51 PM UTC** and **1:38 PM UTC** some Vitess databases in us-east-1 were impacted by connection errors for approximately 5 minutes due to an issue in our edge network. We resolved the issue and are no longer seeing errors. We will be taking action to protect customers...
-
monitoring
We're continuing to monitor. We've updated the status history to reflect the time periods where customers experienced connection issues.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Vitess branch creation unavailable
Failure mode: Orchestration, control plane, service discovery or load balancing failed. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
New Vitess databases are being accepted by the PlanetScale API but we are unable to provision the infrastructure to serve them. We've confirmed this impact and are investigating the cause. We will provide further updates by 11:00 UTC.
-
investigating
We're rolling out a mitigation now that will allow Vitess branch creation to succeed while we continue to investigate. No database operations or anything about Postgres database creation are impacted. Next update by 12:00 UTC.
-
resolved
Vitess branch creation is available once again.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Vitess database availability issues in GCP northamerica-northeast1
Failure mode: Hardware, power, cooling or another physical failure. Root cause: Hardware or facility. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: Google Cloud.
-
investigating
We are currently investigating impact.
-
identified
We're working on a fix for the impacted databases.
-
monitoring
Impacted databases are recovering, we're continuing to monitor.
-
resolved
Problem has been resolved. We saw three nodes fail across three availability zones simultaneously. Impacting databases hosted on those nodes. All databases have been moved to healthy nodes and we're investigating how we can further reduce impact from similar events in the future.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Query insights outage
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are investigating an issue with Query Insights
-
identified
There is an incident with a downstream provider. [https://status.clickhouse.com/incidents/01KG9R4QYASZW9VXHG3S2YD4WD](https://status.clickhouse.com/incidents/01KG9R4QYASZW9VXHG3S2YD4WD "https://status.clickhouse.com/incidents/01KG9R4QYASZW9VXHG3S2YD4WD")
-
monitoring
Insights service is restored and we are blasting through the backlog of data.
-
resolved
Query Insights is fully operational.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
API availability issues
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We are investigating internal errors on some API endpoints. Database connectivity is unaffected.
-
monitoring
A fix has been applied, and we are monitoring recovery.
-
resolved
The issue has been resolved.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Insights ingestion delayed
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: A bug in the vendor's own code. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
identified
Insights data ingestion is delayed. This underlying issue has identified and the Insights data backlog is being processed
-
resolved
Insights data ingestion encountered an error due to an unexpected data format. The issue was identified and fixed, and ingestion resumed.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Errors with branch creation for GCP databases
Failure mode: A code release introduced the failure. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
Names an upstream provider: Google Cloud.
-
investigating
We're aware of an issue impacting new branch creation, deploy requests and cluster size changes for Vitess databases deployed to GCP. We are working on a fix.
-
identified
We're continuing to work on a fix and will share an update once it has been deployed.
-
monitoring
We've deployed a fix and are seeing error rates resolve.
-
resolved
This incident is resolved.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
API and dashboard: 500 errors
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
The dashboard and API are currently returning 500 errors. We are rolling out a fix.
-
resolved
We've made a fix and the errors have resolved.
Excerpts are shortened. Read the full incident on PlanetScale's status page.
Delays in Datadog metric publishing
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
monitoring
During the ongoing incident, some branches are seeing delays in metrics via the Datadog integration.
-
resolved
Datadog metrics are back up-to-date.
Excerpts are shortened. Read the full incident on PlanetScale's status page.