Twingate
Infrastructure. Source: Twingate status page.
- Incidents, last 90 days
- 0
- Median to mitigation
- none resolved
- Median to resolution
- none resolved
- p95 to resolution
- none resolved
- Naming an upstream provider
- no incidents
- With a postmortem on the status page
- no incidents
Incidents per month
All recorded incidents
Linux Package Downloads Down
Affected: Downloads
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
Our upstream provider for Linux packages is having an issue impacting Twingate's Linux package downloads.
-
investigating
We are continuing to investigate this issue.
-
investigating
We are continuing to investigate this issue.
-
investigating
We are continuing to investigate this issue.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate Service Incident
Affected: Authentication - Enterprise, Authentication - Social, MFA, Authorization, Connector Heartbeat
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A configuration change. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are currently investigating this issue.
-
investigating
We are continuing to investigate this issue.
-
investigating
We are continuing to investigate this issue. We have narrowed the scope of the issue to Control Plane - Authorization.
-
investigating
We are continuing to investigate this issue. We are seeing recovery and have updated the Control Plane - Authorization status to partial outage.
-
monitoring
The issue has been fixed. We are still working with cloud provider on root cause.
-
monitoring
We're continuing to work with our cloud provider to identify the root cause.
-
monitoring
We're continuing to work with our cloud provider to identify the root cause.
-
resolved
We are currently awaiting the completion of our cloud provider’s investigation into the issue. In the meantime, we continue to closely monitor the system, and all service metrics have returned to normal operating levels. At this time, we are closing this incident. We will...
-
postmortem
# Incident Report – Authorization Service Degradation ## Components Impacted Control Plane – Authorization Service ## Summary On May 28, 2026, between 10:00 UTC and 12:30 UTC, Twingate experienced a degradation of its Authorization service that affected approximately 15% of...
Excerpts are shortened. Read the full incident on Twingate's status page.
Relays443 Down
Affected: Americas Relays, EMEA Relays, APAC Relays
Failure mode: A configuration change caused the failure. Root cause: A configuration change. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are seeing an issue with relay443. We are investigating. Note: These are special relays that offer connectivity over port 443 and are used by a subset of customers. So majority of customers shouldn't be seeing an issue,
-
identified
The issue has been identified and a fix is being implemented.
-
resolved
The fix has been rolled out and relays443 are now fully functional.
-
postmortem
**Components impacted** * Data Plane - Relay 443 flows only **Summary** On May 9, 2026, a subset of Twingate customers experienced an interruption to network access affecting Relay 443 connectivity. The disruption lasted approximately 2 hours and 10 minutes and was caused by a...
Excerpts are shortened. Read the full incident on Twingate's status page.
AWS Outage Impacting APT/RPM Package Repository (packages.twingate.com)
Affected: Downloads
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
Names an upstream provider: AWS.
-
monitoring
The AWS outage is affecting GemFury, a service we use to host our APT/RPM packages.
-
monitoring
Our testing indicates that APT/RPM packages are now operational, though Gemfury continues to report degraded performance. We will continue to monitor.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Admin and Reports Issues
Affected: Reports Downloads, Admin Console, Network Dashboards
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are currently investigating service issues related to our cloud provider. The disruption is affecting the Twingate service, including the Admin Console, Report Downloads, and Network Dashboards. We will continue to monitor the situation and provide updates as we learn more.
-
identified
Our cloud provider has acknowledged a service issue. We are continuing to monitor the situation and will provide updates as we learn more.
-
monitoring
Our cloud provider has indicated that their service is recovering. Impacted Twingate services are now back online, but we are currently processing a backlog of Events. We expect this to be fully resolved within the next few hours and will provide an update when processing is...
-
resolved
Our cloud provider has confirmed full recovery of their services, and our backlog of Events has now been fully processed. We consider this incident fully resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate Service Down
Affected: Authentication - Enterprise, Identity Providers Sync, Public API, Authentication - Social, Admin Console, MFA, Authorization, Realtime Updates, Connector Heartbeat, Client Log Upload, 3rd Party Integrations, Network Dashboards, DNS Filtering Dashboards
Failure mode: A configuration change caused the failure. Root cause: A configuration change. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
identified
The issue has been identified and a fix is being implemented.
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This incident is resolved now. We'll provide a post-mortem as soon as we have details.
-
postmortem
### **Incident Duration** **UTC Time**: May 28, 2025, from **20:45 to 21:14** \(29 minutes\) ### **Components Impacted** **Control Plane Services** * Authentication \(Enterprise & Social\) * Multi-Factor Authentication \(MFA\) * Authorization * Connector Heartbeat **Management...
Excerpts are shortened. Read the full incident on Twingate's status page.
Issues with Dashboards and Events Processing
Affected: Events Processing, Reports Downloads, Network Dashboards, DNS Filtering Dashboards
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
identified
We are seeing higher latency than usual with our cloud provider's APIs to process data used for our dashboards and reports. They confirmed the issue with their service. We hope this should be resolved soon.
-
monitoring
The Big Query service latencies have dropped and we see improvements with our internal dashboards.
-
resolved
All of internal alerts are cleared. You should not see delays/errors with dashboards and reports any longer.
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate Service Issues
Affected: Authentication - Enterprise, Identity Providers Sync, Public API, Authentication - Social, Admin Console, MFA, Authorization, Realtime Updates, Connector Heartbeat, Client Log Upload, 3rd Party Integrations, Network Dashboards, DNS Filtering Dashboards
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are currently investigating this issue.
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This incident has been resolved.
-
postmortem
**Twingate Public RCA: March 21, 2025 Authentication/Authorization Incident** **Summary** On March 21, 2025, between 21:10 and 21:41 UTC, a subset of authentication and authorization requests to Twingate services experienced elevated error rates. The issue was mitigated by 21:41...
Excerpts are shortened. Read the full incident on Twingate's status page.
Temporary Disruption in DNS Activity Reports
Affected: DNS Filtering Dashboards
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We're currently experiencing a temporary disruption with the DNS Activity Reports. The team is working on restoring access, and we'll have them back up shortly.
-
monitoring
Recent DNS Activity is now restored and we are monitoring the system.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Jamf Device Integration Issue
Affected: Identity Providers Sync
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We're seeing increased errors when syncing trusted devices from Jamf. We're currently investigating.
-
investigating
This incident is still being investigated. It started after a recent upgrade performed by Jamf. We have reached out to Jamf on the issue and working with them on resolution.
-
resolved
Issue with syncing trusted devices from Jamf has been fixed.
Excerpts are shortened. Read the full incident on Twingate's status page.
DNS Events Ingestion Issue
Affected: Events Processing
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We've detected an issue with DNS events ingestion affecting some of our customers who are not able to see DNS events when exporting to S3. We're currently looking for root cause.
-
identified
We've identified the issue and are working on a fix.
-
monitoring
DNS events are being ingested again and we're monitoring the system.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
GitHub Social Login is Down
Affected: Authentication - Social
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
monitoring
GitHub is currently experiencing an incident affecting its authentication - https://www.githubstatus.com/incidents/kz4khcgdsfdv Social login via Github is therefore temporarily not working until GitHub resolves their issues.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Secure DNS Dashboards Issue
Affected: DNS Filtering Dashboards
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are seeing issues with Secure DNS (Internet Security) Dashboards loading. We are investigating.
-
investigating
We are continuing to investigate this issue.
-
identified
Issue has been identified and we're working on a fix.
-
monitoring
Dashboards are gradually coming back online.
-
resolved
Dashboard are back to normal.
Excerpts are shortened. Read the full incident on Twingate's status page.
Issue with S3 Sync of Internet Security Events
Affected: Events Processing
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are having an issue with S3 Sync of Internet Security events. Team is engaged and issue is being investigated.
-
monitoring
There was an ingestion delay that's fixed . We see logs flowing again.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Issue with S3 Sync of Internet Security Events
Affected: Events Processing
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: AWS.
-
investigating
We are seeing issues with AWS S3 Sync of Internet Security events. We are currently investigating.
-
investigating
We are continuing to investigate this issue.
-
identified
We have identified the issue and working on a fix. Will update once fix is deployed.
-
resolved
The fix has been pushed to production and we confirmed Internet Security Events are now syncing to S3 buckets again.
Excerpts are shortened. Read the full incident on Twingate's status page.
MFA Incident
Failure mode: Login, tokens, certificates or credentials failed. Root cause: A human mistake during operations. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
resolved
During the incident , some of our customers MFA tokens became invalid. Less than 15 of our customers were impacted by this incident. We identified the issue and will make this key rotation safer going forward so it doesn't impact any of our customers. Impact Duration: 12:47 -...
Excerpts are shortened. Read the full incident on Twingate's status page.
Database Connection Issues
Affected: Public API, Admin Console, Connector Heartbeat
Failure mode: A configuration change caused the failure. Root cause: A configuration change. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
resolved
On June 26, 2024, between 8:16 pm UTC and 8:28 pm UTC, Twingate experienced several database connectivity alerts due to a failed rollout of one of its components. The rollout was promptly reversed, and our existing reliability measures prevented any major disruption to customer...
-
postmortem
**Components impacted** Management: Public API Management: Admin Console **Summary** On June 26, 2024 between 20:16 and 20:24 UTC, Twingate’s SQL proxies restarted, causing a brief failure to a small percentage of calls made to our Public API \(Terraform, Pulumi, k8s Operator,...
Excerpts are shortened. Read the full incident on Twingate's status page.
Recent DNS Activity Unavailable
Affected: Admin Console
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
Recent DNS Activity screen on the Admin console isn't available.
-
monitoring
Recent DNS Activity screen on the Admin console is back up.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Logins with Github Not Working
Affected: Authentication - Enterprise
Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
investigating
We are currently investigating this issue.
-
investigating
We are continuing to investigate this issue.
-
investigating
A software rollout has broken the logins with Github. We are working on rolling out a hotfix.
-
resolved
We have successfully rollout the HotFix for the issue with Github logins.
-
postmortem
**Components impacted** Control Plane: Authentication **Summary** On April 30, 2024, between 15:44 and 18:38 UTC, users were unable to login to Twingate through GitHub. The Twingate Engineering team investigated the issue upon receiving support communications and found that...
Excerpts are shortened. Read the full incident on Twingate's status page.
Recent DNS Activity Unavailable
Affected: Admin Console
Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
identified
Recent DNS Activity on admin is unavailable. We have identified the issue and working on a fix.
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This incident has been resolved.
-
postmortem
**Components impacted** Management: Admin Console **Summary** On April 20, 2024, between 5:32 GMT and 6:57 GMT, Recent DNS Activity on the Admin Console became unavailable. Shortly after the incident began, the Twingate on-call team received alerts regarding abnormal database...
Excerpts are shortened. Read the full incident on Twingate's status page.
Empty DNS filtering logs
Affected: Admin Console
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We’re currently investigating an issue where DNS filtering logs are sometimes empty.
-
identified
The issue has been identified and a fix is being implemented.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Database Connection Issues
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A bug in the vendor's own code. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
resolved
Summary On Dec 11, 2023 between the hours of 5:02 pm UTC and 6:24 pm UTC, Twingate received network connectivity alerts at 3 distinct times, each for a few minutes. After investigation, it was identified that a change in our application had caused our connections to exceed the...
-
postmortem
**Components impacted** Control Plane: Authn, Authz, Connector Heartbeat Management: Admin Console, Public API, Identity Providers Sync **Summary** On Dec 11, 2023 between the hours of 5:02 pm UTC and 6:24 pm UTC, Twingate received network connectivity alerts at 3 distinct...
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate Service Incident - Aug 19, 2023
Affected: Authentication - Enterprise, Public API, Admin Console, Authorization, Connector Heartbeat
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are seeing issues with Twingate service and investigating.
-
investigating
We are continuing to investigate this issue.
-
resolved
This incident has been resolved. We'll publish RCA as soon as we can.
-
postmortem
**Summary** On August 19 at 7:51 AM UTC, Twingate received alerts of issues with the login services. Within a few minutes, the Twingate engineering team began investigating. The team quickly identified that our backend was seeing excessive timeouts from a 3rd-party API,...
Excerpts are shortened. Read the full incident on Twingate's status page.
Admin Console Authentication Issues for tenants with JumpCloud IDP integration
Failure mode: Login, tokens, certificates or credentials failed. Root cause: A bug in the vendor's own code. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
resolved
Admin Console Authentication is broken for our tenants that utilize JumpCloud IDP integration. This was due to a bug in authentication flows with our latest software that was deployed at 15:24 UTC on June 21st. Resolution was accomplished by reverting to the previous software at...
Excerpts are shortened. Read the full incident on Twingate's status page.
admin console and authentication incident
Affected: Admin Console
Failure mode: A schema or data migration caused the failure. Root cause: A human mistake during operations. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are seeing issues with our admin consoles not loading properly. It's been investigated.
-
resolved
This incident has been resolved. It's due to an issue with a software update. We are working on a plan to avoid this in the future. This impacted authentication flow too. Already authenticated flows continued to function.
-
postmortem
**Summary** On June 7th 17:08 UTC, a new version of our Controller software was rolled out. Shortly after the rollout completed, our on-call team received automated exception alerts and began investigating. The new version had inadvertently included changes to clean up our...
Excerpts are shortened. Read the full incident on Twingate's status page.
Issue in us-east4 region
Affected: Authentication - Enterprise, Public API, Admin Console, Authorization, Connector Heartbeat
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
monitoring
Our cloud provider is having a networking issue in us-east4 region that caused 500 errors for our customers hitting that region. Due to retry logic in our service, this shouldn't have caused issues for our customers. We diverted traffic to other regions and no traffic is handled...
-
resolved
Our cloud provider has announced that the issue with us-east4 region has been resolved. We will be monitoring a little bit more before re-enabling traffic on that region.
Excerpts are shortened. Read the full incident on Twingate's status page.
Relay2 (us-east4) and Relay4 (eu-west6) Issue
Affected: Americas Relays, Peer-to-Peer
Failure mode: A configuration change caused the failure. Root cause: A configuration change. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We see issues with one of our relay clusters (US relay cluster 2) and investigating.
-
identified
We found issues with 2 of our relay clusters, one in US (region: Virgina and one in Europe (region: Zurich). While we are working on bringing them up, the connectors and clients should have automatically reconnected to the other relay clusters, which may cause some slowness for...
-
resolved
We have identified the issue and a fix is implemented. Both relays clusters are healthy and processing requests.
-
postmortem
**Components impacted** Relay clusters in us-east4 \(Ashburn, Virginia\) and europe-west6 \(Zurich, Switzerland\) **Summary** We’ve recently been working on adding spot instance scaling to our Relay cluster infrastructure. On Feb 14th at 01:00 UTC, we initiated this upgrade...
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate Service Incident
Affected: Authentication - Enterprise, Public API, Admin Console, Downloads, Authorization, Connector Heartbeat
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: Not enough capacity for the load. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are currently investigating this issue.
-
investigating
Twingate Engineering is fully engaged and we are still investigating the issue. We'll provide further updates as soon as we can.
-
investigating
Twingate engineering is still working on identifying the root cause of the issue. We'll continue to provide updates as we find out more. - Public-api is disabled. - Admins and Logins should work. - Still seeing issue with Authorization.
-
investigating
We are continuing to investigate this issue.
-
monitoring
We have identified the issue and Twingate system looks healthy since 1:48 pm PST. We are still monitoring the issue. Public-API is still being kept down for the time being.
-
monitoring
Public-API (Admin-API) has been brought up too. While all the metrics for the service looks healthy, we will continue to monitor them.
-
resolved
We are marking the issue as resolved. The system works as expected with healthy metrics.
-
postmortem
**Summary** On January 24 at 19:58 UTC, our on-call team started to receive automated alerts regarding system performance degradation. The team began an investigation and, by 20:02 UTC, the degradation had escalated to a point where some Twingate Clients began to experience...
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate Admin Impacted
Affected: Admin Console
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
Currently Twingate admin is broken. We have identified the issue and rolling out the fix.
-
resolved
Twingate admin is fully functional again.
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate controller service impacted
Affected: Authentication - Enterprise, Authorization, Connector Heartbeat
Failure mode: A code release introduced the failure. Root cause: A bug in the vendor's own code. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are currently investigating this issue.
-
investigating
We are continuing to investigate this issue.
-
investigating
We are working with our cloud provider to identify the issue
-
identified
The issue has been identified and a fix is being implemented. the system is slowly recovering. We will keep update.
-
identified
We are still working on the fix. It takes a bit longer then we expected.
-
investigating
Although we identified a problem earlier it appears that it was not the root cause of the issue. We are serving some customer requests but there remains an ongoing impact to service availability that we are investigating.
-
monitoring
We have restored service for all customers but are verifying each of our internal services in-turn and checking for any residual issues
-
resolved
This incident has been resolved.
-
postmortem
**Summary** On September 21 at 4:14am UTC, Twingate released a new controller version as part of improvements to the authorization engine. This new release contained both code changes and involved data migration. The change caused an unexpectedly significant increase in load on...
Excerpts are shortened. Read the full incident on Twingate's status page.
Delay in display for network events
Affected: Admin Console
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
monitoring
Our infrastructure is running behind which is causing delays in our display of network events in the admin console. No data has been lost and the system should be caught up shortly.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate Docs down
Affected: Docs
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
Twingate docs site (docs.twingate.com) is down due to issues with our vendor.
-
monitoring
Twingate docs site is up now but we are still monitoring the issue as our docs hosting provider hasn't released an update yet on the resolution of the issue.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
download or update of client/connector packages
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are investigating an issue with our third-party repository provider for Linux packages. While it is not impacting Twingate clients or connectors it does appear to be preventing download or update of client/connector packages.
-
identified
The issue is due to a third party incorrect infrastructure upgrade
-
monitoring
Our repository third party is recovering.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
www.twingate.com down - no service impact
Affected: www.twingate.com
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
Due to an issue with our service provider, our homepage (www.twingate.com) is down. There should be no impact to service for our customers.
-
monitoring
Our service provider still reports an issue with their network however our web site came back up and has been operational. We'll continue to monitor.
-
monitoring
We are continuing to monitor for any further issues.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate ingress partially unavailable
Failure mode: A configuration change caused the failure. Root cause: A configuration change. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
resolved
Due to unexpected delays associated with a planned ingress update, Twingate’s controller was partially unavailable for ~2.5 minutes between 10:15 pm and 10:18 pm PST. During this short window, no existing network connections were interrupted. New connections were blocked during...
Excerpts are shortened. Read the full incident on Twingate's status page.
Cloud provider multiple services degraded
Affected: Americas Relays
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
monitoring
Our cloud provider (Google) is experiencing an incident affecting multiple services in their eu-west2 (London) region. Our service spans multiple regions but users may experience intermittent slowness.
-
monitoring
Our cloud provider (Google) is continuing to experience the outage in Europe-west2 (London) region. This is not directly impacting Twingate service as our clients and connectors have built-in redundancy by connecting to multiple regions but users in that region may experience...
-
resolved
Our cloud provider (Google) incident is now resolved, and our services in eu-west2 (London) are fully operational.
Excerpts are shortened. Read the full incident on Twingate's status page.
Documentation site is unavailable in some regions
Affected: Docs
Failure mode: CDN or edge layer failed or served bad content. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
identified
The issue has been identified by our vendor as a CDN issue, we will continue to monitor and provide updates.
-
identified
We are continuing to work on a fix for this issue.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate Controller outage
Affected: Authentication - Enterprise, Public API, Admin Console, Authorization, Connector Heartbeat
Failure mode: Orchestration, control plane, service discovery or load balancing failed. Root cause: A human mistake during operations. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
Controller is currently experiencing an outage. Our team is investigating the issue.
-
investigating
During a planned Kubernetes version upgrade, our application started to fail. We failed to our standby region/cluster, but it has the same issue. We are downgrading Kubernetes version and continuing to working on the issue.
-
monitoring
After reverting back the Kubernetes version and failing back to our previously Active cluster, we see Twingate Service recovered. We continue to monitor.
-
resolved
We are marking the incident as resolved. We will provide post-mortem notes as soon as we have them.
-
postmortem
**Summary** On June 3rd at 3 AM UTC, Twingate started a regular Kubernetes upgrade on its main cluster. This maintenance is usually done once a month and has been performed successfully many times prior to this upgrade. It includes a version upgrade of the cluster followed by a...
Excerpts are shortened. Read the full incident on Twingate's status page.
Issue with Twingate
Affected: Authentication - Enterprise, Public API, Admin Console, MFA, Authorization, Connector Heartbeat
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are currently investigating the incident.
-
investigating
We have seen improvements; we are monitoring the situation. We'll update as we find out more details on the issue.
-
investigating
We are continuing to investigate this issue.
-
investigating
The system is fully up. We will continue to monitor.
-
resolved
We are marking this issue resolved. The impact was between 8:31 am to 8:44 am. We will add the post mortem to the incident as soon as we have it ready.
-
postmortem
**Summary** At approximately 15:31 UTC on May 13, 2022, we received alerts from our monitoring systems pointing to a problem with Twingate. Our cloud provider’s load balancer started to return 502 \(Bad Gateway Error\) due to issues with our backend system. Looking into our...
Excerpts are shortened. Read the full incident on Twingate's status page.
Issue connecting to Twingate
Affected: Americas Relays, Admin Console, Connector Heartbeat
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: Not enough capacity for the load. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are aware of an incident affecting our production system and are currently actively investigating the issue. We will be posting regular updates pertaining to this incident.
-
investigating
Our engineers have isolated the problem to a network connectivity issue between our application servers and our database infrastructure. Our team is working to restore network connectivity and we will continue to post regular updates.
-
monitoring
We have re-established connectivity and Twingate services have been restored. We are continuing to monitor our systems.
-
resolved
We are continuing to monitor the system, and it remains stable and available. We are closing out this incident and we will follow up with a post mortem here.
-
postmortem
**Summary** At approximately 02:26 UTC on January 19th, we observed an increase in latency between our API layer and our backend database system. Within a few minutes, this spike in latency developed into an outage that resulted in 90% of requests returning one of two responses...
Excerpts are shortened. Read the full incident on Twingate's status page.
Twingate MFA challenge page is slow to load
Affected: Connector Heartbeat
Failure mode: CDN or edge layer failed or served bad content. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are currently investigating degraded performance of loading the MFA page of Twingate. Customers are experiencing slower page load times due to a CDN issue but services are still functional and available. We will be posting regular updates pertaining to this incident.
-
identified
We have identified the issue and are currently switching to our backup CDN.
-
monitoring
We have switched to our backup CDN and will continue to monitor the system.
-
resolved
We are closing this incident as the MFA challenge page has been operating normally since our last update.
Excerpts are shortened. Read the full incident on Twingate's status page.
Admin console billing functionality is temporarily unavailable
Affected: Admin Console
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
The admin console is currently experiencing an outage caused by our 3rd party billing system being unavailable. Our team is investigating the issue and working on a fix currently. This issue is isolated to loading the admin console and does not affect any resource access or end...
-
identified
The root cause of the issue has been identified and a fix is in progress. We will post another update shortly.
-
monitoring
A fix has been deployed and the admin console is now available to all customers. We'll continue to monitor the system for the next 30 minutes before marking this incident as resolved.
-
monitoring
We have received confirmation from our 3rd party billing provider that they are aware of their system outage and are working on a fix. We will resolve this incident when the 3rd party system is available. Until this incident is marked as resolved, no billing functionality will...
-
resolved
Our 3rd party billing system is now available and we are marking this incident as resolved. We will follow up with a post mortem update.
-
postmortem
**Components impacted** * Admin console **Summary** At 18:59 UTC we received an automated alert that requests to our 3rd party billing system \(Chargebee\) were failing. A few minutes later we confirmed that this was causing the Twingate admin console interface to fail to load...
Excerpts are shortened. Read the full incident on Twingate's status page.
Okta connectivity issue
Affected: Connector Heartbeat
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: Network or DNS. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
monitoring
We are aware of and investigating reports that customers using Okta for authentication are unable to login. It appears that customers' Okta domains are not reachable. At this stage, we are not aware of any issue affecting Twingate services itself and are working to restore...
-
monitoring
We are observing that Okta appears available again. Customers that use Okta as their Identity Provider should try again to login if they have experienced trouble logging in.
-
resolved
Customers using Okta should now be able to login without issue. We understand that the problem was related to an internet connectivity issue unrelated to Twingate that is now resolved.
Excerpts are shortened. Read the full incident on Twingate's status page.
Inbound requests have heavily downgraded availability
Affected: Connector Heartbeat
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are currently investigating this issue.
-
investigating
We are continuing to investigate this issue.
-
investigating
We are continuing to investigate this issue. We will be posting regular updates pertaining to this incident.
-
investigating
We are continuing to investigate this issue. We will be posting regular updates pertaining to this incident.
-
investigating
We are continuing to investigate this issue. We have narrowed the source of the problem to the public-facing frontend servers that handle requests inbound to our service. As a result, this is broadly affecting our public API, the private API calls used by Clients and Connectors,...
-
investigating
Inbound requests are now being accepted and the service is operational again. We have verified that all operational tests are succeeding. We are continuing to investigate to determine the root cause of this incident.
-
monitoring
We are continuing to monitor the system, and we are still investigating the root cause of the outage. We will continue to post additional updates regularly.
-
monitoring
We are continuing to monitor the system, and it remains stable and available. We are investigating the root cause of the outage. We will continue to post additional updates regularly.
-
monitoring
We are continuing to monitor the system, and it remains stable and available. We are investigating the root cause of the outage. We will post our next update at 17:00 PST / 01:00 UTC.
-
monitoring
We are continuing to monitor the system, and it remains stable and available. We are investigating the root cause of the outage. We will post our next update at 21:00 PST / 05:00 UTC.
-
monitoring
We are continuing to monitor the system, and it remains stable and available. We are investigating the root cause of the outage. We will post our next update at 09:00 PST / 17:00 UTC.
-
resolved
We are continuing to monitor the system, and it remains stable and available. We are closing out this incident, and we will continue to post updates and follow up with a post mortem here.
-
postmortem
**Components impacted** * Controller **Summary** At approximately 17:06 UTC on December 13th, we observed an increase in latency between our API layer and our backend database system. Within a few minutes, this spike in latency developed into an outage that resulted in 90-95% of...
Excerpts are shortened. Read the full incident on Twingate's status page.
Service provider networking outage
Affected: Americas Relays, Connector Heartbeat
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
Names an upstream provider: Google Cloud.
-
investigating
We are investigating an outage report with regards to Twingate. At this time we suspect it is an issue affecting broader Internet services and is not isolated to Twingate. We will continue to post regular updates as we learn more.
-
investigating
We are continuing to investigate this issue.
-
investigating
The Twingate admin console is now accessible and the Twingate Controller is operational. Customers may need to restart Connectors to restore connectivity to resources due to the nature of the networking outage. The originating cause appears to be related to an outage in Google...
-
monitoring
We are continuing to monitor the status of the service. Customers may need to restart Connectors to restore connectivity to resources due to the nature of the networking outage.
-
monitoring
We are continuing to monitor for any further issues.
-
monitoring
We have verified that all of our infrastructure is fully operational at this time and will continue to monitor for any changes. Until our service provider (Google Cloud Platform) has closed their incident, we will leave this incident open in Monitoring status and provide regular...
-
monitoring
Google Cloud Platform has marked their Cloud Networking issue as resolved and has posted a status update: https://status.cloud.google.com/incidents/6PM5mNd43NbMqjCZ5REh We are continuing to monitor our infrastructure and will mark this incident as resolved when we are confident...
-
resolved
We are marking this issue as resolved as our monitoring shows that our infrastructure is operating normally and Google Cloud Platform has resolved the incident on their network. We will be following up with a post-mortem shortly.
-
postmortem
**Components impacted** Controller Relays **Summary** Twingate services were unavailable to service requests from approximately 17:48 to 20:09 UTC on November 16th. The result was that during this period of time, access to Twingate and protected resources was limited, existing...
Excerpts are shortened. Read the full incident on Twingate's status page.
Controller downtime
Affected: Connector Heartbeat
Failure mode: Hardware, power, cooling or another physical failure. Root cause: Hardware or facility. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are looking into it we will provide more info as soon as we have it
-
investigating
We are continuing to investigate this issue.
-
investigating
We are back and operational now. We are still investigating the root cause.
-
investigating
We are continuing to investigate this issue.
-
monitoring
We are still investigating the root cause of the incident. We didn't find any issue on our side, and we are working with our cloud provider support team to investigate the matter further.
-
resolved
This incident has been resolved.
-
postmortem
**Components impacted** Relay Controller **Summary** A physical hardware failure occurred in a node within one of our Eastern US Relay clusters at approximately 18:19 UTC. Connectors and Clients attached to this node automatically failed over to a new node. This failover process...
Excerpts are shortened. Read the full incident on Twingate's status page.
Connector restart may be required
Failure mode: A schema or data migration caused the failure. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
monitoring
Connectors older than v1.26.0 require a restart due to a database update. You can find Connector version information in the Connector detail page in the Twingate Admin console. We are currently in the process of contacting Twingate admins.
-
resolved
All admins with affected Connectors were notified.
Excerpts are shortened. Read the full incident on Twingate's status page.
Controller downtime
Affected: Connector Heartbeat
Failure mode: A configuration change caused the failure. Root cause: A human mistake during operations. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
monitoring
The Controller infrastucture was experiencing degraded availability. The issue began at 19:39 UTC and continued until 19:47 UTC. Our team is currently investigating the root cause of the issue, and we will post additional updates here.
-
monitoring
The Controller is currently fully available, and we are actively investigating the root cause of the issue.
-
resolved
This incident has been resolved. We will be posting a post mortem description shortly.
-
postmortem
**Components impacted** Controller **Summary** The Controller was partially unavailable to service requests from approximately 19:39 to 19:46 UTC. The result was that during this period of time access to protected resources was limited, some existing connections were dropped,...
Excerpts are shortened. Read the full incident on Twingate's status page.
Controller downtime
Affected: Connector Heartbeat
Failure mode: A configuration change caused the failure. Root cause: A configuration change. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
identified
We've identified the issue, which is being caused by excessive memory usage on our infrastructure.
-
monitoring
We're resolved the immediate issue by adding additional processing capacity and increasing memory limits on our controller infrastructructure.
-
monitoring
The system is now confirmed as fully operational. We are working on an incident report and taking steps to ensure that this issue will not happen in the future.
-
resolved
This incident has been resolved.
-
postmortem
**Components impacted** Controller **Summary** The controller was unavailable to service new authentication requests from approximately 15:17 to 15:19 UTC. The result was that during this period of time, new connection requests were rejected. Existing connections were not...
Excerpts are shortened. Read the full incident on Twingate's status page.
Mumbai (asia-south1-a) cluster is unavailable
Affected: Americas Relays
Failure mode: A configuration change caused the failure. Root cause: A human mistake during operations. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
Names an upstream provider: Google Cloud.
-
identified
We have identified an issue with our Relay cluster in Mumbai (GCP region asia-south1-a) and are working to fix it.
-
monitoring
Engineering has a fix in place. We are currently monitoring the cluster and expect it to be back up by 21:00 PST.
-
resolved
Relay cluster in Mumbai (GCP region asia-south1-a) is now fully operational.
-
postmortem
**Components impacted** Relay **Summary** We encountered an issue during an upgrade to our relay cluster monitoring infrastructure. As a result, we were unable to bring the Mumbai regional cluster up during this maintenance window, and so it was left down. There was no customer...
Excerpts are shortened. Read the full incident on Twingate's status page.