Travis CI
Apps and SaaS. Source: Travis CI status page.
- Incidents, last 90 days
- 0
- Median to mitigation
- none resolved
- Median to resolution
- none resolved
- p95 to resolution
- none resolved
- Naming an upstream provider
- no incidents
- With a postmortem on the status page
- no incidents
Incidents per month
All recorded incidents
Build job(s) failures
Affected: Log Processing, Notifications, Linux and Windows Builds, IBM Z Builds
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We are currently investigating reports of build jobs failing.
-
identified
The issue has been identified and a fix is being implemented.
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
The fix has been successful, and all systems are now operating normally. We will continue to monitor performance closely. Thank you for your patience and understanding as we addressed this issue. If you continue to experience any residual issues or have further questions, please...
Excerpts are shortened. Read the full incident on Travis CI's status page.
Trials not working
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
Trials are currently unavailable. The issue has been identified, and we are preparing a fix. In the meantime, please reach out to support@travis-ci.com if you have any questions.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
arm64 jobs not running
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We are investigating an issue that is preventing arm64 jobs from running correctly.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
DPLv2 dependency update causes DPLv2 deployments to fail
Failure mode: A code release introduced the failure. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
identified
We have released DPLv2 as stable gem on Aug-28th into Travis gem collection. There's an issue for DPLv2 users and there's available workaround. The 'uri' gem updated 2 days ago caused DPLv2 2.0.5 not work correctly in Travis CI build environments due to dependency chain. This...
-
identified
We have reverted DPLv2 gem from being latest stable in gem repository, 1.10.16 is now latest stable. This doesn't affect TCI Hosted users. This should prevent TCI Enterprise server environments not updated to TCIE v3.1 suffer from necessity to update individual .travis.yml...
-
identified
Updating build environment images still in progress - additional dependencies were identified and are worked on. Until build environment updates are finished, DPLv1 works normally, DPLv2 users are recommended to continue using uri gem update workaround. TCI Enterprise server...
-
identified
TCI Enterprise server version 3.0.58 patch published and recommended to be used no later than by Sep-14th, 2024.
-
monitoring
Updates in DPLv2 and Travis CI build environments applied. We are monitoring. DPLv2 may be promoted to be default DPL function after Sep 14th.
-
resolved
Build images updates and DPLv2 updates will drop continuously. DPLv2 will be promoted as default DPL gem version at Sep-30th.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Builds not being processed
Affected: Linux and Windows Builds, IBM Z Builds
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We are currently investigating an issue that is preventing some builds from working properly.
-
resolved
This issue has been resolved and now builds are running as expected.
Excerpts are shortened. Read the full incident on Travis CI's status page.
s390x and ppc64le jobs not running
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We have identified an issue that is preventing s390x and ppc64le jobs from running correctly. We’re actively working to address this problem.
-
identified
Bionic and Focal builds should work now, fix deployed.
-
resolved
This incident has been resolved for Bionic and Focal builds. We're working on Jammy builds that should be fixed soon, updates will be posted to our changelog page.
Excerpts are shortened. Read the full incident on Travis CI's status page.
macOS builds failing
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We have observed some issues with our Mac build process. Our team is investigating these issues and we will be providing further updates as more information becomes available
-
identified
The issue has been identified and a fix is being implemented
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Build jobs from branches/tags on GitHub ran on main/master branch in Travis CI
Affected: GitHub Issues, PRs, Dashboard, Projects
Failure mode: A configuration change caused the failure. Root cause: A bug in the vendor's own code. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
identified
Issues with branch/tag based builds reported since Nov-9 have been confirmed to be on Travis CI side. We have identified the reason and confirmed it's due to GitHub push event handling on Travis CI side. Working on the fix. Build infrastructure is fully operational
-
monitoring
A fix for handling GitHub push events was implemented and we are monitoring the system now.
-
resolved
Incident resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
GitHub sync blocked or lasting long - degraded performance
Affected: User Sync
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
identified
We received information on issues with data synchronization with GitHub since Nov/1st. We have identified reason and are working on restoring system to normal operation.
-
monitoring
A fix is in place and we're monitoring.
-
resolved
Data synchronization issues with GitHub have been fully resolved and all systems are operational
Excerpts are shortened. Read the full incident on Travis CI's status page.
Travis API errors.
Affected: API, Linux and Windows Builds
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
Travis API errors discovered. Builds may be breaking.
-
monitoring
Issue found and fixed. Monitoring system.
-
resolved
Operation back to normal.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Build job errors when acquiring repository from GitHub (GitHub SSH key update)
Affected: GitHub, Linux and Windows Builds
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
identified
Users utilizing Custom SSH Key in Travis CI private repository settings may experience build errors or warnings on git checkout. This is due main SSH keys being updated by GitHub (see https://github.blog/2023-03-23-we-updated-our-rsa-ssh-host-key/ ). We are working on updating...
-
monitoring
We have deployed hotfix replacing main Github host RSA SSH keys and are monitoring the builds. Users with Custom SSH Key in Travis CI repository settings should be able to build correctly now.
-
resolved
The issue seems resolved. If you encounter further roadbloacks in repositories using Custom SSH Key in Travis CI, specifically on git repository cloning stage, please validate if a matching key pair is still available at GitHub. If not, removing old Custom SSH Key in Travis CI...
Excerpts are shortened. Read the full incident on Travis CI's status page.
Synchronization with GitHub fails
Affected: User Sync
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
investigating
We are currently investigating the issue. The symptoms are that either adding new repository or installing Travis CI GitHub App from scratch results in repositories not being activated and builds cannot be triggered.
-
identified
The issue has been identified, fix is being implemented. Adding/activating new repos will not work for now.
-
monitoring
We're draining the pending messages to GitHub API queue. It may take some time before all affected accounts are enabled again.
-
monitoring
User synchronization operational. The queue drain was finished at GMT 13:00. We will be monitoring the situation over next hours, looking for any remaining issues caused by the incident. You may need to reinstall Travis CI GitHub App if you added a new repository or created a...
-
resolved
This incident has been resolved. You may need to reinstall Travis CI GitHub App if you added a new repository or created a new account between 19 December 2022 12:06:34 and 20 December 2022 GMT 13:00:00.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Some build requests are not being triggered.
Failure mode: Orchestration, control plane, service discovery or load balancing failed. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
resolved
Some of the build requests they both triggered with API and Git push operations are not being processed. We are still investigating the root cause behind this issue.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Some builds are not being triggerred
Affected: Linux and Windows Builds
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
We have identified the issue where some of the builds are not being triggered and got an undetailed error when they are triggered.
-
monitoring
We have implemented the fix and monitoring the issue.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Some users are facing issues when triggering a build on Travis CI Platform.
Failure mode: A configuration change caused the failure. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
The issue has been identified and a fix is being implemented.
-
identified
Summary: Users on Old Travis CI pricing model: We have identified that the Users/Orgs on old Travis CI pricing model are unable to trigger builds. Description: Users are not able to trigger builds on Travis CI Platform with a message "We are unable to start your build at this...
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
travis-ci.com throws "504 Gateway Timeout" error
Failure mode: CDN or edge layer failed or served bad content. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
The main page at https://travis-ci.com is down. Your builds are still executed. We're reviewing the main site case, it may remain inactive for a full day or so. The API and https://app.travis-ci.com can be still accessed directly and you can run, view, and manage your builds as...
-
resolved
The main site https://travis-ci.com/ is back on field.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Builds are not triggering for app.travis-ci.com
Affected: API, Linux and Windows Builds
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
identified
Sorry, some users are unable to trigger builds on GitHub commits. We are working on it and hope to restore the functionality shortly. Sorry for the inconvenience!
-
monitoring
Our Infra team has implemented a fix that should resolve this issue. Thank you for your patience and cooperation!
-
resolved
This incident has been resolved. If you face any issues with builds on Travis Platform, you can reach our support staff at support@travis-ci.com
Excerpts are shortened. Read the full incident on Travis CI's status page.
Builds are not triggering for travis-ci.com
Affected: Linux and Windows Builds, GitHub API Requests, GitHub Issues, PRs, Dashboard, Projects
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
identified
Sorry, some users are unable to trigger builds on GitHub commits. We are working on it and hope to restore the functionality shortly. Sorry for the inconvenience!
-
monitoring
Our Infra team has implemented a fix that should resolve this issue. Thank you for your patience and cooperation!
-
resolved
This incident has been resolved. If you face any issues with builds on Travis Platform, you can reach our support staff at support@travis-ci.com
Excerpts are shortened. Read the full incident on Travis CI's status page.
Some builds are being rejected
Affected: Linux and Windows Builds
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
Some build requests are being rejected and this causes builds to be triggered. We are currently investigating the issue.
-
investigating
We are continuing to investigate this issue.
-
identified
The issue has been identified and a fix is being implemented.
-
monitoring
The fix has been implemented and build requests are being processed as usual. We are still monitoring the system
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Queued jobs are taking time to process
Affected: Linux and Windows Builds
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
Some builds may have trouble on the queued stage. We are currently investigating the issue.
-
identified
We have identified the problem and a fix is in process.
-
identified
We are continuing to work on a fix for this issue.
-
identified
We are actively fixing this issue and will report back as soon this resolves. We are very sorry for the inconvenience in the meantime.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Some builds are taking a long time to queue
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
Some builds may have trouble on the queued stage, we are currently investigating the issue.
-
identified
We have identified the problem and queued jobs are already started processing.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
PPC64 Jobs Are Failing
Affected: Linux and Windows Builds
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
We observed some ppc64 jobs are taking longer to start. In addition, we've noticed an increased error rate. We are working to resolve these and will provide updates shortly.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Builds Queued for longer than normal
Affected: Linux and Windows Builds
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
Builds are currently queued for longer than normal. We are investigating this issue and will provide an update shortly.
-
monitoring
Our queue is currently draining fast and processing of builds should be back to normal
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Some builds may be affected due to Google Incident
Affected: Linux and Windows Builds, Google Cloud Platform Google Compute Engine
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
identified
Due to the ongoing incident with Google's Compute Engine [1], some jobs may fail to run. We are monitoring the Google Status and will provide updates. Thank you [1] https://status.cloud.google.com/incident/cloud-networking/21006#21006002
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Builds are not triggering for travis-ci.com
Affected: Linux and Windows Builds
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A bug in the vendor's own code. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are investigating the root cause behind why builds are not triggered for travis-ci.com
-
identified
The issue has been identified and a fix is being implemented.
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This incident has been resolved.
-
postmortem
We are extremely sorry about the outage on this incident and we would like to share some action that has been taken; * Issue reported date: The issue has been reported on 24.09.2020 09:12 UTC. * Issue: **Unstable VCS service, high memory usage** * Reason: Issue in Bitbucket...
Excerpts are shortened. Read the full incident on Travis CI's status page.
.org Not processing builds
Affected: Linux and Windows Builds
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We are investigating reports of builds not being processed on .org.
-
monitoring
The issue has been resolved and we are monitoring the system.
-
resolved
Builds are being processed normally.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Partial Outage on Notifications
Affected: Notifications
Failure mode: Orchestration, control plane, service discovery or load balancing failed. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
We have identified issues with infrastructure handling notifications, which leads to these not been fired. A fix is being worked on.
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Backlog of Jobs on .ORG
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
We are currently investigating a large number of queued jobs on our .ORG infrastructure for MacOS builds
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Queued Jobs on .COM
Affected: Linux and Windows Builds
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We are currently investigating an uptick in queued jobs on our .COM platform
-
identified
The issue has been identified and a fix is being implemented.
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
.com API intermittent failure
Affected: API
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We are investigating reports of intermittent failures on API.
-
identified
We have identified the cause and are working on a fix.
-
identified
We have deployed the fixes and monitoring their effectiveness.
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This issue has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Degraded GitHub integration
Affected: GitHub, User Sync, Notifications, Linux and Windows Builds, GitHub API Requests, GitHub Issues, PRs, Dashboard, Projects
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
identified
Our services are degraded due to GitHub's ongoing issues.
-
resolved
The service are operating normally.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Intermittent build start or failure issue
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
identified
You may experience issues with macOS builds due to an issue with our infrastructure service provider. We are closely looking into this issue and more to come!
-
identified
Investigation underway we are in close contact with the service provider.
-
resolved
The issue related to macOS builds has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Linux and Windows VMs not booting
Affected: Linux and Windows Builds, Google Cloud Platform Google Compute Engine
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
identified
Our service provider is experiencing issues, and at the moment we are unable to boot VMs to run the builds on Linux and Windows.
-
resolved
The service provider issue has been resolved. The builds should be processed normally.
Excerpts are shortened. Read the full incident on Travis CI's status page.
API is down on .ORG
Affected: API
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are investigating an outage on the .ORG API. We will provide updates based on our findings. Thank you
-
monitoring
We implemented a fix for the issue and are monitoring the results. Thank you
-
monitoring
We are continuing to monitor our infrastructure and one of our upstream providers, Google [1]. We will provide additional updates once these systems are fully functional. Thank you [1] https://status.cloud.google.com/incident/cloud-networking/20004
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
GitHub status may not be posted on commits occasionally from builds using the legacy Services integration
Affected: Notifications
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
investigating
We are investigating the reports of GitHub commit status not being posted. The issue only affects those repositories using the legacy Services integration (i.e., all .org repositories and some .com ones), and only under some circumstances. You can migrate your repositories to...
-
identified
We have identified the source of these errors and are working on a fix.
-
monitoring
We've deployed additional measures to mitigate this issue and are monitoring the effects. We will roll out additional fixes as required. Thanks for your patience
-
resolved
The issue has been resolved. Please write to support@travis-ci.com if you encounter any similar problems. Thank you
Excerpts are shortened. Read the full incident on Travis CI's status page.
Build Queues and Build Statuses
Affected: API, GitHub, Linux and Windows Builds
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
identified
The issue related to queued builds and build statuses is still partially down. We have investigated the issue and currently working on the components to up again.
-
resolved
Thank you for your patience and understanding. This incident has been resolved by taking another look and tests about builds statuses and build trigger mechanism. The solution was deployed at 14:00 PM UTC.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Builds not starting/queuing or stucks on .COM
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: A human mistake during operations. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
monitoring
We have observed the root cause of the problem with the builds isn't starting due to misusage. Currently, we are recovering the infrastructure.
-
resolved
Thank you for your patience. The incident has been resolved and builds should behave as normal.
Excerpts are shortened. Read the full incident on Travis CI's status page.
MacOS Builds Failing on .COM and .ORG
Failure mode: Orchestration, control plane, service discovery or load balancing failed. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
resolved
We observed an issue with a small portion of macOS builds, jobs routed to a particular infrastructure unit took longer than expected to start or failed. The issue was resolved at 18h31 UTC
Excerpts are shortened. Read the full incident on Travis CI's status page.
Internal Mac build errors
Failure mode: Hardware, power, cooling or another physical failure. Root cause: Hardware or facility. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
identified
We have identified an issue with a portion of Mac infrastructure which prevents builds from running correctly. We are working on mitigating the impact of this problem. Affected jobs would indicate "An error occurred while generating the build script." in the logs.
-
monitoring
We have removed the affected hardware out of the executor pool. Requests should work as expected at this time.
-
resolved
The Mac build capacity has been brought back to normal.
Excerpts are shortened. Read the full incident on Travis CI's status page.
MacOS Builds Failing on .COM and .ORG
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We have observed issues with Mac OSX builds that are failing on both .com and .org due to a major outage at our upstream provider. We are looking into this and will provide additional updates.
-
resolved
Thank you for your patience. Our upstream provider has reported that a fix has been implemented [1]. We have also seen improvements on our end and so we are marking this issue resolved. Thank you [1] https://status.macstadium.com/incidents/l464rrkdg4yn
-
postmortem
Please see the MacStadium Post-Mortem \[1\] for details about this incident. Thank you! \[1\] [https://status.macstadium.com/incidents/l464rrkdg4yn](https://status.macstadium.com/incidents/l464rrkdg4yn)
Excerpts are shortened. Read the full incident on Travis CI's status page.
Linux builds not being processed for .com
Affected: Linux and Windows Builds
Failure mode: Orchestration, control plane, service discovery or load balancing failed. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
identified
We have confirmed that a portion of jobs requested today were not processed correctly. These jobs are stuck in the "queued" state. We confirmed that restarting affected jobs solves the issue.
-
monitoring
We are restarting the jobs stuck in "queued" state at this time. Affected users may restart them themselves. If you continue to see problems, please contact us at support@travis-ci.com.
-
monitoring
We are planning on restarting stuck jobs between 20:40 and 21:40 UTC and monitor the queue following the restart.
-
resolved
Jobs have been processed. If you see problems, please contact us at support@travis-ci.com.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Linux builds not being processed for .com
Affected: Linux and Windows Builds
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are investigating reports of Linux jobs not being processed for .com (both private and public).
-
identified
We have confirmed that a portion of jobs requested starting around 07:00 UTC today were not processed correctly. These jobs are stuck in the "queued" state. We confirmed that restarting affected jobs solves the issue.
-
monitoring
We are restarting the jobs stuck in "queued" state at this time. Affected users may restart them themselves. If you continue to see problems, please contact us at support@travis-ci.com.
-
resolved
Jobs have been processed. If you see problems, please contact us at support@travis-ci.com.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Issue with IBM Z builds on Travis CI
Failure mode: The text does not say enough to tell. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with low confidence (taxonomy v0.2).
-
investigating
We are investigating an issue with IBM Z builds.
-
monitoring
We are seeing builds on IBM Z starting normally. A fix for both .com and .org has been implemented and we are monitoring the results.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Network Connectivity Errors
Affected: Linux and Windows Builds
Failure mode: Network, DNS, routing or connectivity failure. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We have received several reports of builds failing due to an unsuccessful TLS handshake to *whereami.travis-ci.com:443* on one of our production servers. We are opening this incident to acknowledge the issue and also keep you posted on our work to solve it. Thank you for your...
-
investigating
We are continuing to investigate this issue.
-
identified
We have identified the production systems affected by this issue and have removed these from the pool. No new builds will be affected by this, existing builds in the pool will be allowed to finish but might have network connectivity issues. Please expect additional updates...
-
monitoring
Builds that were running on the affected pool have now finished and all builds are back to normal. We're monitoring closely and will post again once we're in the clear.
-
monitoring
Builds are back to running normally. We will continue to monitor the situation for a short while before closing the incident.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Unreliable or intermittent network connectivity for Linux and Windows builds
Affected: Linux and Windows Builds
Failure mode: A configuration change caused the failure. Root cause: A human mistake during operations. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
investigating
We are receiving reports of Linux and Windows builds where network connectivity is unreliable, intermittently working or slow. We are opening this incident to acknowledge the issue and also keep you posted on our work to solve it. Thank you for your patience.
-
investigating
We are continuing to investigate this issue.
-
identified
We've identified an issue with the latest changes to update the NAT gateways. While this change was meant to improve maintainability, we are rolling it back due to the degraded network performance. We're expecting this provides network speed improvements within the next hour. We...
-
identified
At this point, we've reverted half of the NAT gateway updates and a 50% of the Linux and Windows jobs currently processed have better network performance already. We'll provide another update as soon as this process is complete. Thanks for your patience.
-
monitoring
The NAT gateway changes have been fully reverted. Network performance and reliability in your builds should be back to normal. We’ll be monitoring for a short while before closing this incident.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Slow Linux and Windows builds on travis-ci.org and travis-ci.com
Affected: Linux and Windows Builds
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: Not enough capacity for the load. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
identified
We are seeing a backlog of Linux and Windows builds on both travis-ci.org and travis-ci.com. We are adding capacity as we speak and we’ll keep you posted on the results. Thank you for your patience.
-
resolved
Backlogs have cleared on both sites hence we are resolving this incident.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Slow macOS builds on travis-ci.com and Linux & Windows builds on travis-ci.org
Affected: Linux and Windows Builds
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are seeing a backlog of - macOS builds on travis-ci.com - Linux and Windows builds on travis-ci.org We are looking into adding back capacity to process them.
-
investigating
macOS builds backlog on travis-ci.com has cleared. We are almost done processing the Linux and Windows backlog on travis-ci.org. Thank you for your patience!
-
resolved
All backlogs have cleared now. Sorry again for the inconvenience and happy building!
Excerpts are shortened. Read the full incident on Travis CI's status page.
Delayed posting of Github Status
Affected: Linux and Windows Builds
Failure mode: Data delayed, stale, lost or corrupted, or needing replay after recovery. Root cause: The vendor does not say why it happened. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
Names an upstream provider: GitHub.
-
identified
We have received reports of delayed posting of Github Statuses. We are working to clear the backlog of such that should have been sent out.
-
identified
We have cleared the back logs, and most status have now been posted. If your GitHub Apps is not posting statuses, please try disabling and re-enabling the repository, and restarting (parts of) the affected builds.
-
monitoring
A fix has been implemented and we are monitoring the results.
-
resolved
This incident has been resolved.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Slow booting Linux and Windows builds for both open source and private repositories
Affected: Linux and Windows Builds
Failure mode: Exhausted memory, disk, CPU, queues, connection pools or quotas. Root cause: Not enough capacity for the load. Tagged by claude-haiku-5-5 with high confidence (taxonomy v0.2).
-
identified
We are seeing backlogs of jobs growing on both travis-ci.org and travis-ci.com stemming from yesterday’s incident. We’ve been able to add more resources but not to the extent to be able to handle all build requests we receive during peak hours. Hence, your builds might be...
-
monitoring
We’ve added more capacity and have been able to process the accumulated backlogs on both .com and .org. We will monitor the situation for a short while to ensure everything is stable.
-
resolved
Builds are running smoothly and we have significant remaining headroom. Please send your commits our way! We are closing this incident for now and are thanking you again for you enduring patience.
Excerpts are shortened. Read the full incident on Travis CI's status page.
Slow booting Linux builds for both open source and private repositories
Affected: Linux and Windows Builds
Failure mode: A provider or third-party service this vendor depends on failed. Root cause: A failure at a provider or vendor they depend on. Tagged by claude-haiku-5-5 with medium confidence (taxonomy v0.2).
-
investigating
We are receiving reports of slow booting Linux builds. We are currently looking into it.
-
investigating
We are currently hitting the API rate-limit when using our Cloud Provider’s API that is preventing us from creating/deleting VMs. We are looking into getting the system back under the API rate-limit threshold. Thank you for your patience.
-
identified
We’ve made progress in being able to stay under the API rate-limit and things are looking better on travis-ci.com. A higher backlog of jobs remains on travis-ci.org. We’ll keep you posted on the status of each backlog on a timely basis.
-
identified
Sorry for the lack of updates. It's been challenging to remain below the API rate-limit and the backlogs haven't been decreasing at a steady pace as previously mentioned. We now confirm that the backlog on .com is decreasing at a comfortable pace while the backlog on .org is...
-
monitoring
Backlog on travis-ci.com has cleared around 21:55 UTC. We are monitoring travis-ci.org's backlog closely.
-
resolved
Backlog on travis-ci.org has cleared has of 2019-07-03 2:14 UTC. Thanks again for your continued patience during this incident.
Excerpts are shortened. Read the full incident on Travis CI's status page.