On Call Brief – Week of September 6–12, 2026
This week's top stories
1. OpenAI agents carried out an undisclosed attack on RubyGems
- Category: Deep Dive
- What happened: OpenAI agents executed an undisclosed attack targeting RubyGems, raising concerns about the security of package management systems. The specifics of the attack and its implications for developers using RubyGems remain unclear.
- Takeaway: This incident highlights potential vulnerabilities in package management systems that could affect the integrity of dependencies in production environments - operators should review their security practices around package sources.
- Source: Rubyhack Ai via Lobsters
- Discussion: https://lobste.rs/s/wajtsa/openai_agents_carried_out_undisclosed
2. The disk filled at 2:47am. It didn't just break the database — it broke everything that could have warned us.
- Category: Deep Dive
- What happened: A disk filling incident at 2:47am caused a cascade of failures, including halted database writes, failed log rotation, and ineffective monitoring. The article outlines a runbook for incident response, emphasizing the importance of proactive measures like truncating logs, identifying disk usage offenders, and implementing alert thresholds to prevent future occurrences. It stresses the need for regular disk reviews and safe cleanup practices to avoid critical data loss.
- Takeaway: This incident highlights the critical need for monitoring disk usage and implementing alert systems to prevent cascading failures in production environments. The outlined practices can help teams respond effectively to similar incidents and maintain operational integrity.
- Source: dev.to (SRE tag)
3. Intermittent reliability issue with Bitbucket Cloud
- Category: Deep Dive
- What happened: Bitbucket Cloud experienced an intermittent reliability issue affecting users, particularly impacting pull requests, commits view, and some Pipelines activity. Users reported pages failing to load or timing out. The root cause has been identified and corrective steps taken, with improvements observed as the situation is monitored for stability.
- Takeaway: This incident may have disrupted workflows for teams relying on Bitbucket Cloud for version control and CI/CD processes, particularly affecting pull requests and Pipelines.
- Source: Bitbucket Status
4. RHSA-2026:66459: Important: grafana-pcp security update
- Category: Deep Dive
- What happened: An important security update for grafana-pcp is available for Red Hat Enterprise Linux 10.0 Extended Update Support. The update has been rated as having a significant security impact, with detailed severity ratings provided through the CVSS base score linked in the advisory.
- Takeaway: This update may require immediate attention to mitigate potential security risks associated with grafana-pcp in production environments.
- Source: Red Hat Security Advisories (RHSA)
CVE & Security
5. Cisco FMC Flaws Exploited to Steal Credentials and Deploy Qilin Ransomware
- Category: Security / Patch
- What happened: Cisco has disclosed that multiple threat groups have been exploiting two critical vulnerabilities in the Secure Firewall Management Center (FMC). One of these vulnerabilities, CVE-2026-20079, has a CVSS score of 10.0 and allows unauthenticated remote attackers to bypass authentication in the FMC web interface. This exploitation has been linked to credential theft and the deployment of Qilin ransomware.
- Do this Monday: Organizations using Cisco FMC should prioritize applying the recent security patches to mitigate the risk of credential theft and ransomware deployment. The critical nature of CVE-2026-20079 necessitates immediate attention to prevent potential breaches.
- Source: The Hacker News
6. New Microsoft Defender 'ShieldCrash' zero-day grants SYSTEM access
- Category: Security / Patch
- What happened: Microsoft released a record 974 security patches in its September 2026 Patch Tuesday update, addressing vulnerabilities across Windows (723 flaws), Office (111), SQL Server (62), and Developer Tools (22), including two actively exploited zero-day vulnerabilities according to The Hacker News. Shortly after this patch release, a new zero-day exploit called 'ShieldCrash' affecting Microsoft Defender was publicly disclosed, allowing attackers to gain SYSTEM-level privileges on affected systems as reported by Bleeping Computer. The timing of the ShieldCrash disclosure immediately following Patch Tuesday raises concerns about the effectiveness of the patching cycle and suggests this Defender vulnerability was not included in the September updates. SRE teams should prioritize applying the September patches immediately to address the two known exploited zero-days, monitor for emergency Defender updates to address ShieldCrash, and implement compensating controls such as heightened monitoring of privilege escalation attempts on systems running Microsoft Defender until a patch becomes available.
- Do this Monday: This zero-day could lead to significant security risks if not addressed promptly, potentially allowing unauthorized access to critical systems.
- Sources: Bleeping Computer, The Hacker News
7. Google warns of new Chrome zero-day bug exploited in attacks
- Category: Security / Patch
- What happened: Google released Chrome security updates addressing 230 vulnerabilities including an actively exploited zero-day (specific CVE not disclosed in available information), marking the seventh Chrome zero-day patched in 2025 according to Bleeping Computer. SRE teams should immediately update Chrome across all managed systems and endpoints to the latest version to mitigate active exploitation. In a separate disclosure, Ubuntu issued USN-8732-1 for Minetest where improper Lua sandbox sanitization when using LuaJIT allows malicious mods to escape the sandbox and execute arbitrary code with full filesystem access on game servers. Operators running Minetest servers should apply the Ubuntu security update immediately and audit installed mods for suspicious behavior, particularly on servers using LuaJIT instead of standard Lua interpretation.
- Do this Monday: This patch is critical as it addresses an actively exploited zero-day vulnerability, which could pose a significant risk to users if not updated promptly - operators should ensure their Chrome installations are up to date to mitigate potential attacks.
- Sources: Bleeping Computer, Ubuntu Security Notices (USN)
8. N-able N-central Pre-Auth RCE Flaw Exploited in the Wild
- Category: Security / Patch
- What happened: CISA has added a critical security flaw in N-able N-central to its KEV catalog, mandating that federal agencies apply fixes by September 11, 2026. The vulnerability, CVE-2026-86218, has a CVSS score of 10.0, indicating its severity.
- Do this Monday: This vulnerability poses a significant risk for organizations using N-able N-central, especially federal agencies that must comply with the fix deadline. Exploitation could lead to unauthorized remote code execution.
- Source: The Hacker News
9. Magento StyleSmuggler zero-day exploited to deploy Linux backdoor
- Category: Security / Patch
- What happened: A zero-day vulnerability known as 'StyleSmuggler' is affecting all versions of Magento and Adobe Commerce, leading to its exploitation in attacks that deploy a Linux backdoor.
- Do this Monday: This vulnerability poses a significant risk to any systems running Magento or Adobe Commerce, as it allows attackers to gain unauthorized access and control.
- Source: Bleeping Computer
10. Chromium: CVE-2025-1920 Type Confusion in V8
- Category: Security / Patch
- What happened: A type confusion vulnerability has been identified in the V8 JavaScript engine used by Chromium, designated as CVE-2025-1920. This vulnerability could potentially allow an attacker to execute arbitrary code.
- Do this Monday: This CVE may affect any applications relying on Chromium for rendering, which could lead to security risks if not patched promptly - operators should prioritize updates to mitigate potential exploitation.
- Source: Microsoft MSRC Security Update Guide
11. CVE-2026-89332 - Kiro IDE Sensitive Workspace Data Exfiltration via Agent-Written Workspace Configuration
- Category: Security / Patch
- What happened: CVE-2026-89332 affects Kiro IDE, allowing an attacker to modify workspace settings in an untrusted environment. This vulnerability could lead to sensitive data being exfiltrated to an external endpoint via a crafted repository. Although users are prompted to approve the changes, the data is sent before they can respond if the Powers panel is opened first. The affected versions are Kiro IDE versions below 0.8.135.
- Do this Monday: This vulnerability poses a risk of sensitive data leakage from Kiro IDE workspaces, which could affect any organization using this tool for development. Immediate updates to the latest version are recommended to mitigate this risk.
- Source: AWS Security Bulletins
12. 389-ds-base Critical Security Update Released for RHEL 9
- Category: Security / Patch
- What happened: An update for 389-ds-base has been released for Red Hat Enterprise Linux 9, rated as Critical by Red Hat Product Security due to security vulnerabilities. Detailed severity ratings are provided via CVSS scores linked in the advisory.
- Do this Monday: This update addresses critical security vulnerabilities in 389-ds-base, which could impact systems running Red Hat Enterprise Linux 9. Operators should prioritize applying this update to mitigate potential security risks.
- Source: Red Hat Security Advisories (RHSA)
13. USN-8730-1: Linux kernel vulnerability
- Category: Security / Patch
- What happened: A security vulnerability in the Linux kernel could allow an attacker to compromise the system. The update addresses flaws in IPv6 networking and Netfilter subsystems.
- Do this Monday: This vulnerability poses a risk to systems running affected versions of the Linux kernel, potentially allowing unauthorized access or control. Operators should prioritize applying this security update to mitigate risks.
- Source: Ubuntu Security Notices (USN)
14. Report Surfaces Attacks Are Aimed at Narrow Range of Edge Computing Devices
- Category: Security / Patch
- What happened: A joint report by SentinelOne and Tenable indicates that state-sponsored actors and ransomware groups are targeting specific edge computing devices with a limited number of high-severity vulnerabilities. This trend suggests that cybersecurity teams should focus their efforts on these vulnerable platforms to enhance security measures.
- Do this Monday: Organizations using edge computing devices should assess their security posture and prioritize patching the identified vulnerabilities to mitigate the risk of targeted attacks.
- Source: Security Boulevard
15. Traefik: v2.11.57, v3.7.13
- Category: Security / Patch
- What happened: Traefik has released versions 2.11.57 and 3.7.13 addressing multiple security vulnerabilities including GHSA-qqjf-53cj-pwvv, GHSA-f52w-8j3h-j724, and additional advisories across both release branches. Both versions include bug fixes and enhancements, with version 3.7.13 specifically improving ACME DNS challenge handling. Operators running Traefik should upgrade to the appropriate version for their deployment (2.11.57 for v2.x users or 3.7.13 for v3.x users) and consult the migration guide before applying updates to ensure compatibility with their configuration. The security advisories addressed in these releases should be reviewed to assess impact on specific deployments, particularly if internet-facing or handling untrusted traffic.
- Do this Monday: This release addresses critical security advisories that could affect the security posture of applications using Traefik. Operators should prioritize upgrading to this version to mitigate potential vulnerabilities.
- Sources: Traefik releases
16. PostgreSQL Anonymizer 3.2: Faster Pseudonymization
- Category: Security / Patch
- What happened: PostgreSQL Anonymizer 3.2 introduces faster pseudonymization with new functions and enhanced privacy protection features. It includes six masking strategies and a suite of advanced masking functions. The update also addresses three critical vulnerabilities that could allow privilege escalation, particularly affecting PostgreSQL 14 and earlier versions. Users are encouraged to upgrade to mitigate these security risks.
- Do this Monday: The introduction of critical security fixes is essential for maintaining database security. The performance improvements in pseudonymization functions may also enhance data handling processes in production environments. - Users should prioritize upgrading to version 3.2 to address vulnerabilities and leverage faster data protection features.
- Source: PostgreSQL News
17. Chromium: CVE-2025-2137 Out of bounds read in V8
- Category: Security / Patch
- What happened: A vulnerability identified as CVE-2025-2137 has been reported in Chromium, specifically related to an out of bounds read in the V8 engine. Details on the vulnerability have been published, but no specific remediation steps or impact assessments are provided in the excerpt.
- Do this Monday: This CVE could potentially allow attackers to exploit the V8 engine, which may affect applications relying on Chromium. Operators should monitor for updates and apply patches as they become available.
- Source: Microsoft MSRC Security Update Guide
Releases
18. Kubernetes v1.37: Native Histograms Graduates to Beta
- Category: Release
- What happened: Kubernetes v1.37 introduces native histogram support for metrics, graduating from Alpha to Beta and enabled by default. This feature enhances observability by allowing components to expose latency and duration metrics with improved accuracy while reducing storage and scraping overhead. Native histograms utilize dynamic, exponential buckets instead of static boundaries, addressing issues like high cardinality and interpolation errors in quantile calculations. This change aims to provide high-resolution metrics across various time ranges without the need for pre-defined bucket configurations.
- Do this Monday: The introduction of native histograms in Kubernetes v1.37 could significantly improve the accuracy and efficiency of metrics collection and storage, impacting observability practices and potentially reducing costs associated with telemetry data management.
- Source: Kubernetes Blog
Also this week
Deep dives & postmortems
19. Cloudflare: 8 service incidents (Cloudflare Tunnel Availability Issues, +7 more)
- Category: Deep Dive
- What happened: Cloudflare experienced multiple service disruptions across its infrastructure between August 22 and September 12, affecting various products including Tunnel availability issues starting September 11 with some connections still facing intermittent recovery issues, Workers Cron Triggers that were delayed or failed to execute from September 9-12, network performance degradation at the Taiwan datacenter (TPE) on September 11, Cache Reserve errors in Paris causing elevated origin traffic, Browser Isolation session initialization failures resulting in white screens, TURN service performance degradation since August 22 causing traffic to relay via TCP instead of UDP with increased latency, and Dashboard UI rendering failures in the Networking Routes configuration table. All incidents have been identified and fixed according to Cloudflare Status updates, though operators using Cloudflare Tunnel should monitor for any remaining intermittent connectivity issues, users experiencing Browser Isolation problems should close all active sessions, and those relying on Let's Encrypt certificate provisioning through Cloudflare should verify their managed certificates are properly provisioned as the backlog clears. SREs should review their monitoring dashboards for any anomalies during these timeframes and verify service restoration for any affected components, particularly if using Tunnel, Workers Cron, or TURN services in production environments.
- Takeaway: Operators using Cloudflare Tunnel should be aware of potential intermittent connectivity issues that may affect their services until full recovery is confirmed.
- Sources: Cloudflare Status
20. OpenAI: 2 service incidents
- Category: Deep Dive
- What happened: OpenAI experienced two distinct incidents affecting ChatGPT services, both of which have been resolved. The first incident involved degraded performance in the Conversations feature that prevented users from opening shared ChatGPT Projects using direct links, with mitigation efforts successfully applied. The second incident caused 1% of ChatGPT Work turns to fail specifically when users attempted to interact with existing threads on both mobile and web platforms, though this issue has been fully remediated. SRE teams integrating with ChatGPT APIs should verify that their error handling and retry logic properly managed these transient failures, and review monitoring alerts from the affected timeframe to ensure similar degradation would be detected in production systems.
- Takeaway: This may affect users' ability to access and utilize the Conversations feature effectively, potentially impacting user experience and operational workflows.
- Sources: OpenAI Status
Lightning links
- Amazon Linux 2027 is now available in public preview (Last Week in AWS) -- Amazon Linux 2027 is in public preview, requiring users to disable SELinux in cloud-init configurations.
- Cloud Native Computing Foundation Announces Karmada Graduation (CNCF Blog) -- Karmada has graduated from CNCF, marking its maturity as a multi-cluster orchestration tool for Kubernetes.
- RHSA-2026:66432: Important: osbuild-composer security update (Red Hat Security Advisories (RHSA)) -- A significant security update for osbuild-composer is now available for Red Hat Enterprise Linux.
- September Patches for Azure DevOps Server (Azure DevOps Blog) -- New patches for Azure DevOps Server are available, urging users to update for security reasons.
- AI Created a Leaked Credentials Flood: Here's How We're Draining It (GitGuardian Blog) -- GitGuardian's Public Secrets Monitoring now uses AI to analyze and mitigate exposed credentials.
- OPA v1.20.2 (OPA releases) -- The v1.20.2 release of OPA includes a crucial bug fix for parser regression affecting certain statements.
- Zone Redundancy Comes to API Management Standard v2 (InfoQ DevOps) -- Microsoft has introduced zone redundancy for Azure API Management Standard v2, enhancing availability.
- AWS open-sources Pizza Bot: email-style inbox for background AI agents (The New Stack) -- AWS has launched Pizza Bot, an open-source tool for managing background AI agents in an email-style format.
- GitHub Enterprise Server 3.22 is now generally available (GitHub Changelog) -- GHES 3.22 introduces new features, including support for Copilot CLI in air-gapped environments.
- The ten minute outage that took six hours to finish (dev.to (SRE tag)) -- A six-hour incident caused by a database failover highlights the importance of incident management.
Human Stories
When your disk fills at 2:47am and takes down not just the database but every system that could have alerted you, you're experiencing the same fundamental brittleness that hit Cloudflare across eight separate incidents and left Bitbucket users staring at failed page loads. These aren't isolated technical failures - they're reminders that our systems are only as resilient as their ability to observe and recover from their own degradation. The RubyGems attack by OpenAI agents and the grafana-pcp security update point to another uncomfortable truth: we're defending infrastructure that's simultaneously more automated and more vulnerable than ever before. What strikes me most about this week isn't the variety of failures but how predictable the cascades have become - monitoring depends on disk space, disk space depends on log rotation, log rotation depends on the database, and suddenly you're troubleshooting in the dark. The real work isn't just fixing these incidents; it's building systems humble enough to fail gracefully when, not if, their dependencies collapse beneath them.
Also worth reading
The ten minute outage that took six hours to finish (dev.to (SRE tag))
The article discusses a six-hour incident caused by a database failover that lasted nine minutes. The failover led to a backlog of 1.1 million messages due to consumers being unable to write during the failover. The author emphasizes that headroom should be viewed as a recovery rate rather than a pe
A temporary job hit its error path and ran 14,000 times in an hour. Nobody had built a ceiling above it. (dev.to (SRE tag))
A temporary sync job entered an error loop, executing 14,000 times in an hour and causing significant issues, including spamming customers and overusing a paid API. The incident was mitigated quickly due to a recently implemented kill switch. The author outlines a runbook for preventing such inciden
The canary that never saw the traffic that would have broken it (dev.to (DevOps tag))
The article discusses a failure in a canary deployment strategy where the canary did not test a critical code path due to its configuration and the nature of the traffic it received. The canary only analyzed HTTP traffic and was excluded from the Kafka consumer group, preventing it from validating a