GitHub 与 Microsoft 试点 AI 找漏洞并附修复建议,六个开源项目收到 99 份私密报告
Maintainers don’t need more AI bug reports. They need fixes.
GitHub 与 Microsoft 在 AutoGPT、Caddy、Express、FastMCP、ImageMagick、Netty 六个开源项目上试点,用 Microsoft 的 Codename MDASH 扫描漏洞并给出修复建议。
GitHub 与 Microsoft 在六个开源项目试点,AI 扫描加人工复核后只送出 99 份带修复建议的私密报告,维护者已修 55 个,但每项目要七名研究员手工核查两天。
AI has made finding potential vulnerabilities fast and cheap. Fixing them still takes human judgment, and in open source, that work falls to maintainers. Many are already flooded with AI-generated security findings, including duplicates and reports that aren’t vulnerabilities at all. Another raw scan doesn’t help them. Anyone pointing a new model at a project should ask its maintainers first and come with fixes, not just findings.
Maintainers are under intense pressure from this flood of reports. As Christian Grobmeier, a maintainer of Log4j, has put it, the AI defending open source has to be better than the AI attacking it.
AI shouldn’t add to maintainers’ workload. So, with maintainers, GitHub and Microsoft ran a pilot together: could AI help maintainers ship fixes instead of handing them more findings?
GitHub and Microsoft are using Codename MDASH, Microsoft’s multi-model agentic scanning harness, to find and fix security vulnerabilities in widely used open source software, strengthening the foundation that much of the world’s code is built on.
The process
Our pilot had two goals: send only findings that matter, and never send a maintainer an unverified finding. Here’s how it worked:
- Find. Codename MDASH, an AI system from Microsoft Security, scanned each project using Microsoft’s MAI Cyber model and suggested fixes for what it found.
- Filter. An AI triage agent from the GitHub Security Lab, built on tailored Copilot skills, removed duplicates, checked validity, and focused on high-impact bugs, so maintainers never had to review raw scan results.
- Verify. Researchers from Microsoft FORGE Lab checked every remaining finding by hand.
- Report privately. Reports reached maintainers through GitHub private vulnerability reporting, with a proof of concept and a suggested fix.
- Fix. Maintainers decided what to fix, how to fix it, and when.
Reports and fixes stayed on GitHub, where maintainers already work.
The result: Codename MDASH, using Microsoft’s MAI Cyber model, flagged thousands of possible issues across the six projects. After AI triage and hand review by seven Microsoft FORGE Lab researchers, maintainers received 99 private reports. As of November 15, they had fixed 55, and 14 of those fixes were already in a release.

Participating projects
Six projects took part, all alumni of the GitHub Secure Open Source Fund. Their maintainers agreed to the scan, received every report privately, decided what to fix, and shared what worked:
- AutoGPT, an AI agent platform
- Caddy, a web server
- Express, a web framework for Node.js
- FastMCP, a framework for building MCP servers
- ImageMagick, image processing software
- Netty, a networking framework for Java

What we learned
These lessons come from what the six projects fixed and what their maintainers chose to share. Six projects is a small sample, so read them as early lessons.
1. Fixes matter more than findings
Fixing is where maintainers spend their time. So every report arrived already checked, with a suggested fix to review, adapt, and merge. Maintainers started from a well-scoped patch, not a raw finding.
The first fixes shipped about a week after the initial scan. Caddy’s maintainers fixed all 22 of the reports they received in a week or less. Maintainers used the suggested fixes, some as written and some with changes.
AutoGPT’s maintainers had recently shipped a new check, and it was broken. The report landed three days later and pointed at the right line. They took the fix further than the suggested patch, wrote it within a day, and had it in production less than a week later.
Finding vulnerabilities is no longer our bottleneck. Fixing them is the hard part, and that depends on maintainers.
Netty maintainer
2. Codename MDASH, with researcher review, gave maintainers high-quality findings with fixes
Maintainers got a short list, not a flood. Express maintainers said the reports cut through the noise. Caddy maintainers said they surfaced obscure bugs and filled gaps that earlier reports had missed. For FastMCP, the scan went beyond what AI scanners had given them before. ImageMagick, maintained by a two-person team, received 22 reports.
AI did the finding, researchers did the checking, and maintainers stayed in charge.
One ImageMagick report looked like a kind of issue the maintainers had seen before. Its summary showed it wasn’t and pointed to the exact lines of code. They were able to push a fix in 15 minutes.
Normally, a security advisory would take us around 30 minutes to 1 hour on average to read, understand, and make a fix. It is a huge difference.
ImageMagick maintainer
Codename MDASH was able to find unknown, obscure security bugs in our project with succinct reports, and it filled in gaps from some prior reports that hadn’t been noticed.
Caddy maintainer
3. Open source still has gaps to close
The pilot worked because people did careful work at every step, and that work doesn’t scale yet. Seven researchers spent about two days per project checking findings by hand. Meanwhile, low-quality reports still reach maintainers every day.
For open source, fixes need to be delivered via private vulnerability reporting (PVR). Maintainers need to run CI/CD tests on private forks to verify those fixes. And to close the gap between defenders and attackers, maintainers need access to cyber-capable models to verify a proof of concept, before and after the fix.
The Codename MDASH scan provided unique insights into the security of our project above and beyond what AI scanners have provided us in the past
FastMCP maintainer
Why it matters
If you’re a maintainer, this approach changes what a security report costs you. A checked, private report that comes with a suggested fix takes less of your time. You shouldn’t have to triage a scanner’s output. That’s the sender’s job.
If you use AI to find vulnerabilities in open source, maintainers’ feedback points to this standard:
- Check every finding before you send it, against what the project already knows and against its threat model and security policy.
- Report it privately.
- Include a suggested fix. Let maintainers set the pace.
Features are easier and easier to ship, but in the future maintaining software will probably come down to who cares enough to manage the security.
AutoGPT maintainer
Codename MDASH is very useful for cutting through the noise of vulnerability reports.
Express maintainer
What you can do today
- If you maintain any open source project, turn on private vulnerability reporting so researchers can report security issues to you without making them public. If your project is on GitHub, turn on core security features in about two minutes with
gh-secure. - If you build on open source, turn on Dependabot alerts so you know when a dependency you use needs a security update.
- If you send AI-generated vulnerability reports to open source projects, hold them to the standard above before you send them.
- Repositories using GitHub code security can use agentic autofix to help automatically remediate their alerts with Copilot
What happens next
- Fixes, where maintainers already work. GitHub is bringing these lessons into private vulnerability reporting and security advisories, where GitHub Security Lab is already investing to reduce the burden of low-quality reports on maintainers.
- MAI Cyber 2. Today Microsoft announced MAI Cyber 2. The Codename MDASH pilot ran on the earlier MAI Cyber model. GitHub and Microsoft will keep working together to help secure open source.
- Closing the gaps, starting with the GitHub Secure Open Source Fund. We’re working with Microsoft to scale researcher review without cutting corners. GitHub will offer every alumni project AI security scans, with findings checked before they’re reported privately. Alumni also get GitHub Copilot Max. We’ll bring this support to future sessions of the Fund.
Everyone downstream benefits from this system. When a maintainer publishes a security advisory on GitHub and it’s reviewed for the GitHub Advisory Database, Dependabot can alert the repositories that depend on that package. That’s the idea behind the GitHub Secure Open Source Fund: 216 projects so far, with more than 300 maintainers fixing more than 4,000 vulnerabilities in software downloaded more than 20 billion times a month.
Thank you
To the maintainers of AutoGPT, Caddy, Express, FastMCP, ImageMagick, and Netty: thank you for your time, your trust, and your feedback. Thank you also to the Codename MDASH team at Microsoft Security, the MAI Cyber team, the researchers of Microsoft FORGE Lab, and GitHub Security Lab.
Maintainers do the fixing. Our job is to make sure they never do it alone.
Hear from maintainers about their experience with Codename MDASH. 👇
About the GitHub Secure Open Source Fund
All six projects in this pilot are alumni of the GitHub Secure Open Source Fund, which gives each project $10,000 through GitHub Sponsors, plus security training and a supportive alumni community.
The GitHub Secure Open Source Fund, powered by GitHub Sponsors, funds open source projects that underpin the digital supply chain, catalyze innovation, and are critical to the AI stack. Want your company to help secure the open source it depends on? Become a funding partner through the Fund page. Learn more about the Fund or apply.

Through the Fund, maintainers receive security training and Azure credits from Microsoft for Startups. That support sits alongside Microsoft’s European Security Program and its Secure Future Initiative, whose principle is security above all else. Most organizations are downstream in the same way. If your software depends on open source, do the same: back the maintainers you rely on.
All alumni of the GitHub Secure Open Source Fund
AI, machine learning, and intelligent systems
ACI.dev • AlbumentationsX • ArviZ • AutoGPT/GravitasML • CAMEL-AI • Caracal • CocoIndex • Code-Graph-RAG • CodeCarbon • Cognee • Deep Agents • DIPY • DocsGPT • FastMCP • Jupyter • LadybugDB • LangChain • Matplotlib • n8n-MCP • Nasiko • NumPy • Ollama • ONNX • OpenBB Platform • OpenClaw • OpenCV • OpenMetadata • OpenSearch • PageIndex • pandas • Pydantic • PyMC • Ruby-OpenAI • Scenic • scikit-learn • SciPy • Serena • TokenOps • TraceRoot • Zeus
Build systems, supply chain, and release tooling
Apache Airflow • Babel • Bluefin • bootc • Browserslist • Changesets • Colima • Concourse • Cucumber • CycloneDX Python Library • Flux • Foundry • Gitoxide • golangci-lint • GoReleaser • hardhat-deploy • Jenkins • JReleaser • Jupyter Docker Stacks • NixOS/Nixpkgs • node-lru-cache • oapi-codegen • PostCSS • PyPI/Warehouse • rimraf • Task • Termux • Terra • Turborepo • Warpgate • webpack • zizmor
Core programming languages, runtimes, and foundational libraries
Apache Commons • Apache Groovy • Byte Buddy • core-js • CPython • FS2 • Gleam • Himmelblau • htmx • LLVM • NAPI-RS • Node.js • Pkl • Pyodide • Rustls • SQLite • termcolor • time-rs
Developer tools and productivity platforms
AirQo • API Dash • ArduPilot • AssertJ • AsyncAPI Initiative • Bevy • Bootstrap • calibre • Charset Normalizer • Cheerio • Ciphey • Cobra • CodeRunner • CSS Declaration Sorter • DataJourney • Diesel • DIGIT • Electron • ERPNext • fabric.js • GitPython • Hoppscotch • ImageMagick • jQuery • js-yaml • jsoup • JUnit • libyt • LORIS • MapStruct • Mastodon • Mathesar • Mautic • Mermaid • MessageFormat • Mockoon • NativeScript • Next.js • Nuxt • nvm • Oh My Zsh • p5.js • Path-to-RegExp • Pelias Geocoder • Pest • Pillow • Polly • Proyecto Respira • PypeIt • python-benedict • qs • React Starter Kit • Readest • Resolve • Rocket.Chat • Selenium • shadcn/ui • Sphinx • Spyder • ssh_config • StackQL • Stirling PDF • Svelte • Thunderbird for Android • ToolJet • Two.js • Viper • virtualenv • Vuetify • Wagmi • WebdriverIO • xyflow • YAML • Yii Framework • Yjs
Web, networking, APIs, and infrastructure services
actix-web • aiohttp • Apache APISIX • Apache Shiro • Apache Solr • Apache ZooKeeper • Arkime • Caddy • cmux • Cryptomator • curl • CycloneDX .NET Library • CycloneDX cdxgen • Ente • etcd • evcc • Express • external-secrets • FastAPI • Fastify • Haraka • Helmet.js • Home Assistant • Hummingbird • jose • Keycloak • Keyshade • kgateway • Log4j • mimetype • NetBird • Netty • Oauth2 (Ruby) • OAuthlib • openapi-stack • OpenWISP • PGPainless • quic-go • ScanAPI • ScanCode • Sniffnet • Social Auth App Django • Stalwart • Starlette • UAParser.js • urllib3 • Vapor • varlock • Veramo • WebAuthn (Go) • ZITADEL
The post Maintainers don’t need more AI bug reports. They need fixes. appeared first on The GitHub Blog.
来源:GitHub Blog · github.blog