cd /news/artificial-intelligence/jason-haddix-stop-fearing-ai-pentest… · home topics artificial-intelligence article
[ARTICLE · art-123952] src=aikido.dev ↗ pub= topic=artificial-intelligence verified=true sentiment=· neutral

Jason Haddix: Stop fearing AI pentesting

Jason Haddix, former CISO of Ubisoft and author of The Bug Hunter's Methodology, predicts that 90% of penetration tests will be performed by AI in the near future, arguing that defenders must 'fight AI with AI' to keep pace with AI-driven attacks. According to Aikido's State of AI in Pentesting 2026 report, 79% of 400 CISOs and engineering leaders worry about vulnerabilities slipping between scheduled tests, and 48% say findings are outdated by arrival. Haddix says AI will eliminate 'scanners in disguise' and checkbox pentests, but stresses that effective AI pentesting requires baking in human methodology, as raw AI models 'suck' at finding bugs without it.

by read9 min views1 publishedSep 8, 2026
Jason Haddix: Stop fearing AI pentesting
Image: Aikido (auto-discovered)

This post is based on Mackenzie's conversation with Jason Haddix on The Secure Disclosure podcast*. Listen to the full episode or watch below.*

Jason Haddix has topped the Bugcrowd leaderboards, run security as CISO of Ubisoft, and wrote The Bug Hunter's Methodology, the playbook a lot of working pentesters learned from, so his read on the direction of the field is worth listening to. He believes that “90% of pen tests will be done by AI” in the near future. As AI is lowering the barrier of entry to cyber attacks and drastically increasing the volume and speed of malicious operations , the only way defenders can keep up is to put AI to work on their own side. As Haddix says, “We're going to have to fight AI with AI.”

Naturally, this scares human pentesters (are their jobs evaporating?) Haddix doesn't think AI pentesting is an extinction event for humans, though it is something that will inevitably impact their existing workflow.

AI solves pentesting's coverage problem #

Manual pentesting is not only cost-prohibitive, its typical twice-a-year cadence is not adequate for how fast teams are deploying AI-generated code. In Aikido's State of AI in Pentesting 2026 report, 79% of the 400 CISOs and engineering leaders surveyed said they worry about vulnerabilities slipping in between scheduled tests, and 48% said findings are already outdated by the time they arrive.

{{cta}} "The biggest problem we've always had is scale," Haddix says. If you run security for a large organization, the math meant you were never going to manually pentest everything your team shipped. Covering all of it with manual testing "would have been a billion dollars in pentesting." So you tested biannually and hoped for the best.

"We have prayed for scale before," Haddix says, "and now they're just railing against it." His read on the people leading that resistance is that they "want to stand back and sling mud when they should be jumping in and helping people build."

What actually dies #

"Scanners in disguise," is what Haddix calls shops that run open-source scanners and repackage the results. These work differently from real pentests, and return much worse results, which is why they will be the first to go.

The other casualty is the checkbox pentest a customer buys just to satisfy an auditor. Performing these tests has always been the first job a tester takes to break in, and the people in it rarely want to stay. The people doing it would rather be learning real exploits and building their own methodology. AI clears out the drudge rung.

Haddix is honest about the catch, though. If AI takes the foot-in-the-door work, where does the next generation of testers get their start? "I don't have a great answer for that," he admits. "We're still thinking about it."

AI pentesting only works with human methodology baked in #

Point Claude Code at a target and tell it to find bugs, and "it's going to suck. Even the best model, max thinking, doesn't matter," says Haddix. "The power comes when you bake in your methodology.

Take Haddix's recon process, which has 18 steps for mapping the sites a big organization actually owns. Two or three of them used to need a human's eyes and judgment. A company like Nintendo has registered hundreds of thousands of domains, most of them parked, and deciding which ones host a real target was hard to automate. Now an agent reads the page and makes that call itself.

Across the industry, "the smarter ones are hiring pentesters who have unique methodologies and codifying it, putting it in prompting," Haddix says, and "the smartest ones are training synthetic data sets" to keep that reasoning accurate.

And once it's baked in, AI does the creative, chained work that people assume only humans can. In one case from Aikido's own benchmark, agents testing a document-signing app worked through its logic and proved that e-signatures could be forged, all in roughly nine hours. The senior human team spent about two weeks on the same app, returned one XSS and one SSRF, with seven of their nine findings being routine hardening checks, and never caught the forgery.

Giving a pentester access to an application's source code results in a deeper test. Most human-run pentests run grey or black box, limiting the depth of a test. Across more than 1,000 AI pentests, Aikido found that whitebox testing uncovered 7x more vulnerabilities while requiring fewer attempts than greybox testing alone. Humans generally don’t do whitebox testing, because checking every path in the code isn’t feasible. An AI pentest with whitebox testing is able to coordinate a fleet of agents to check every line of the code, and connect it back to the live environment.

While you can bake methodology in, humans miss things too. In Aikido's State of AI in Pentesting 2026 report, half of the surveyed 400 CISOs and engineering leaders say logic flaws, broken access controls, and multi-step bugs get missed always or often in manual testing, and that jumped to 92% for teams shipping daily or faster.  This shows that while the human methodology is well grounded, it's by no means perfect, and AI helps cover what a manual pass would miss.

Aikido AI Pentesting is built on expertise #

Aikido Security built AI Pentesting with the expertise that Haddix describes, and independent testing backs it up. Doyensec benchmarked Aikido on two open-source apps drawn at random from 442 candidates, with a senior researcher validating every finding by hand. Aikido surfaced 49 verified vulnerabilities, 9 of them high or critical, at a 4% false-positive rate, and was running self-serve on both apps in under 20 minutes.

{{pentest}}

<script type="application/ld+json">

{

  "@context": "https://schema.org",

  "@graph": [

    {

      "@type": ["BlogPosting", "TechArticle"],

      "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#article",

      "isPartOf": { "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#webpage" },

      "mainEntityOfPage": { "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#webpage" },

      "headline": "Jason Haddix: 90% of pentests will be done by AI",

      "alternativeHeadline": "Why manual pentesting can't keep up, and what human methodology still brings to AI pentesting",

      "description": "Jason Haddix says 90% of pentests will soon be done by AI. He explains why manual testing can't keep up with AI-generated code, which kinds of testing disappear, and why baked-in human methodology is what makes AI pentesting work.",

      "inLanguage": "en-US",

      "datePublished": "2026-09-08T09:00:00-04:00",

      "dateModified": "2026-09-08T09:00:00-04:00",

      "wordCount": 1150,

      "timeRequired": "PT5M",

      "articleSection": "Pentesting",

      "proficiencyLevel": "Expert",

      "url": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting",

      "author": { "@id": "https://www.aikido.dev/authors/nicholas-thomson#person" },

      "creator": { "@id": "https://www.aikido.dev/authors/nicholas-thomson#person" },

      "publisher": { "@id": "https://www.aikido.dev#organization" },

      "image": { "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#primaryimage" },

      "keywords": [

"AI pentesting",

"penetration testing",

"Jason Haddix",

"The Bug Hunter's Methodology",

"whitebox testing",

"supply chain attacks",

"application security",

"automated pentesting",

"Aikido AI Pentesting"

      ],

      "about": [

        {

          "@type": "Thing",

          "name": "AI penetration testing",

          "sameAs": "https://en.wikipedia.org/wiki/Penetration_test"

        },

        {

          "@type": "Thing",

          "name": "Penetration testing",

          "sameAs": "https://en.wikipedia.org/wiki/Penetration_test"

        },

        {

          "@type": "Thing",

          "name": "Application security",

          "sameAs": "https://en.wikipedia.org/wiki/Application_security"

        }

      ],

      "mentions": [

        {

          "@type": "Person",

          "name": "Jason Haddix",

          "jobTitle": "Security researcher and former CISO",

          "sameAs": "https://x.com/Jhaddix"

        },

        {

          "@type": "SoftwareApplication",

          "name": "Aikido AI Pentesting",

          "applicationCategory": "SecurityApplication",

          "operatingSystem": "Web",

          "url": "https://www.aikido.dev",

          "publisher": { "@id": "https://www.aikido.dev#organization" }

        },

        {

          "@type": "Organization",

          "name": "Doyensec",

          "sameAs": "https://www.doyensec.com"

        },

        {

          "@type": "Organization",

          "name": "Bugcrowd",

          "sameAs": "https://www.bugcrowd.com"

        },

        {

          "@type": "Organization",

          "name": "Ubisoft",

          "sameAs": "https://en.wikipedia.org/wiki/Ubisoft"

        },

        {

          "@type": "CreativeWork",

          "name": "The Bug Hunter's Methodology"

        },

        {

          "@type": "Report",

          "name": "State of AI in Pentesting 2026",

          "author": { "@id": "https://www.aikido.dev#organization" }

        }

      ],

      "speakable": {

        "@type": "SpeakableSpecification",

        "cssSelector": ["h1", ".article-summary", "article p:first-of-type"]

      }

    },

    {

      "@type": "WebPage",

      "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#webpage",

      "url": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting",

      "name": "Jason Haddix: 90% of pentests will be done by AI",

      "description": "Jason Haddix on why manual pentesting can't keep up with AI-generated code, what disappears, and why human methodology still matters in AI pentesting.",

      "inLanguage": "en-US",

      "isPartOf": { "@id": "https://www.aikido.dev#website" },

      "primaryImageOfPage": { "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#primaryimage" },

      "breadcrumb": { "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#breadcrumb" },

      "datePublished": "2026-09-08T09:00:00-04:00",

      "dateModified": "2026-09-08T09:00:00-04:00",

      "author": { "@id": "https://www.aikido.dev/authors/nicholas-thomson#person" },

      "publisher": { "@id": "https://www.aikido.dev#organization" },

      "mainEntity": { "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#article" }

    },

    {

      "@type": "ImageObject",

      "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#primaryimage",

      "url": "https://www.aikido.dev/images/blog/jason-haddix-ai-pentesting.png",

      "contentUrl": "https://www.aikido.dev/images/blog/jason-haddix-ai-pentesting.png",

      "caption": "Jason Haddix on the future of AI pentesting",

      "width": 1200,

      "height": 630

    },

    {

      "@type": "BreadcrumbList",

      "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#breadcrumb",

      "itemListElement": [

        {

          "@type": "ListItem",

          "position": 1,

          "name": "Home",

          "item": "https://www.aikido.dev"

        },

        {

          "@type": "ListItem",

          "position": 2,

          "name": "Blog",

          "item": "https://www.aikido.dev/blog"

        },

        {

          "@type": "ListItem",

          "position": 3,

          "name": "Jason Haddix: 90% of pentests will be done by AI",

          "item": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting"

        }

      ]

    },

    {

      "@type": "WebSite",

      "@id": "https://www.aikido.dev#website",

      "url": "https://www.aikido.dev",

      "name": "Aikido Security",

      "publisher": { "@id": "https://www.aikido.dev#organization" },

      "inLanguage": "en-US"

    },

    {

      "@type": "Organization",

      "@id": "https://www.aikido.dev#organization",

      "name": "Aikido Security",

      "legalName": "Aikido Security",

      "url": "https://www.aikido.dev",

      "description": "Aikido Security is a software security platform that provides category-leading products including SAST, DAST, SCA, and AI Pentesting.",

      "logo": {

        "@type": "ImageObject",

        "@id": "https://www.aikido.dev#logo",

        "url": "https://www.aikido.dev/logo.png",

        "contentUrl": "https://www.aikido.dev/logo.png",

        "caption": "Aikido Security"

      },

      "image": { "@id": "https://www.aikido.dev#logo" },

      "sameAs": [

"https://www.linkedin.com/company/aikido-security",

"https://x.com/AikidoSecurity"

      ]

    },

    {

      "@type": "Person",

      "@id": "https://www.aikido.dev/authors/nicholas-thomson#person",

      "name": "Nicholas Thomson",

      "url": "https://www.aikido.dev/authors/nicholas-thomson",

      "jobTitle": "Senior SEO & Growth Lead",

      "worksFor": { "@id": "https://www.aikido.dev#organization" },

      "sameAs": [

"https://www.linkedin.com/",

"https://x.com/"

      ]

    },

    {

      "@type": "FAQPage",

      "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#faq",

      "isPartOf": { "@id": "https://www.aikido.dev/blog/jason-haddix-ai-pentesting#webpage" },

      "mainEntity": [

        {

          "@type": "Question",

          "name": "Will AI replace human pentesters?",

          "acceptedAnswer": {

            "@type": "Answer",

            "text": "Jason Haddix doesn't see AI pentesting as an extinction event for humans, though it will change existing workflows. The work that disappears first is the checkbox pentest and shops that run open-source scanners and repackage the results. Human methodology still drives the best AI pentesting results."

          }

        },

        {

          "@type": "Question",

          "name": "Why can't manual pentesting keep up with modern development?",

          "acceptedAnswer": {

            "@type": "Answer",

            "text": "Manual pentesting is cost-prohibitive and typically runs twice a year, which isn't enough for teams shipping AI-generated code daily. In Aikido's State of AI in Pentesting 2026 report, 79% of the 400 CISOs and engineering leaders surveyed worried about vulnerabilities slipping in between scheduled tests, and 48% said findings are outdated by the time they arrive."

          }

        },

        {

          "@type": "Question",

          "name": "How does whitebox AI pentesting compare to greybox testing?",

          "acceptedAnswer": {

            "@type": "Answer",

            "text": "Across more than 1,000 AI pentests, Aikido found that whitebox testing uncovered 7x more vulnerabilities while requiring fewer attempts than greybox testing alone. AI can coordinate a fleet of agents to check every line of code and connect it back to the live environment, which humans generally can't do at that depth."

          }

        }

      ]

    }

  ]

}

</script>

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @jason haddix 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/jason-haddix-stop-fe…] indexed:0 read:9min 2026-09-08 ·