Skip to content
James Bower
James Bower

Quantitative AI Security

  • Tools
  • Audit
  • Guides
  • Courses
  • Newsletter
James Bower

Quantitative AI Security

Audit

Detection Health & Validation Audit

Spectrum’s 2026 Detection Debt Report found that 29.2% of deployed, enabled detection rules cannot fire. Two-thirds of the failures are data problems, not logic: a field moved, a value changed under a field the SIEM still reports as healthy, a log source went dark. Syntax errors are under 1%. Those get caught. The quiet failures don’t, and a rule that runs correctly and finds nothing looks exactly like a rule that works.

The audit finds out which of yours still catch what they claim.

What you get

Your Sigma and Elastic rule estate run through detect-forge: staleness against current ATT&CK, backtesting against labeled attack telemetry, and coverage gaps weighted by your priority techniques. You receive a scored report, rule by rule, with a fix list that includes the rules to retire, and a 60-minute readout. Nothing leaves your environment; the CLI runs where your rules live, and I work from the output.

Price

$3,500. The first three founding customers pay $1,750 in exchange for an anonymized case study.

Book an intake call:

Book a 30-minute intake call

I’m building Detect-Forge in the open. The results of every audit, win or miss, get reported in the weekly build log, anonymized.

  • Twitter
  • GitHub
  • YouTube
  • LinkedIn

Videos

https://www.youtube.com/watch?v=FEb8KZoEyzI&t=1291s

Categories

  • Active Defense
  • Anomaly Detection
  • AWS
  • Books
  • Business
  • CTF
  • Decision Intelligence
  • Deep Learning
  • Detection Engineering
  • EDA
  • Entity Recognition
  • Health
  • Linux
  • LLM
  • Machine Learning
  • Memory Forensics
  • NIDS
  • NLG
  • NLP
  • Operating Systems
  • Productivity
  • Python
  • Quantitative Security
  • Security Tools
  • Sentiment Analysis
  • Tech
  • Text Analytics
  • Threat Hunting
  • Threat Intelligence
  • Topic Modeling
  • UEBA

Recent Posts

  • Detection Rule Staleness: How AI Can Solve This Now
  • How to Think About Low-Latency Development with Python
  • Managing Noise In AI Security Machine Learning
  • Dimensionality Reduction: Find the Best Method for Your Data
  • Improved Anomaly Detection in Cybersecurity using Model Cascading

Tags

Apache BERT Boot2Root classification Conda Data Augmentation ddos Diet Dirb Ensemble ETL featured Firewall FreeBSD GPT-3 Hacking Hacking Challenge Htop Kioptrix LiME LLM low-latency Miniconda Mod_jk Monitoring NetworkMiner Nikto NLP NLTK Nmap Nokia 770 OpenAI OpenBSD PCAP pdfminer Peak Performance PF recon Security SSM Tomcat Volatility VSCode Word2Vec xgboost

Archives

  • April 2026
  • November 2024
  • October 2024
  • June 2024
  • October 2023
  • September 2023
  • August 2023
  • May 2023
  • April 2023
  • February 2023
  • March 2020
  • June 2019
  • July 2018
  • May 2018
  • August 2017
  • June 2017
  • February 2017
  • November 2016
  • October 2016
  • September 2016
  • April 2016
  • March 2016
  • November 2015
  • August 2015
  • June 2015
  • February 2015
  • September 2014
  • August 2014
  • July 2014
  • January 2014
  • June 2013
  • January 2012
  • September 2009
  • August 2009
  • September 2008
  • September 2006
©2026 James Bower | WordPress Theme by SuperbThemes