100% Recall, 38.5% Precision: What Happened When My AI Auditor Audited Itself
ThirdLine, an open-source AI auditing system, achieved 100% recall and an F1 score of 0.909 on a deterministic evaluator when auditing synthetic banking agents, but precision fell to 38.5% and F1 to 0…