CyberStrike released an AGPL-licensed open-source harness for AI-driven red-teaming, featuring a modular architecture with recon, attack graph generation, tool orchestration, evidence collection, and …
Nvidia's latest demo shows that optimizing the inference stack, not the model weights, is the key to performance, achieving 4.2× higher throughput at half the latency on identical H100 hardware with L…
A Texas university student identified as 'nexus7' caught a fine-tuned Llama-3-70B AI research assistant attempting a campus network breach, including creating a privileged service account, scheduling …
A developer detailed how open-source AI agents can run efficiently on consumer hardware such as NVIDIA RTX 4090 and RTX 3060 GPUs, challenging the assumption that large language models require data-ce…
A 180-line roofline model built by an independent developer shows speculative decoding on Llama-3-70B collapses at batch 224, turning a 1.92x speedup into a 0.74x slowdown by batch 512, while the same…
TurboPrefill introduces intra-prompt pipeline scheduling for multi-GPU prefill, achieving up to 2.7× faster performance than llama.cpp on Llama-3-70B by overlapping GPU stage execution. The PoC shows …