We built a vendor-neutral accelerator plugin architecture in lldb-server for debugging applications that span CPUs and GPUs. It separates shared debugger infrastructure from hardware-specific device control. The design represents the CPU and GPU as separate debugger processes while presenting them in one debugging session. Modern AI applications rarely execute in one place. A workload can [...]
The post Extending LLDB to Debug Applications That Span CPUs and GPUs appeared first on Engineering at Meta.
source & further reading
engineering.fb.com — original article
Evaluating voice agent quality at scale
Improving caller identification for voice AI agents
A simple fix for LLM tail latency