CUDA support added - Pre-generation knowledge-boundary estimator
A new pre-generation knowledge-boundary estimator with CUDA support has been developed. The tool uses a small sidecar model and prompt-only features to predict whether a language model will answer correctly without retri…