The Power of Logits: Unlocking Smarter, Safer LLM Responses
Summary In this blog post
I want to fully explore logits and how they can be used to enhance AI applications I want to understand the ideas from this paper: “Is That Your Final Answer? Test-Time Scaling Improves Selective Question Answering” This paper introduces a new approach, Selective Question Answering (SQA). This introduces confidence scores to decide when an answer should be given. In this post, we’ll cover the core insights of the paper and implement a basic confidence-based selection function in Python.