https://aibussin.com/tags/embedding-based-training/ Recent content in Embedding-Based Training on AIBussin — AI applications, systems and books Hugo en-US Fri, 27 Jun 2025 23:24:14 +0100 https://aibussin.com/post/pupil/ Fri, 27 Jun 2025 23:24:14 +0100 https://aibussin.com/post/pupil/ <h2 id="-summary">🧪 Summary</h2> <p>As AI developers, we often face the tradeoff between intelligence and accessibility. Powerful language models like Qwen3 run beautifully on servers but what about on the edge? On devices like Raspberry Pi or old Android phones, we’re limited to small models. The question we asked was simple:</p> <p><strong>Can we teach a small model to behave like a large one without retraining it from scratch using only its outputs and embeddings?</strong></p>