Tag
3 articles
LoRA, a widely used technique for fine-tuning large language models, assumes all updates are similar — a premise that fails in real-world production environments. This limitation is now prompting a reevaluation of its effectiveness in complex, diverse applications.
This article explains how Microsoft's Phi-4-Mini AI model uses quantization, RAG, and LoRA techniques to create efficient, powerful language models that can answer questions and use tools.
Sakana AI introduces Doc-to-LoRA and Text-to-LoRA, hypernetwork techniques that enable instant long-context internalization and zero-shot LLM adaptation via natural language instructions.