Tag

#fine-tuning

12 articles

Someone Fine-Tuned OpenBMB’s MiniCPM5-1B on Claude Fable 5 Traces to Ship a 657MB Local Thinking Model

Learn how fine-tuning allows developers to create small, local AI models that can think and reason like larger systems, all while running on your own device.

Jul 1913

Fine-Tuning Qwen3 with LoRA Using NVIDIA NeMo AutoModel: A Complete Single-GPU Google Colab Workflow Tutorial

This article explains how to fine-tune the Qwen3 language model using Low-Rank Adaptation (LoRA) and NVIDIA NeMo AutoModel in a single-GPU Google Colab environment, focusing on parameter-efficient training techniques and automated workflows.

Jul 1818

I had Gemini and Claude write my email replies - but only one sounds like me

This article explains how language model fine-tuning and personalization work in AI systems, using the comparison between Gemini and Claude's email reply generation as a practical example.

Jul 123

Building Supervised Fine-Tuning Data from NVIDIA Open-SWE-Traces: Trajectory Parsing, Patch Analysis, Token Budgets, and Tool-Use Metrics

Learn how to load, process, and filter the NVIDIA Open-SWE-Traces dataset for supervised fine-tuning of AI models in software engineering tasks.

Jun 2626

DeepSeek lines up its first outside money: a $7bn round at up to $59bn

Learn how to fine-tune a pre-trained language model using Hugging Face's Transformers library, a technique used by AI companies like DeepSeek.

Jun 265

How to Fine-Tune LFM2 Using QLoRA and DPO: A Complete Step-by-Step Coding Tutorial on Google Colab

Learn how fine-tuning with QLoRA and DPO can make language models smarter and more useful, even on limited hardware.

Jun 235

Adaption aims big with AutoScientist, an AI tool that helps models train themselves

Learn how to use AutoScientist, an AI tool that automates model fine-tuning for beginners. This tutorial walks you through setting up the environment, preparing data, and running automated training sessions.

May 1358

tools

smol-audio: A Colab-Friendly Notebook Collection for Fine-Tuning Whisper, Parakeet, Voxtral, Granite Speech, and Audio Flamingo 3

smol-audio is a Colab-friendly notebook collection that simplifies fine-tuning of leading audio AI models like Whisper, Parakeet, and Voxtral.

Apr 2863

The LoRA Assumption That Breaks in Production

LoRA, a widely used technique for fine-tuning large language models, assumes all updates are similar — a premise that fails in real-world production environments. This limitation is now prompting a reevaluation of its effectiveness in complex, diverse applications.

Apr 2668

This AI Paper Introduces TinyLoRA, A 13-Parameter Fine-Tuning Method That Reaches 91.8 Percent GSM8K on Qwen2.5-7B

Researchers from Meta, Cornell, and CMU introduce TinyLoRA, a 13-parameter fine-tuning method that achieves 91.8% accuracy on GSM8K using Qwen2.5-7B.

Mar 2487

Unsloth AI Releases Unsloth Studio: A Local No-Code Interface For High-Performance LLM Fine-Tuning With 70% Less VRAM Usage

Learn how to use Unsloth Studio, a no-code interface for fine-tuning Large Language Models locally with 70% less VRAM usage.

Mar 17131

tools

How to Build a Stable and Efficient QLoRA Fine-Tuning Pipeline Using Unsloth for Large Language Models

A new tutorial demonstrates how to build a stable and efficient QLoRA fine-tuning pipeline using Unsloth, addressing common Colab issues and enabling resource-efficient LLM training.

Mar 3169