Introducing the Series
Fine-tuning LLM: The Art of AI Tuning is a course that helps you deeply understand and practice fine-tuning — the technique of fine-tuning large language models for your own domain, task, or brand voice.
🎯 Core questions this course answers:
- When is fine-tuning needed? When to use RAG? When to combine the two?
- How much does Fine-tune cost? How is the ROI?
- How to evaluate fine-tuned models scientifically?
- How to deploy production effectively?
What will you learn?
Part 1: Overview & Strategy
- Lesson 1: What is Fine-tuning? Decision framework: Prompt Engineering → RAG → Fine-tuning
- Lesson 2: Fine-tuning vs RAG — the biggest debate, a practical decision checklist
- Lesson 3: Fine-tuning costs — detailed price list, ROI calculator, budget planning
Part 2: Data Preparation
- Lesson 4: Collect & design dataset: JSONL format, synthetic data, quality vs quantity
- Lesson 5: Data cleaning & augmentation: pipeline cleaning, tokenization, split strategies
Part 3: Fine-tuning on Google Gemini / Vertex AI
- Lesson 6: Vertex AI setup: project, IAM, billing, pricing breakdown
- Lesson 7: Fine-tune Gemini Flash step-by-step: upload data → train → deploy → test
- Lesson 8: Advanced: distillation, hyperparameter optimization, multi-task tuning
Part 4: Fine-tuning on OpenAI & Open-source
- Lesson 9: Fine-tune OpenAI GPT-4o-mini: API workflow, comparison with Gemini
- Lesson 10: LoRA & QLoRA: fine-tune open-source models on Google Colab for free
Part 5: Model Evaluation — Methods & Metrics
- Lesson 11: Metrics: Perplexity, BLEU, ROUGE, BERTScore — when to use what
- Lesson 12: LLM-as-a-Judge & Human Evaluation — multidimensional evaluation
- Lesson 13: Evaluation Pipeline: golden test sets, CI/CD, A/B testing, red teaming
Part 6: Production & Best Practices
- Lesson 14: Deployment: Vertex AI endpoints, vLLM, multi-adapter serving
- Lesson 15: Common pitfalls: catastrophic forgetting, overfitting, troubleshooting
- Lesson 16: Capstone: fine-tune end-to-end for real use cases
Special features of the course
| Topics | Content |
|---|---|
| 🔥 Google Gemini Focus | 3 separate articles for Vertex AI — the most powerful platform 2025–2026 |
| 💰 Actual costs | Price list, ROI calculator, cost optimization — not just theory |
| 📊 Scientific Evaluation | 3 articles on evaluation — BLEU, ROUGE, LLM-as-Judge, Human Eval |
| 🤔 Fine-tune vs RAG | Full decision framework, case studies, hybrid approach |
| 🔧 Multi-platform | Google Gemini + OpenAI + LoRA/QLoRA open-source |
| 🚀 Production-ready | Deployment, monitoring, A/B testing, drift detection |
Input required
- Intermediate Python (async/await, file I/O, JSON handling)
- Basic understanding of LLM (knows prompt engineering, API calls)
- Google Cloud account (free trial $300 credit enough for the whole course)
- OpenAI account (for lesson 9)
- Google Colab (for lesson 10 — free)
Tools used
Python 3.11+ | Ngôn ngữ chính
Google Cloud / Vertex AI | Fine-tune Gemini models
OpenAI API | Fine-tune GPT-4o-mini
Hugging Face | Transformers, PEFT, datasets
Unsloth / Axolotl | Optimized LoRA training
Weights & Biases | Experiment tracking
Google Colab | Free GPU cho hands-on
BERTScore / ROUGE | Evaluation metrics
LangSmith | LLM-as-a-Judge pipeline
Compare 3 AI series
| AI & LLM Series | Build AI Agents | Fine-tuning LLM | |
|---|---|---|---|
| Focus | LLM Theory | Build Agent | Refine Model |
| Object | Newbie | Know basic LLM | Know basic LLM |
| Output | Understanding LLM | Portfolio Agents | Custom AI Models |
| Technology | PyTorch, Transformers | LangGraph, CrewAI | Vertex AI, LoRA |
| Difficulty level | ⭐⭐ | ⭐⭐⭐ | ⭐⭐⭐ |