Why are AI models smart even when they are small? How Distillation, Quantization, MoE, and LoRA work

In our previous article, "Why has AI become so smart?", we wrote about the mechanisms that make AI smart, but this time we ...