Training a language model from nothing takes enormous data and enormous computing power. Almost nobody does it.<\/p>\n
What most people do is start from a model somebody else trained, and adjust it.<\/strong><\/p>\n The base model already knows language, grammar, reasoning and a great deal of general information. Fine-tuning teaches it your subject and your output format<\/strong> \u2014 using a fraction of the data and a fraction of the cost.<\/p>\n Two things, and the second is often more valuable than the first.<\/p>\n Knowledge.<\/strong> The model becomes more reliable on your subject \u2014 the terminology, the standards, the specifics.<\/p>\n Behaviour.<\/strong> It learns to answer in the shape you need. Not a paragraph of prose, but a verdict, a citation, an explanation and a list of recommendations \u2014 every time, in the same structure.<\/p>\n That second one is underrated.<\/strong> A general model can be prompted into a format. A fine-tuned one produces it consistently, without a long instruction on every call.<\/p>\n FIGURE 1: WHAT FINE-TUNING GIVES YOU<\/p>\n Knowledge<\/p>\n Behaviour<\/p>\n AboutKnowledge fine-tuned two models on quality management and ISO compliance<\/strong>, both published openly on Hugging Face.<\/p>\n The first<\/strong> is built for questions and drafting \u2014 quality management systems, ISO standards, auditing, CAPA, Six Sigma, Lean, FMEA, SPC and related topics.<\/p>\n The second<\/strong> is built for analysis. Given a statement about how an organisation operates, it returns a compliance verdict<\/strong>, the relevant clause<\/strong>, an explanation<\/strong>, and recommendations<\/strong>.<\/p>\n Two models, two jobs.<\/strong> One answers questions. One produces structured judgements. That split is a design decision, not an accident, and it is covered in more detail in the case studies in this series.<\/p>\n A fair question, and sometimes prompting is the right answer.<\/p>\n Where fine-tuning wins:<\/strong><\/p>\n Consistency.<\/strong> A fine-tuned model produces the same structure every time. A prompted one drifts, especially on unusual input.<\/p>\n Cost per call.<\/strong> A long system prompt is sent every single time. Fine-tuning bakes that in.<\/p>\n Size.<\/strong> A fine-tuned small model can outperform a much larger general one on its specific task<\/strong> \u2014 which means it can run on modest hardware.<\/p>\n Privacy.<\/strong> A small fine-tuned model runs locally. Your data never leaves your infrastructure.<\/p>\n Where prompting wins:<\/strong><\/p>\n Breadth.<\/strong> A large general model handles anything. A fine-tuned small one is good at its subject and unremarkable outside it.<\/p>\n Speed to start.<\/strong> Prompting takes minutes. Fine-tuning takes a dataset and a training run.<\/p>\n Change.<\/strong> Adjusting a prompt is instant. Retraining is not.<\/p>\n FIGURE 2: FINE-TUNE OR PROMPT?<\/p>\n Fine-tune when<\/p>\n Prompt when<\/p>\n Three things.<\/p>\n A base model.<\/strong> Open models such as Llama, Mistral or Qwen are the usual starting point. They come in sizes \u2014 1B, 3B, 7B and up \u2014 and the number is roughly how much the model can hold.<\/p>\n Training data.<\/strong> Examples of the input and the output you want. Thousands, not dozens.<\/strong> Where this comes from is a subject in itself, and one of the articles in this series.<\/p>\n Compute.<\/strong> A GPU, for hours rather than months. Techniques like LoRA reduce this substantially<\/strong> \u2014 enough that fine-tuning a small model is within reach of a single machine rather than a data centre.<\/p>\n Bigger is not automatically better for a narrow task.<\/strong><\/p>\n A 1B model fine-tuned on quality management can answer quality management questions better than a general model many times its size \u2014 because all of its capacity is pointed at one subject.<\/p>\n And it runs on a laptop.<\/strong><\/p>\n The trade-off:<\/strong> the small model is worse at everything else. Ask it about anything outside its training and the answer is unremarkable.<\/p>\n Which is fine, if you only ever ask it about its subject.<\/strong><\/p>\n FIGURE 3: WHY A SMALL FINE-TUNED MODEL CAN WIN<\/p>\n All capacity on one subject<\/p>\n Runs locally<\/p>\n Consistent output<\/p>\n Cheap per call<\/p>\n It does not make the model correct.<\/strong> A fine-tuned model can still be confidently wrong, particularly on cases unlike anything in its training.<\/p>\n It does not remove the need for review.<\/strong> For anything with consequences \u2014 compliance, regulation, money \u2014 a person checks.<\/p>\n It does not stay current.<\/strong> The model knows what it was trained on. New standards, new rules, new products mean retraining.<\/p>\n Both of AboutKnowledge’s published models say this in their own documentation<\/strong> \u2014 useful for drafting and triage, not a replacement for human auditors or regulatory review. That is the right position, and it is worth looking for in any model you consider using.<\/p>\n A narrow, repeated task.<\/strong> The same kind of question, many times.<\/p>\n A need for consistent structured output.<\/strong> Something a downstream system will parse.<\/p>\n A privacy requirement.<\/strong> The data cannot go to a third-party API.<\/p>\n Enough volume<\/strong> that per-call API costs add up.<\/p>\n Not worth it<\/strong> for one-off tasks, broad general questions, or anything where requirements are still changing week to week.<\/p>\n Fine-tuning takes a model that already understands language and teaches it your subject and your output format<\/strong>.<\/p>\n The format part is often the bigger win<\/strong> \u2014 consistent structure, without a long prompt every time.<\/p>\n A small fine-tuned model can beat a large general one on its own subject<\/strong>, and run locally on modest hardware.<\/p>\n It does not make the model correct, and it does not remove the person who checks.<\/p>\n A repeated task where a general model is not consistent enough?<\/p>\n Get in touch. We build and fine-tune models for narrow business tasks \u2014 including ones that run entirely on your own infrastructure.<\/p>\n<\/div>","protected":false},"excerpt":{"rendered":" Starting from something that already works Training a language model from nothing takes enormous data and enormous computing power. Almost nobody does it. What most people do is start from a model somebody else trained, and adjust it. The base model already knows language, grammar, reasoning and a great deal of general information. Fine-tuning teaches […]<\/p>\n","protected":false},"author":3,"featured_media":9432,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[26],"tags":[],"class_list":["post-9431","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai"],"yoast_head":"\nWhat fine-tuning actually changes<\/h2>\n
\n
\n
A real example<\/h2>\n
Why not just prompt a big model?<\/h2>\n
\n
\n
What you need<\/h2>\n
The size question<\/h2>\n
\n
\n
\n
\n
What it does not fix<\/h2>\n
When it is worth it<\/h2>\n
The short version<\/h2>\n