What is a large language model used for?#
LLMs address this by enabling computers to perform complex language-based tasks at scale. This allows a business to automate the creation of marketing copy, summarise long reports, provide instant and detailed answers to customer questions, or even assist in writing software code, freeing up employee time for more strategic work.
How does a large language model work?#
A large language model is trained by analysing enormous amounts of text data from the internet, books, and other sources. During this training, it learns the incredibly complex statistical relationships between words—identifying patterns, grammar, context, facts, and even styles of reasoning. Most of what it learns is the underlying structure of language rather than the source text itself, but the two are not exclusive: models do memorise some of what they are trained on, most often passages that appear many times or are unusual enough to stand out, and researchers have shown that such passages can sometimes be extracted verbatim. That is why training data raises copyright and privacy questions that "it only learns patterns" does not answer.
When you give an LLM a prompt (a question or an instruction), it uses its learned patterns to calculate the most probable sequence of words to form a response. It generates the answer one word at a time, with each new word being the most likely one to follow the last, given the context of both the original prompt and the sentence it is building.
How is an LLM different from a scripted chatbot?#
A large language model generates novel, contextually relevant text based on the vast patterns it has learned. This is different from older chatbots which typically relied on pre-programmed scripts and keywords, limiting them to a narrow range of predictable conversations. It is also more advanced than simple text autocomplete, which might suggest the next word or two; an LLM can generate entire documents, hold a detailed conversation, and create sophisticated original content from a simple request.