Learn/Core Concept What is tool calling in LLMs? Tool calling lets large language models execute external functions during conversation, like fetching data or running calculations. Instead of just generating text, the model identifies when it needs external capabilities and formats structured requests for specific tools. It's everywhere because it transforms chatbots into functional assistants that can actually do things. However, as discussed in today's local tool calling thread, many devs find local implementations unreliable compared to cloud services. Function-callingStructured-output |