Modern-day LLMs are "fiction machines," designed not to be truthful but to make sense. What can we expect from these machines, and what are their limitations?

This hands-on PoC shows how I got an open-source model running locally in Visual Studio Code, where the setup worked, where it broke down, and what to watch out for if you want to apply a local model ...