GPT4All

GPT4All is a desktop application that runs open language models locally on Windows, macOS and Linux, without sending data to the cloud. You download a model, chat with it, and can point it at folders of documents to ask questions.

It works on ordinary CPUs, so even laptops without a strong graphics card can run smaller models. The app is free and open source.

It is a gentle first step into local AI for people who want privacy and no subscription.