A pitch has been making the rounds online: buy a cheap mini PC, install a local AI model on it, walk into a small business, and charge a flat fee for an agent that "never touches the internet." It's an appealing story — low cost, high margin, no ongoing dependency. It's also a story that falls apart the moment you check it against how small businesses actually buy technology.
The underlying idea isn't wrong. There is a real, durable business in installing offline AI for small businesses. But it only works for a narrow slice of them, the hardware math doesn't support a bargain-bin machine, and the pricing has to reflect real labor, not a one-time plug-and-go install. Here's what the numbers actually say.
Offline only matters when compliance forces it
Most small businesses have no reason to run AI locally. A retail shop, a restaurant, a salon — their data isn't sensitive enough to justify the cost or complexity of an on-premise system when a free cloud tool does the job.
The businesses that do need it are the ones legally restricted from sending client data to a cloud model: medical and dental practices bound by HIPAA, law firms bound by attorney-client privilege, and accounting or tax firms handling financial records. For these businesses, "your data never leaves this building" isn't a nice-to-have — it's what makes AI usable at all without creating regulatory exposure. That constraint is also the moat: a free consumer AI tool is legally off the table for them in a way it isn't for a coffee shop, so there's no cheaper substitute pulling the deal away from you.
The product that sells into this narrow window is offline document Q&A — an assistant that answers questions using a firm's own files (intake forms, contract templates, prior filings, policy manuals) without any of it leaving the premises. Not a general chatbot. Not automation. A private assistant for a firm's own documents.
Subscribe to CLUB to read the rest.
Become a paying subscriber of CLUB to get access to this post and other subscriber-only content.
UpgradeA subscription gets you:
- Everything included in Premium.
- Early access to new tools and the specialized AI and product-market fit newsletter.
- One-on-one feedback on your business, with actionable guidance on strategy, positioning, and growth
- Masterclasses with Pablo Fernandez Alvarez
