AI in Smart Home: Questions & Answers

AI in smart home means your house doesn't just follow fixed rules (if door open → light on) but recognizes patterns and makes its own decisions. Examples: anomaly detection for energy consumption, automatic image recognition at the doorbell, or a voice assistant that understands natural language. In my setup I use local LLMs (Ollama), n8n workflows, and Home Assistant as the foundation.

Read more

Mein KI gesteuertes Smart Home

To get started: No. Home Assistant has a visual automation editor, and tools like n8n enable AI workflows via drag-and-drop. For advanced setups (custom models, custom components), basic YAML and Python knowledge helps — but isn't required. Most of my tutorials provide copy-paste ready solutions.

Automation follows fixed rules: "At 10 PM, turn off the lights." AI learns and decides: "Nobody seems to be in the living room anymore, should I dim the lights?" The transition is fluid. In practice, you combine both — AI for the decision, automation for the execution.

A basic setup can start at under $100: Raspberry Pi 4/5 for Home Assistant (~$60) + free software. For local AI you need more power: a mini PC with 16GB RAM (~$150) is enough for Ollama + smaller models. My production setup runs on a Hetzner server (~$15/month) for n8n + AI workflows, and a Mac Mini for local tasks.

Ollama is a tool that runs LLMs locally — like Docker for AI models. Installation: curl -fsSL https://ollama.com/install.sh | sh, then ollama pull llama3. After that you have a local API at http://localhost:11434 that you can integrate into n8n or Home Assistant. I use Ollama for package recognition, anomaly analysis, and as a backend for Nova.

Read more

Analysiere deine Kamera-Bilder LOKAL mit KI innerhalb von Home Assistant

Depends on the model: Small models (Phi-3, Gemma 2B): 8GB RAM, any reasonably modern PC. Medium models (Llama 3 8B, Mistral 7B): 16GB RAM, preferably with GPU. Large models (Llama 3 70B): 64GB+ RAM or dedicated GPU with 24GB VRAM. For most smart home tasks, small to medium models are more than sufficient.

Read more

Local AI Berater

Yes, absolutely. With Ollama, models like Llama 3, Mistral, or Phi run locally on your hardware. Home Assistant's own voice assistant (Assist) works completely offline with Whisper (STT) and Piper (TTS). In my setup I additionally use Presidio for PII detection, so sensitive data never leaves the house — not even accidentally.

Read more

Local AI Berater

There's now a wide selection of models that run completely locally: For text processing, Llama 3 (8B), Mistral 7B, or the tiny Phi-3 work great — all installable via Ollama with a single command. For image recognition, LLaVA is the go-to model (understands camera images and can describe them), complemented by Frigate with Google Coral TPU for real-time object detection. For voice, you use Whisper/faster-whisper (speech → text) and Piper (text → speech) — both run as Home Assistant add-ons. Hardware requirements start at 4GB RAM for small models and 16GB for medium ones. You can find a complete overview with comparison table in my AI Models Guide.

Read more

KI Modelle Guide

Honestly: Not quite yet. Speech recognition (Whisper) is excellent. But natural language understanding is still more limited than Alexa/Google — you need to be more precise. Development is rapid though: with a local LLM as Conversation Agent it gets much better. For smart home commands ("living room light to 50%") it already works reliably.

Home Assistant has a built-in Assist Pipeline: Speech → Text (Whisper/faster-whisper), text processing (Conversation Agent), Text → Speech (Piper). Everything runs locally. You need a microphone device like the ESP32-S3 BOX or a self-built ESPHome device with I2S microphone. In my setup I additionally use a Wyoming Satellite on the Voice PE.

n8n is an open-source workflow automation platform with a visual interface. Compared to Node-RED, n8n has native AI nodes (OpenAI, Ollama, LangChain), better error handling flows, and a clearer structure for complex workflows. I run 30+ n8n workflows for everything from Telegram bot routing to package tracking to content pipeline. n8n runs on my Hetzner VPS connected to my local network via Tailscale.

Read more

Automation im Quadrat – n8n verleiht dem Smart Home Superkräfte

Practically all that need context: Presence detection (BLE tracking + pattern learning instead of just motion sensors), Energy optimization (recognize consumption patterns, report anomalies), Security (camera image recognition: person vs. cat vs. delivery), Comfort (light scenes based on time of day + activity).

Read more

10 Ideen für generative KI im Smart Home

My bot "Nova" consists of: 1) Telegram Bot API (via BotFather), 2) n8n as workflow engine, 3) a router workflow that classifies messages (photo → image recognition, text → intent detection, voice → STT), 4) sub-workflows for specific tasks (inventory, shopping list, smart home control). The router uses an LLM to detect intent and route to the correct sub-workflow.

For beginners: Intel N100 Mini-PC (e.g., Beelink EQ12, ~$150) with 16GB RAM — enough for Ollama with small models. For advanced users: Mac Mini M2/M4 — the Neural Engine is excellent for AI inference. For heavy workloads: NVIDIA Jetson Orin Nano or a PC with RTX 3060/4060 (12GB VRAM).

Directly on ESP32: only very simple tasks (e.g., wake word detection with microWakeWord in ESPHome). For real AI, you use the ESP32 as a sensor/actuator and let processing happen on the server. Example: ESP32 captures camera image → sends to Home Assistant → HA sends to Ollama/Frigate for recognition. The ESP32-S3 does have enough power for edge AI like acoustic drone detection though.

With local assistants (Home Assistant Assist): Wake word is detected on the ESP32 itself (microWakeWord) — data is only transmitted once the keyword is recognized. And even then only to your own server. With cloud assistants (Alexa, Google): Technically yes, but officially only recorded after the wake word. The difference: with the local solution you can verify it yourself — with cloud solutions you have to trust the provider.

Read more

Du hast das Gefühl von Big Tech ausspioniert zu werden? Ersetze Alexa mit einem lokalen (keine Cloud) Sprachassistenten (Teil I Prototyp)

Three pillars: 1) Local first — Ollama, Whisper, Piper run on your hardware, no cloud needed. 2) PII scrubbing — I use Microsoft Presidio to automatically remove personal data (names, addresses, phone numbers) before they go to external APIs. 3) Network segmentation — IoT devices run in their own VLAN without internet access. This way a compromised smart home device can't send data outside.