AI-Driven Smart Home Architecture

Two pillars power my smart home: an AI DevOps pipeline that builds it, and an AI automation layer the whole family uses every day.

The Two Pillars

Building vs. living in an AI smart home

🤖

AI DevOps

Building & maintaining the smart home

Human

👨‍💻 Daniel a.k.a. The Smart Home Maker

AI Assistant

🤖 Claude Code (Opus)

Task Management

✅ Todoist

📝 Nova Notebook

📨 Email Summaries

Development

💻 n8n Workflows

🏠 HA Automations

📡 ESPHome Configs

🧱 3D Printing / CAD

🏠

AI Smart Home

Used daily by the whole family

Users

👨‍💻 Daniel = Dad (Smart Home Admin)

👩 Mom

👧 Daughter

👦 Son

Input & Triggers

💬 Telegram Chat

🎤 Voice PE

📱 HA App & Dashboards

📡 Sensors & Devices

📧 Email & Services

⏰ Schedules

Processing

🔀 Telegram & Voice Router

🔒 PII Protection

🧠 Smart Home Agent

AI / LLM

☁️ Claude / GPT (Cloud)

💻 Local LLMs

Actions & Use Cases

☀️ Morning Briefing

💡 Lights / Scenes

🌡️ Climate

🎁 Birthday Greetings

☕ Caffeine Tracker

📦 Inventory

🔊 Smart Notifications

📊 Family Dashboard

📷 Cameras

🔊 Noise Monitor

🎧 Content Pipeline

📧 Email Agent

Message Flow

From Telegram chat to smart home action

💬

Telegram

User writes or speaks

🔀

Router

Detects context

🔒

PII Protection

Anonymizes personal data

🧠

AI Agent

Understands & acts

🏠

Home Assistant

Executes action

🔒 PII Protection: Privacy Despite Cloud AI

Personal data never leaves the local network

👤 "Call Lukas"

➔

🔒 Presidio
(local, self-hosted)

➔

👥 "Call [PERSON_1]"

➔

☁️ Cloud LLM

➔

👥 Response with [PERSON_1]

➔

🔓 De-Anonymize
(local, self-hosted)

➔

👤 Response with real name

What Nova Can Do

Examples of AI-powered features in everyday life

☀️

Morning Briefing

Weather, calendar, trash pickup, family stress score via voice

🎁

Birthday Bot

Reminds & drafts WhatsApp greetings with personal context

📦

Inventory

Photo → AI recognition → project assignment → dashboard

📧

Email Agent

Nova answers emails, tracks Amazon orders automatically

🔊

Smart Notifications

Context-aware: noise alerts, doorbell, motion

☕

Caffeine Tracker

Counts coffee cups, warns at WHO limits

📊

Family Dashboard

Stress score, sleep, energy, calendar at a glance

🎧

Content Pipeline

YouTube clips, blog posts, podcast transcripts automated

Tech Stack

Home Assistant

n8n

Claude Code

GPT-4o

Presidio (PII)

Telegram Bot API

ESPHome

Tailscale

Docker

Local Server

Mac Mini

Zigbee / Z-Wave

MQTT

UniFi

Nova Inventory Management

Automated hardware inventory with AI recognition — a deep dive into one of Nova's most powerful features.

Input

📷

Photo Form

Snap a photo, AI identifies the component

📦

Amazon Email

Shipping & delivery confirmations auto-detected

🤖

Telegram / Voice

"Do I have an ESP32?" — inventory lookup

1

AI Recognition

Photo: GPT-4o Vision reads chip markings, component values and specs.
Amazon: LLM extracts product name, ASIN, price and order number.

Detected: ESP32-C3 SuperMini
WiFi Bluetooth 3.3V USB-C

2

Telegram Approval

Nova sends a preview via Telegram. Daniel decides with a single tap.

📦🚚 IN TRANSIT from Amazon

• ESP32-C3 SuperMini (x2)
• DS18B20 Temp Sensor

🔖 305-2764042-0194728

Add to inventory?

✅ Yes

❌ No

🔍 Project Assignment & Storage Location

Each piece can be assigned to a different project. Location → Bin (hierarchical).

🔧 Desk Control Panel

📻 Smart Home Remote

+ New Project

3

Inventory Entry

Item saved with all data: photos, description, specs, project, storage location.

🔥

ESP32-C3 SuperMini

microcontroller Desk Panel x1 Remote x1 • 2x • Office > White Cabinet

4

Status Tracking

Amazon orders tracked automatically: In Transit → Delivered → In Stock. No manual action needed.

📦✅ DELIVERED: ESP32-C3 SuperMini
Status automatically set to "in_stock".

Usage

📋

Dashboard

Searchable, filterable, with photos and full details

💬

Voice Search

"Do I have any ESP32s left?" via Telegram or voice

🔧

Project Mgmt

Track components per project

🎧

Content Pipeline

Projects feed into blog posts, videos, build logs

🏷️

Label Printing

QR codes for bins and items

Explore More

Dive deeper into specific aspects of this AI smart home

Local AI Advisor

Learn which local LLMs work best for smart homes — models, hardware, and setup guide

Smart Home Advisor

Get personalized smart home recommendations — interactive tool powered by AI