How we test smart home products

Two research methods, disclosed honestly

Smart Home Assistant is written by one person, so we are upfront about what that means: no single reviewer can plausibly buy and hands-on test every product across every category this site covers — from Zigbee sensors to boilers to soundbars. Rather than claim otherwise, every article discloses which of the two methods below produced its verdict.

Hands-on testing.Used for products that are part of the author's own homelab, have been purchased and set up directly, or were supplied by the manufacturer for review — this is where most Home Assistant, Zigbee, and home-networking coverage comes from. A manufacturer-supplied unit never guarantees coverage, a positive review, or a specific score, and we accept no payment or sponsored content — see our policy for manufacturers for the full terms.

Desk research.This is how most product reviews on the site are built — a single reviewer cannot plausibly buy and hands-on test every Sonos speaker, security camera, or boiler on the market. These verdicts are compiled from manufacturer specifications and datasheets, published lab and efficiency data, official documentation, and other independent reviewers' published testing and owner data — cross-referenced against each other, not a claim of personal testing. Every desk-research review carries a visible notice saying so, and does not display the "UK-tested in real homes" badge.

The hands-on test environment

Hands-on testing happens in a real UK home running a production Home Assistant instance on a local server (Intel NUC, 16 GB RAM). The smart home covers over 100 Zigbee devices, Matter, Z-Wave, and Wi-Fi integrations across heating, lighting, security, and audio. UK mains voltage (230 V / 50 Hz) and UK-specific tariff structures (Ofgem unit rates) are used throughout — we never simply translate US reviews.

What we measure, for hands-on tested products

• Setup: Time from unboxing to functional, including app account creation and hub pairing. We use UK Apple ID / Google accounts.
• Reliability: We track failure events — dropped connections, missed automations, unresponsive controls — over at least four weeks of daily use.
• Energy use: Where a smart plug or energy monitor is relevant, we compare measured energy consumption against the manufacturer's stated figures.
• Latency: For lighting and heating, we measure response time from command to action using a stopwatch average over ten presses.
• Home Assistant integration: We test the official HA integration (if one exists), noting whether local-only polling is available or whether cloud dependency is required.
• Privacy: We check whether the app requires an account, what data is transmitted, whether EU/UK GDPR rights are exercisable, and whether local operation is possible.

Research and sources

Factual claims in reviews and guides are verified against primary sources: manufacturer official documentation, Ofgem publications, BEAMA/Salford University acoustic studies, the Connectivity Standards Alliance Matter specification, the Z-Wave Alliance spec, and UK government publications (BEIS, MHCLG). We never cite Reddit, YouTube, or unnamed forum posts as evidence for factual claims.

Every source is linked inline and listed in a Sources section at the bottom of each article. If a link rots, we update it or remove the claim.

Scoring

For hands-on tested products, review scores reflect our direct test observations, using this weighting:

• Reliability (35%): Does it work, consistently, over weeks?
• Setup and usability (25%): Can a non-technical UK household use it?
• Home Assistant integration (20%): Local control, entity quality, stability.
• Value (20%): Price relative to UK alternatives at the time of review.

For desk-research articles, scores and recommendations are built from the cross-referenced sources described above rather than direct test observations, and the article says so.

Scores are not adjusted based on a product's importance to the market or the manufacturer's size. A poorly-made product from a major brand scores poorly.

Affiliates and conflicts of interest

We use Amazon Associates (tag: smarthomeu07b-21) and Awin (publisher 2941111). Affiliate commissions help cover running costs but play no role in which products we review, which products we recommend, or how we score them. See the editorial policy for full details.

AI assistance

AI tools are used to help structure article drafts and surface gaps in coverage. Every sentence is then reviewed, fact-checked, and where necessary rewritten by the author. No article is published without a human expert reading and verifying every claim. We disclose AI involvement in accordance with Google's updated E-E-A-T guidelines.

Questions about methodology?

If you have questions about how we tested a specific product, or if you've spotted a factual error, contact us via the about page.