How we test smart home products
Last updated: June 2026
Two research methods, disclosed honestly
Smart Home Assistant is written by one person, so we are upfront about what that means: no single reviewer can plausibly buy and hands-on test every product across every category this site covers — from Zigbee sensors to boilers to soundbars. Rather than claim otherwise, every article discloses which of the two methods below produced its verdict.
Hands-on testing.Used for products that are part of the author's own homelab or have been purchased and set up directly — this is where most Home Assistant, Zigbee, and home-networking coverage comes from. We accept no manufacturer-supplied review units for these, no early-access samples, and no sponsored content, which eliminates the conflict of interest that affects most tech publications.
Desk research.Used for categories outside that personal setup — smart heating and boilers, for instance, sit in a heating engineer's domain, not a software engineer's. These articles are built from manufacturer specifications and datasheets, published lab and efficiency data, official documentation, and cross-referenced expert and owner reviews, rather than a claim of personal testing.
The hands-on test environment
Hands-on testing happens in a real UK home running a production Home Assistant instance on a local server (Intel NUC, 16 GB RAM). The smart home covers over 100 Zigbee devices, Matter, Z-Wave, and Wi-Fi integrations across heating, lighting, security, and audio. UK mains voltage (230 V / 50 Hz) and UK-specific tariff structures (Ofgem unit rates) are used throughout — we never simply translate US reviews.
What we measure, for hands-on tested products
- Setup: Time from unboxing to functional, including app account creation and hub pairing. We use UK Apple ID / Google accounts.
- Reliability: We track failure events — dropped connections, missed automations, unresponsive controls — over at least four weeks of daily use.
- Energy use: Where a smart plug or energy monitor is relevant, we compare measured energy consumption against the manufacturer's stated figures.
- Latency: For lighting and heating, we measure response time from command to action using a stopwatch average over ten presses.
- Home Assistant integration: We test the official HA integration (if one exists), noting whether local-only polling is available or whether cloud dependency is required.
- Privacy: We check whether the app requires an account, what data is transmitted, whether EU/UK GDPR rights are exercisable, and whether local operation is possible.
Research and sources
Factual claims in reviews and guides are verified against primary sources: manufacturer official documentation, Ofgem publications, BEAMA/Salford University acoustic studies, the Connectivity Standards Alliance Matter specification, the Z-Wave Alliance spec, and UK government publications (BEIS, MHCLG). We never cite Reddit, YouTube, or unnamed forum posts as evidence for factual claims.
Every source is linked inline and listed in a Sources section at the bottom of each article. If a link rots, we update it or remove the claim.
Scoring
For hands-on tested products, review scores reflect our direct test observations, using this weighting:
- Reliability (35%): Does it work, consistently, over weeks?
- Setup and usability (25%): Can a non-technical UK household use it?
- Home Assistant integration (20%): Local control, entity quality, stability.
- Value (20%): Price relative to UK alternatives at the time of review.
For desk-research articles, scores and recommendations are built from the cross-referenced sources described above rather than direct test observations, and the article says so.
Scores are not adjusted based on a product's importance to the market or the manufacturer's size. A poorly-made product from a major brand scores poorly.
Affiliates and conflicts of interest
We use Amazon Associates (tag: smarthomeu07b-21) and Awin (publisher 2941111). Affiliate commissions help cover running costs but play no role in which products we review, which products we recommend, or how we score them. See the editorial policy for full details.
AI assistance
AI tools are used to help structure article drafts and surface gaps in coverage. Every sentence is then reviewed, fact-checked, and where necessary rewritten by the author. No article is published without a human expert reading and verifying every claim. We disclose AI involvement in accordance with Google's updated E-E-A-T guidelines.
Questions about methodology?
If you have questions about how we tested a specific product, or if you've spotted a factual error, contact us via the about page.