Consumer smartwatches can reliably track total sleep duration, but their ability to measure “quality” remains inconsistent. A Mayo Clinic study found that while newer devices closely match user reports on sleep length, significant discrepancies persist when tracking perceived sleep quality at the highest and lowest ends of the scale.
The pursuit of a “perfect” night’s sleep has shifted from the bedroom to the wrist. However, the gap between a device’s data and a human’s experience remains a critical point of failure in consumer health tech.
Mayo Clinic data on smartwatch accuracy
A study examined the concordance between self-reported sleep and data from three generations of Garmin smartwatches. Researchers from the Mayo Clinic analyzed 841 sleep instances from 130 participants who maintained a seven-day sleep diary while wearing their devices between November 2023 and June 2024.
The findings reveal a clear trajectory of improvement in duration tracking, but a lingering struggle with quality assessment.
| Device Model | Release Year | Mean Difference (Minutes) |
|---|---|---|
| Garmin Vívoactive 4 | 2019 | 21.22 |
| Garmin Venu 2 Plus | 2022 | 11.67 |
| Garmin Venu 3/3S | 2023 | 6.58 |
The disconnect in perceived sleep quality
The most significant friction exists in “sleep quality.” The Mayo Clinic researchers used the Sleep Quality Scale (SQS) to compare how users felt against what the watches recorded. Using equipercentile linking, the study found that smartwatch sleep scores and self-reported quality only aligned when the SQS was between 4 and 7.
The devices struggled most at the extremes. Disagreements between the hardware and the human were observed at the lowest end of the scale (0–4) and the highest end (7–10). This indicates that when a user feels exceptionally poor or exceptionally great, the smartwatch is less likely to reflect that subjective reality in its score.
The current evidence suggests that while a Garmin Venu 3 can tell you with reasonable accuracy that you slept 6 hours and 42 minutes, it cannot definitively tell you if those hours were restorative.
Продолжение темы
