Quick Answer: Hard water won’t damage a tankless water heater instantly, but it’s the single biggest cause of scale-related warranty claims and efficiency loss. The dividing line manufacturers actually enforce is 200 mg/L, about 12 grains per gallon (Rinnai and Navien’s published spec) — below that, a $75–$200 scale-inhibitor filter is enough; above roughly 15 gpg, a full water softener ($800–$2,500 installed) starts paying for itself through the 34–47% efficiency savings the Battelle/WQRF lab study measured. Per USGS data, about 85% of U.S. homes have some degree of hard water, so this is worth checking rather than assuming.
Hard water is the quiet failure mode in this category. Nobody’s tankless heater stops working the week their water tests hard — it keeps running for years while scale slowly coats the heat exchanger, until a flush stops fixing the flow-rate complaint or a warranty claim gets denied in writing. This guide answers the question that actually matters before you buy either product: how hard is too hard, and does that call for a cheap inline filter or a real softener system.
Where the actual line is
The U.S. Geological Survey classifies water hardness on a standard scale: soft is 0–60 mg/L, moderately hard is 61–120 mg/L, hard is 121–180 mg/L, and very hard is anything above 180 mg/L, all measured as calcium carbonate equivalent. That’s a general water-quality classification, not a heater-specific one.
Manufacturers draw their own, stricter line. Rinnai and Navien both cap total hardness at 200 mg/L — about 12 grains per gallon (gpg) — in their published water-quality specs, and Navien’s installation manual says plainly that above that number, “it is important to install a scale reducer.” That 200 mg/L figure is the same ceiling Rinnai sets for well water; see our tankless water heater for well water guide if sediment and iron are also in play, not just hardness.
About 85% of U.S. homes receive some degree of hard water, according to USGS measurements, and industry surveys put roughly 60% above the 7-gpg “hard” threshold. Most people have never had their water tested — a $10 titration test kit or your utility’s Consumer Confidence Report (most municipal suppliers publish one annually) tells you your actual number in minutes.
What scale actually costs you
This isn’t a cosmetic issue. In the Battelle Memorial Institute study conducted for the Water Quality Research Foundation, gas tankless units run continuously on 26-grain water “completely failed to function because of scale plugging in the downstream plumbing after only 1.6 years” of equivalent use. Below outright failure, the same study quantified the efficiency drag: every 5 grains per gallon of hardness costs about 4% in efficiency and operating cost at 50 gallons of daily hot water use, doubling to 8% at 100 gallons a day. Softening the water recovered real money — 34% savings over 20-grain water and 47% over 30-grain, in the study’s measurements.
Filter vs. softener: the actual decision
| Scale-inhibitor filter | Water softener | |
|---|---|---|
| How it works | Sequesters minerals (Siliphos/polyphosphate) so they don't bond to the heat exchanger | Ion-exchange actually removes calcium/magnesium before the heater sees it |
| Best hardness range | Below ~12–15 gpg | Above ~15 gpg, or whole-house hard-water symptoms (spotting, soap scum, dry skin) |
| Install | Inline housing at the heater's cold inlet | Whole-house, needs a drain line and electrical outlet |
| Ongoing cost | Cartridge swap or media refill every 1–3 years | Salt refills, roughly $5–10/month |
| Upfront cost | $75–$200 | $800–$2,500 installed |
| Still need annual descale? | Yes | Yes, but scale forms far slower |
1. Scale-Inhibitor Filter — Best Under 12–15 Grains Per Gallon
Siliphos / Polyphosphate Scale-Inhibitor Filter (iSpring WSP-50SL or equivalent)
- The right call for most municipal-water homes testing under roughly 12–15 gpg — cheap, no plumbing beyond the filter housing itself, and no electrical or drain requirement.
- Doesn't remove hardness minerals, it coats them so they pass through the heat exchanger without bonding — which is why the annual flush is still required regardless.
- See our best tankless water heater filter picks for the full comparison of sediment and scale-inhibitor combo units by brand.
Get your filter and fittings in two days — try Amazon Prime free for 30 days.
2. Whole-House Water Softener — Best Above ~15 Grains Per Gallon
Fleck 5600SXT-Based Water Softener
- Removes hardness minerals outright rather than sequestering them — the only option that meaningfully slows scale formation in genuinely hard-water homes, per the Battelle/WQRF efficiency data above.
- Pays for itself fastest in homes above roughly 15 gpg with high daily hot-water use (100+ gallons/day), where the study measured the largest efficiency gap.
- Same Fleck 5600SXT control valve this site already recommends for well-water hardness treatment — see the tankless water heater for well water guide if iron and sediment are also present, not just hardness.
How to choose
- You haven’t tested your water: start there — a home titration kit or your utility’s Consumer Confidence Report gives you the gpg number everything else depends on.
- Under 12 gpg: you’re inside Rinnai and Navien’s spec as published; a scale-inhibitor filter is optional insurance, not a requirement.
- 12–15 gpg: install a scale-inhibitor filter and keep the annual descale on schedule — see our tankless water heater maintenance guide for the full checklist.
- Above 15 gpg, or high daily hot-water use: a full water softener is the option the lab data actually supports financially, not just the more thorough-sounding one.
- On a private well: hardness usually isn’t your only problem — see our tankless water heater for well water guide for the sediment and iron stages a softener alone won’t handle.
- Either way: neither a filter nor a softener replaces the annual flush — see our descaling guide and best flush kit picks.
The bottom line
Hard water is the leading cause of scale-related warranty denials on tankless water heaters, and the fix scales with the problem: below roughly 12–15 grains per gallon, a $75–$200 scale-inhibitor filter is enough; above that, a full water softener’s $800–$2,500 installed cost is backed by real numbers — the Battelle/WQRF study measured 34–47% efficiency savings from softened water. Test your water first, match the fix to the number, and keep the annual descale on schedule regardless of which one you install.