My fridge has water hookup but no filter. It makes ice. I have never cleaned it. I put the ice in everything.
At the same time, I get really weird about drinking out of fridges at vrbos as they often have a water Dispenser with a filter and zero indication of when that filter was ever changed (never is a safe bet).