Usually the people are not home: snow birds in Mexico for 4 months, overseas deployment/jobs, working for weeks on end in the Diamond Mines...
By the time the real owner knows the "new owners" have moved in.
It's double victims: the real owner loses their home... and maybe the "new owner" has sold their old place or let the lease run out, meaning they are homeless too.