Millions hit by higher mortgage costs