I'm not a mortgage broker, but I believe there are lots of things that would impact the rate, not just downpayment amount. I think your credit score, if it's a vacation home, loan size, etc. I think if you put less than 20% down, you would fall into a different category of loan products which probably have slightly higher rates as well.