It doesn't matter what others think, this is a VERY personal decision. You should go with what makes you more comfortable and fits your personality. As I have aged I lean to pay it off and not having to worry about debts or payments, BUT again it doesn't matter what i think, it is what you think and what lets you sleep well at night.
Rationale is not as important as peace of mind.
jmho