I completely agree with you because language is personal... both to the character and the author. If I use dialect or colloquialisms or a particular spelling rule, it's because I want to and I'm the author. And I don't even notice British spelling. So, you do what you want. Well, unless you start having Xander say "bloody" or "arse" or "bonnet" because that would be a little odd.