How to sort order names with special characters on lists?

I'm working on a project that contains contacts (First name, Last name), and currently we're using ascending/descending to allow users to re-order the list, however, I'm facing a problem with treating special characters, since they are represented first in the ordering. Should I present them at the last? should I keep them first? What is the most advised experience here?