Potential legibility issues with using a unique font for each character in a game

I have a game where players talk with characters with dialogue boxes. I would like each character to have their own font to add personality to the characters and dialogue. Will this create a legibility issue I'm not aware of? Do users have to reorient their reading each time they encounter a new font, or will this be fine as long as the fonts themselves are legible. Are there any other considerations for attempting something like this? Thanks in advance.