Why can’t you reduce a selection from the beginning after selecting everything in a text input field?

I've noticed that when you select all (using ctrl+a, or some other method) you can only reduce the selection from the end. ie: by holding shift and pressing left you can reduce the selection from the end, but it does not work from the beginning (pressing right)

From a UX standpoint, wouldn't it be better if it worked both ways?