Should a button stay pushed if the user drags their mouse away?

On some UIs, I can press and hold a button and move the mouse away and it stays pushed down.

On other UIs, buttons pop back up when I hold and drag out.

Which is the most user-friendly behavior?