Usability testing old and new design at the same time?

One of our designers has redesigned a page of ours using insights from another piece of research we did months ago.

I want to test old design and new design at the same time to evaluate if the changes are indeed better?

Is it a good idea to set x3 tasks for both prototype to evaluate which is easer to use for participants via success rates and ratings along?