When you have a side panel open, and the user scrolls, is it better to leave it open or to auto close the panel?

Say you have a side menu that opens from one side after clicking on an icon in a website. This menu would take more than 40% of the view-port in the horizontal direction.

If the user scrolls down, is it better to let the user click on the close button, or to hide/close the menu automatically?