Is All Time filter in a dashboard necessary?

I know putting an ALL TIME filter allows me to view all the data from the start to the present. But how really is important to me to allow viewing all of it and how it cant affect my server?