Should I add a floating, fixed feedback button on the pages of my website?

I would like to add a Feedback feature to my website. Should I add it as a floating,fixed button on the side? Is that considered something users are annoyed by? If I shouldn't, which method is recommended for requesting feedback?