Being part of a product team and a design team at the same time

I joined a new company as a product designer a few months ago now. I'm part of a product team but I'm also part of a design team, and I'm finding some struggles in navigating between those two worlds that have completely different cultures. The main struggle I face at the moment is managing the feedback loop and the expectations. On one side I have the product team that is mainly focused on delivery on the other side there is the design team that has the goal of pushing quality and the user experience further.

Because I report in some manner to two different managers, I feel pulled in two different directions, and getting to a design that can make everyone "happy" seems to be difficult, if I focus just on delivery I disappoint the design team if I focus on designing the "north star" design I disappoint the design team because I feel like I'm being a bottleneck. I feel like it should be a balance between those two, and maybe designing the delivery and the vision at the same time. Do you have some advice for me?