But whoever has doubts is condemned if he eats, because the eating is not from faith. For whatever does not proceed from faith is sin.
Romans 14:23 ESV

Just as you shouldn't push your perceived liberties onto someone who disagrees, don't be so weak in your convictions that you will allow someone to pressure you into doing something that you believe is a sin.

If someone in your fellowship invites you to go to a Chinese restaurant where you know there is a Buddhist shrine and pagan religious iconography, and you don't believe that a disciple of Yeshua should eat at such places, don't be afraid to decline and to give an explanation.