Remove Button background on watchOS

Is there a way to remove the button styling from a Button on watchOS? I can use tapAction to turn regular text and images into buttons, but I'd like to keep the highlight animation.