"I mean, hello guys – if he was gay, he could be gay!" she said on the podcast.
"He didn't have to hide in the closet anymore, and he'd be dating Brad Pitt, or whatever. Not that Brad's gay, but you know what I'm saying! It's so silly, and then people perpetuate silly things and it's boring."
While Deb was frustrated by what the rumours have insinuated about their marriage itself, Hugh has revealed in the past that he's not upset about being called gay.
"Some dudes do get upset, some dudes say, 'Don’t say I’m gay' [but] I am good," the actor said of the misconception, which he said he believes comes down to his former role in The Boy From Oz.
Deb, 66, and Hugh, 53, tied the knot in 1996 after meeting on the set of the Aussie TV series Correlli. Together they adopted two children, Oscar and Ava.
"Being married to you Deb is as natural as breathing," wrote on their anniversary in 2021.
"From nearly the moment we met... I knew our destiny was to be together. In our 25 years - our love has only grown deeper. The fun, excitement and adventure more exhilarating; the learning even greater.
"I’m forever grateful to share our love, our life - and, our family together. We’ve only just begun. Deb, I love you with all my heart!"