"They came to have a look and then they left," he told the Daily Mail.
"I didn't turn them down. I've got no idea where that came from, things take a life of their own."
Pierre later said that his wife Bev didn't think she was giving a formal interview with the Vancouver Sun when she spoke to one of their journalists, and her casual comments have since been misinterpreted.
Pierre has stated that after Bev's comments began circulating around the globe, along with the story that the couple turned down the royal couple from eating in their restaurant, they have been inundated with hate mail, furious phone calls and trolling on social media from angry fans.
"We've been getting hundreds of emails, tens of phone calls. Nothing but s--t, saying what terrible people we are," he said.
"And we didn't even meet the people or see them. It just took a life of its own. It f--king pissed me off."
Meanwhile, the Duke and Duchess of Sussex are yet to comment on the debacle as they have reportedly been enjoying some much needed "private family time" in Canada over their six-week break from royal duties.