The TV presenter was speaking in response to reports claiming that councillors in York want to strip him of the freedom of the city which was awarded to him in 1987.
One councillor went further and said the next logical step is to remove his Duke of York title.
Speaking on Breakfast with Eamonn and Isabel on GB News, Eamonn pointed out that his reputation would remain in tatters as the public see him as “a busted flush” who “isn’t wanted”.
He asked royal expert Rafe Heydel-Mankoo: “How important would that be to the Duke of York and how much of a blow would it be if he were to lose his title?”
Rafe replied: “Well there’s no greater honour than honorary freedom, and in the case of York it’s been held by some powerful figures, Churchill, the Duke of Wellington, they’ve all received this honour.
“So it’s quite understandable that given the events of the past two years it’s undoubtedly the case that he’s bringing the title and the honour and the city into disrepute.
“He got it in 1987, and there’s now also a call, of course, for him to lose his peerage title as Duke of York.
“Whilst it’s very easy to get rid of honorary freedom, getting rid of a peerage title is a lot, lot more difficult.”
Isabel asked if the Queen would make the ultimate decision to remove his title, Raif said: “Actually that’s not the case.
“The Queen and the Government can remove most honours, but a peerage title is a different animal altogether, it requires an act of parliament to remove it, the Queen can’t do it herself.
“The last time that was done was in 1917 during World War One with the titles deprivation act which was an act to remove titles from German princes.”