Can the phrase ”once you try white, you know it is right”, be used without it being taken as racist?

I was out hanging with my Italian Brother and a shapely woman in a mini dress was strolling by. I teased him not to be gawking, that he knew the Old Italian motto (from the MOB movies we like to watch), that Italians don’t ”burn coal”, (have intimate relations with African American women). He teased back saying, “You know what they say, ‘once you try white, you know that it is right’”, as a counter to ”Once you try Black you never go back”. I know a lot of people heard the latter and think nothing racial about it, but would they think the same of the phrase my Italian Brother used being it implies a Black woman would give up Black men if she had sex with a white guy? Do you think it would be seen as racist? If you think it is racist would you think that ”once you try Black you never go back” would be equally as racist?