Would the phrase "Right you are" have been used by all classes of British society during the early 1930's?

I’ve been reading a series set in 1930s London and Kent and the author persists in having the characters say the phrase “Right you are” instead of plain “yes”, or other variants of the word “yes”. I’m in the sixth book and it seems odd to me that the Lord and Lady will say the same thing as the tweeny maid, the cabbie, the private investigator, the DCS from Scotland Yard. Is this really a phrase that everyone would say?