What do you say when you don't want to be in an official relationship?

There’s this guy that I like , and he likes me back , but I don’t want to be in an official relationship where we tell everyone that we’re going out . But then he told me he wants to officially ask me out . I do want to be with him , just not make it public . How should I tell him this ?