Does it damage my teeth if I brush wipe them occasionally with a bath towel?

Including brushing with a tooth brush , and flossing once a day with mouth wash? Or is it a clever innovative way to keep my teeth clean? I asked my dental hygienist and he didn’t know. It seems to work for me. I would like to ask the collective.