How quickly after being sore should your go back to physical activity?

I did some intense yoga on Sunday and my body won’t let me forget it – I don’t want to lose the momentum but I also don’t want to permanently hurt something. Is there a protocol for this sort of thing?