Would time travel ever work or would the ramifications of the butterfly effect be too devestating?

I’m not talking about the actual capability of traveling in time, rather the consequences of even the slightest venture by someone into another time. Every minuscule event that transpired would significantly alter the course of history would it not? (Ok, I just watched Back to the Future again and it got my intellectual juices flowing)