Would planetary orbits affect your time travel destination?

Let’s say hypothetically we could time travel. Let’s also assume that we have just discovered how and it is in the baby stages in terms of how it can be used and applied.

So lets say one wanted to go to some random date where Earth is on the complete opposite side of the sun as it is now in the present. So you do the whole time travel thing—wouldn’t one end up floating uselessly in space, though in another time, while their destination is on the other side of the solar system?

Maybe I’m thinking too deep into this but I can’t think of a reason why you’d still be on Earth just because you went into a different time.