Turning right onto a busy street with a yiled sign... I get very nervous, what should I do?

Okay, so there is this street I turn right on to every day to get home and it has a yield sign. I know that means to watch for oncoming traffic, but the lane that turns right onto the street is where some cars merge onto when they come forward. I get a bit panicky and I sometimes stop completely, and don’t turn, especially since if I do, I have to go through about 3 lanes of traffic to get into the left most lane so I can get on the highway. I wait till the light is green and I quickly jut across all lanes onto the left lane, and I feel safe not having to merge into traffic and change lanes 3 times, but then I worry that I am upsetting cars behind me by not going.

Is there some advice I can get on how to relieve anxiety about this? It’s really troublesome and I think of it often. Maybe some advice on how I can better handle the situation, what should I think of, what should I do, etc. Thanks in advance!