How to deal with abuse?

Hello, am 26 and i have been bullied for my whole life from ,,friends” they have bullied me verbally and physically , i was always very skinny person, very shy and sensitive, all of my friend are physically stronger than me and they always used their strength against me, i remember when i was 8–9 years old, i went to my grandpa for help after they bullied me, and he said that i was acting like a weak and it was last time i asked for help, i remember when, 2 of my friend was holding me while other beating his leg in my stomach,(we were 14–15) and they laughed about it, they knew i could not do anything, my childhood was like this always and i thought it was normal and it was my fate and fault , because i was weak. as a time past i started to learn my self how to avoid this kind of things, but i couldnt do anything. they were my neighbours and i grew up with them, our parents are friends also but they dont know about it. i cant get rid of them, one of them is extremely rude to me, our relationship is horrible after i staretd to speak up and tell him that he was behaving very bad , he got even worse, he started to hate me and since then we didnt had normal conversation , only cursing eachother, 2–3 month ago i moved in another city and havent met him , yesterday i came back to my hometown and met him , he was standing with other guys (my neighbours) i staret to walk towards them to meet, before i was there, he started to shout , look who is there and said very disrespectful words , i was speechles , i didnt expected from him to do like this, i stoped thinking and said nothing to him, but after some time it hit me very hard, i am still worried about it, hes acting like , he leaves me no choice but to punch him and i am afraid of it :( i dont know why but i am, i want to abuse him like he does to me but i am not good at it and he is, hes doing it whole life, i dont know , what to do anymore. ( yes i tried to talk to him very friendly way and agreed on some things but , hes doing it again and always tried to disrespect me in public)