Goro was probably reacting to the situation. He and you were in a strange house with strange people to him. He will shy away because he is uncertain. As for your friends "picking on him", Goro may have just wanted to be left alone. One question, did Goro run to you when he felt threatened by your friends or for the door in attempt to get away to find familar surrounding?