From the time of his wife's death until he went searching for his missing daughter Wong Yung in LOCH, East Heretic Wong Yerk See likely did not leave his home on Peach Blossom Island. He left the island on several more occassions during LOCH (to search for Wong Yung when she went missing again, to fight the Cheun Jen 7 Disciples at Misty Rain Pavilion, and to participate in the Second Mt. Hua Sword Tournament). He returned there for some of the period between LOCH and ROCH, but left because he couldn't stand sharing the island with Gwok Jing's teacher Ohr Jen Ngok.
Did Wong Yerk See ever return to Peach Blossom Island after that? He wandered all over the world during ROCH, but I don't know if during any of that time (a good quarter century at least) did he even once go home.