I recently rewatched the old TVB's Return of the Condor Heroes 1983. The one with Andy Lau. I haven't read the novel.
Was it ever explained in the novel why Yang Guo/Yeung Gor didn't just return the baby? I could be wrong but it seems there were many opportunities to do so. And their decision to adopt the baby in the end doesn't make much sense.