The other thing about that, though, is that it's like he asked Touyi when he got his memories back: "How many years has it been since then??"

Hell, at current, non-flashback time, it's been at least nine years since he woke up, so the lady's a good ten years his senior at bare minimum. For all we know, his original body was cooling its heels at the Asia Branch for 30 years before Kanda ever woke up. Even if he finds her, she could be a granny by now. @_@