I viewed the line from Leia as more of a force impression than an infant's memory... Kind of the force at work in Leia. In that tone, I rather enjoy the thought. I still would've found it interesting if Padme had survived and gone into hiding as well, but passed away from something between trilogies.
Yoda fighting, I really hoped for a force showdown... Not the sabers. I felt like using the force to beat your opponent was A) Not used well at all in the Prequals, and B) established pretty nicely in ANH as the "gentleman's way", of sorts. Kenobi preferred it... Vader wasn't going to let him go that route, and then the whole thing about him becoming more powerful once struck down and all, but I felt like Kenobi established that use of the force showed one's TRUE power, and that was carried throughout the OT then...
Flash forward to the Prequals and there's these force stalemates that then require decisions be made with lightsabers. Meh. That's for the weak. Yoda/Dooku having Yoda hand Dooku his ass just by force beating him up would've been great. Then YOda being fought to a Force Stalemate with Palpatine... Have the saber reveal there. Have Yoda's basic character itself be broken by Palpatine because Palps leaves Yoda no other choice than to get brutal. Don't make it so hokey, just have it become almost something he uses to escape a situation he's pretty sure he's about to lose even. Yoda's exile to Dagobah is sort of in some kind of "shame" if you will.