Hehe. I found a sentence that shows my whole opinion in a nutshell.
NO LINK HAS EVER SPOKEN.
Remember that skeleton-dude is actually TALKING to Link. OoT-Link never talked, as no Link ever did. So, that's basically the biggest contra.
Also, why should it be some rusty, filthy skeleton that is representing OoT-Link? Why not, like, a soul, spirit, ghost?
I don't know... maybe it's some other dude from an other game that was a close friend/person to Link.