Eh, I'm not exactly sure about that, simply because we know know that the somebodies of Marluxia, Larxene and Xemnas are all wielders and neither of them seem capable of using their Keyblades. Xigbar seems to be because his was with Xehanort (?), Marly and Larx could be said that it's because they don't remember their true selves, but I see no reason for Xemnas to not pull out No Name (aside from the obvious retcon, that is).
Either way, even if it was a situation where they kept the ability to use a Keyblade and just not remember it (even stretching that Xemnas was truly amnestesiatic during KH2 and was only when he was given a replica body that regained his memories), they sure felt a connection to it considering Marluxia's whole obsession with having a Keyblade.
The most logical conclusion to me is that Roxas was able to use Sora's Keyblade because he had a heart in him, then later on by the time Sora is zZz he already has grown his own heart and doesn't really need to rely on Ven's anymore, until the end of his story when he starts to Dual Wield.