I usually try to pick-pocket Gaelan, as well, but I have to confess it never occured to me to charm him first.
I generally have everyone go invisible but if the first attempt doesn't net the key, oh well...
He is, after all, in league with a pretty vile group; but I do feel a bit guilty when he calls me a traitor.