the charisma "discount" is based upon the person initiating the conversation with the shopkeeper.
for example, my party leader is a fighter with low chr. i do not initiate the conversation with him. i will select or highlite a party member with high chr. to talk with the shopkeeper.