You must spread some Reputation around before giving it to carayan again.