It's specific to the person who is delivering the order.I am not clear yet - and can't test it - but does difficulty scale only to the individual taking the quest, or to the party the individual is in when they take the quest? If party, that would help a lot since it would let a fair few people fight some tougher things in a Governor-led trade quest....