I just don't see a reason to even have the armor penalty anymore since there's no armor bonus for using heavier armors now, especially since they changed it so warriors need tons of mana now also.
Also though, an interesting thing about the plate sam armor you may not know, even though it's "mage armor" that doesn't count as a mod for reforging, you can reforge exceptional samurai plate. What's interesting about it is it's the cheapest, easiest way to get 150 luck or 10 lmc on each piece (dull copper hammers make "clean" items far more often, are cheaper and more common, and have more uses than spined runics) Yeah you lose some max power on the suit which does suck but still, it is a very cheap way to build a simple high luck suit or lmc suit.