Don't you have chivalry? You can travel with the Sacred Journey spell ( and yes, Sampires do cast a few spells). In fact Sacred Journey has minimum skill requirement of 15, meaning humans without chivalry can cast the spell, although it will take a few tries. You just need someone else to mark the runes for you. I use my stealth/mage to mark runes anywhere my sampire wants to go.
By the way, being non-medable armor does not mean you can't cast while wearing it. It just means mana regen will be slower and anyone with the meditation skill cannot actively use the skill.
The bloodwood armor is a good starting suit of armor. I would start looking for better armor when you can afford it that also adds lots of str/dex/int or HP/Stamina and even mana regen, and jewelry that adds those plus HCI/DCI and damage bonus. My base suit adds about 40 points to dex/str.