I have a Fel vendor house and it can be a little nerve wracking. Make sure the doors are secured properly. If able, put a teleporter outside so you never have to open the doors where a stealther could sneak in. Also make sure the teleporters' security settings are correct.