After some digging, it seems that if you log out in a house that a character does not own with possession of the scroll, you can experience access issues. To avoid this issue, only log out in taverns, inns, or houses that the specific holder of the scroll has ownership of. Sorry for the inconvenience and thanks to those who helped get to the bottom of the issue. Those who are having issues with existing scrolls should contact a GM. Enjoy!