I found the problems. There were some floating floor tiles under the roof, and the pillars I used apparrently don't work for holding up floors. Beyond that when I finally committed it, it was really ugly and I've scrapped the whole thing and started over again.
edit: Correction, scrapped the whole thing, had some ice cream, and started over again...