Well I kinda figured they would want to keep Haven on the down-low. Having beautiful architectural masterpieces would kinda be like placing a massive bullseye on the town. Bunch of peasants in posh stone buildings... oh gee, I wonder if this is their hideout? XD