You wouldn't need to download additional data, you would be loading prefabs from the client so you should see an improvement.By all means, please don't.
Those rooms are already really bad at 250 ms ping, specially Belfry (Belfry and his push mechanics SUCK at 250 ms ping). If you add MORE data to download, it will be nigh unplayable.