At Palazzo Pitti, the builders had it much easier, since their source [of stone] (the Boboli hill) was right behind the palace. In fact, Palazzo Pitti sits on the hollowed out part of one of these quarries.

http://www.theflorentine.net/art-culture/2006/09/quarries-near-florence/