The 3rd Marquess lived at Dumfries House following a fire at Mount Stuart in 1877. He made susbstantial changes to the House, including hiring Glasgwegian architect Robert Weir Schultz to design and build an extension onto the House without interfering with the Adam palladian facade.