The long wing facing Markvej is the oldest part of Anchers Hus. A building on the site can be traced back to 1801, but the original house was destroyed in a fire in 1829. The eastern (right) part of the building was the first to be rebuild and the western (left) part was added in stages during the 19th century. The first artist to occupy the house was the poet and painter Holger Drachmann. His father-in-law rented the house for the summer in 1882. The following year, 1883, the Swedish painters Oscar Björck and Johan Krouthén and the Norwegian painters Christian Krohg and Charles Lundh rented the house, which then became known as The Painters' House. Only in 1884, the house was bought by the Ancher family, when Michael Ancher signed the property deed on February 18.