Also known as The Keep, the Little Castle was built between 1612 and 1921 for Sir Charles Cavendish. The architects were probably Robert and John Smythson. Further ranges were added between 1627 and 1642.
The castle ceased being used as a dwelling in the late 19th century and it was given to the nation in 1945. It is now in the care of English Heritage.
Historic England Archive CC77/00129