The fifth child of Robert and Mary Lee, Agnes kept a diary in the 1850s documenting life at Arlington. It was later published. Growing Up in the 1850s: The Journal of Agnes Lee is still in print. Agnes was in love with a cousin, Orton Williams. It is believed that he proposed marriage to Agnes during the war but she turned him down. He was caught by Union troops while behind Union lines and executed as a spy. After the war Agnes moved to Lexington, VA with her parents. She died of cholera in 1873 at the age of 32.