The Lady Fitzroy Memorial was erected to commemorate the place where Lady Fitzroy and the Governor’s Aide, Lieutenant Charles Masters, were killed when their carriage, driven by Governor Fitzroy, overturned and hit a tree within the Park in 1847. The accident marked the beginning of the decline of the area as a Government Domain.