Darley, the son of an English comic actor, began his career as an illustrator in his native Philadelphia. From 1848 to 1859, he worked in New York, earning renowned for his illustrations of the books of Washington Irving and James Fenimore Cooper. From 1859 until his death Darley resided in Clayton (near Dover) Delaware.