In 1565 he was acquired from the King by Don Ruy Gomez de Silva, then awarded the title of Duke of Pastrana, where he was also lord. Ruy Gómez de Silva and his wife, the princess of Eboli made changes in the fortress to be able to inhabit it. In 1572 this tycoon founded a mayorazgo in which he included the town of Zorita and his castle. He passed to his son Don Rodrigo de Silva and Mendoza, and then to his descendants the Dukes of Pastrana, until in 1732, the Dukes of the Infantado, to whom the Pastranera house had corresponded in succession, sold this enclave to Don Juan Antonio Pérez de la Torre, predecessor of the counts of San Rafael. The title, already only honorary, of Commander of Zorita, continued to exist until the 19th century.