Karlsberg Castle was surrounded by landscaped gardens and kitchen gardens which were modified and extended in the course of the years. They produced fruits and vegetables for the court table as well as flowers and potted plants for the room decoration.
For banquets, cages with nightingales were hung between flowering trees, and exotic fruits from the castle's heated greenhouses were served to the guests.
The vegetable gardens were later transformed into an English landscape park.
The court gardener was, among other things, responsible for the maintenance of the forestry and the tree nurseries.