The nearby fortress of Zdislavice was documented in 1349. The castle was rebuilt as a Baroque palace in the late 17th century. Later a possession of the Czech baronial Dubsky of Trebomyslice family, it was the birthplace of the famous Austrian writer Marie von Ebner-Eschenbach on 13 September 1830. She spent her childhood and youth here, before she left Zdislavice in 1848 to live with her husband at Louka near Znojmo. After her death in 1916, she was buried in the Dubsky family tomb in the castle park.
After World War II, the furnishings of Zdislavice Castle were auctioned and its library was destroyed. Today the building stands empty.