No, you can only destroy the weapons and buildings blocks of the castles, like walls, roofs, bridges, treasure chest and throne room. You cannot destroy the characters, animals and decoration items. The characters disapear once their weapon is destroyed.