Leaving dust in the hole will reduce the holding power of the wall anchors and screws you ... clean up any large mortar or ...