Set the status of the Annotation Layer from DEFAULT to OFF. The DEFAULT setting turns the layer on permanently.