You can manage your Bill Pay alerts through your Bill Pay settings: