Should I keep the check after depositing?

Yes. Keep the check for at least 45 days before securely destroying it.