Why does following up matter?
1. It is just the right and decent thing to do.
2. For the candidate, it provides closure and gives them the 'go ahead' to move on to something else.
3. It does not paint you in the best light; consider it bad PR for your company/organization.