The South Carolina congresswoman criticized hundreds of callers as distractions from federal issues after skipping a town hall event.