Public impatience over stalled domestic reforms is mixing with fallout from U.S. tariffs to chip away at his summer highs.