Wiedman, long considered a leading candidate to succeed CEO Larry Fink, is leaving the firm after two decades of service.