Cape May County is the southernmost county in the U.S. state of New Jersey. Much of the county is located on the Cape May peninsula, bound by the Delaware Bay to its west and the Atlantic Ocean to its south and east.