Welcome to Newport, RI! This is actually Goat Island, which is part of the city of Newport but feels a little removed. It's only a 15-minute walk from downtown so it's a wonderful place to stay — or get married!
By the way, there are actually goats on the island! Gurney's Newport — which you'll learn more about soon — has two cuties (Cornelius and William) that live in a replica of Marble House, one of the town's most famous historic mansions. The goat were named after William Vanderbilt, who owned Marble House, and Cornelius Vanderbilt, who built the Breakers. I visited them, and they're pretty damn adorable.