Near the base of the Gloriette is a huge heroic fountain. A walkway allows visitors to go behind it and this makes an excellent place to see the palace and the nearby gardens.
The Gloriette itself is these days an elegant café, but there are walkways in front, above, and on either side, all of which afford good views of the Palace and the city beyond. (Yes, that's Stefansdom on the horizon.)