Shiba Park is located around Tokyo Tower and Zojoji Temple in the Roppongi area of the city. The park is actually divided into a various separate areas. The park has a number of lawns which are popular at lunchtimes with young mothers and children. There are exercise machines that draw salarymen out of their offices for work-outs, and joggers run the perimeter. The park is located between the Minato municipal offices and Tokyo Tower. Many of the footpaths in the park offer excellent views of Tokyo Tower, so the park is a popular spot for dates and appears in many television and film sequences. The Central Labor Relations Commission is located here.

Shiba Tōshō-gū, once part of Zojoji Temple, is known for an ancient gingko tree near the entrance, which is listed as a National Treasure. A giant ginkgo tree, designated Natural Monument and believed to have been planted there by Iemitsu Tokugawa, can be found in the grounds of the shrine.

Shiba Palace Garden (Shiba Onshi-koen), the grounds of the former Shiba Detached Palace, has become the property of the Municipality and is open to the public. The Arisugawa gardens were purchased by the Imperial Household Agency in 1875. The land has since been donated for public use and enjoyment.

Shiba Park is Japan's oldest public park, being the first to be officially designated as a park in 1873, only five years after the beginning of Japan's modernization. Parts of the present day park were once the Edo-period Okubo clan garden. It originally encompassed the adjacent Zojoji Temple, but with the separation of church and state after the Second World War, the temple was detached from it.

The park is home to the ancient Maruyama burial mound (kofun), one of the biggest in Tokyo at 110 meters (361 feet) long. It is actually very indistinct: a simple mound covered with trees, indistinguishable from the natural terrain. Nothing is known of its history.

Shiba Park also has an artificial ravine, Momiji-dani ('autumn leaf valley') restored in 1984. As the name suggests, it is a sight to see in autumn. It features a massive Japanese zelkova tree, 20 meters (66 feet) tall with a trunk circumference of 2.5 meters (8 1/4 feet).

Scottish merchant Thomas Glover (1838-1911), known for his associations with Nagasaki, had a residence in Shiba Park and he died here in 1911.

A tree that United States President Ulysses S. Grant planted at the park is still growing there today.