Your memory is correct. The Boardwalk originally had four Mediterranean style pavilions located at West 35th St, West 29th, West 24th, and West 12th Streets.The pavilions at the West End were popular gathering places on summer evenings. Residents of the Hebrew Home for the Aged, located in the old Half Moon Hotel, would sing songs and tell stories in the pavilion at West 29th Street. The pavilions suffered arson fires and were demolished in the 1970s. Here are photographs of the pavilions in the 1920s and shortly before demolition.