Mittagong residents want a new monument to commemorate the work locals have put into the swimming pool and gardens during the past 70 years.
Local historians and Friends of the Mittagong were outraged when Wingecarribee Shire Council knocked down a facade in front of the pool, which was built during the Great Depression.
But Berrima District Historical Society president Leonie Knapman said it was time to move on and look at what could replace the wall to keep the memories of those who had given to the pool and the community over the years.
"Everyone's been venting their anger, but let's raise some money and do something, and get council to put in too," she said.
Mrs Knapman said the garden in front of the pool was already a memorial because the ashes of her parents, former pool managers, were scattered there nearly 30 years ago.
"Dad built the rockery out there to make people smile when they came into the pool," she said.
"When he died he asked me to sprinkle his ashes around the garden bed because it was the happiest time of his life.
"It's hard to say in a few words what they put into that place."
Mrs Knapman said she had scattered her mother's ashes around the fern garden she had helped create in the centre of Boswell Park.
"I was reluctant to talk about this, but if this knowledge, along with all the unhappy people means something will be built to honour not just my Mum and Dad but all those who made the pool what it is, then it's worthwhile," she said.
Mrs Knapman said she would like to see the pool returned to its former glory, when as many people could be found picnicking in the grounds as swimming in the pool. She suggested the fountain in the centre of the park be rebuilt as a lasting tribute to many hours of time volunteered by the community.
Mittagong resident Tim McCartney said he would like to see sandstone gates built with a large plaque to remind pool-goers of the facade which used to stand at the entrance.
Mayor Phil Yeo said council would consider all the suggestions it received in writing.