Bit of a trek but Cirencester pool is fantastic, has a baby pool which is nice and warm. There are sessions every day.
Tewkesbury Leisure centre the family fun sessions are good and cheap!
Leisure at Cheltenham
Leisure at Cheltenham have a baby splash pool and it’s warm, so not freezing for baby.
Cheltenham leisure has the splash pad and baby pool and it’s always very quiet x