I wasn't able to produce with my first born, but would still leak. My OB said it was normal and could continue for months to years. However, my breast did not hurt. Therefore I would definitely recommend making an appointment and maybe they will prescribe medication to help dry you up completely.
I breastfed but leaked occasionally months later. Sometimes it was clear. It didn't ache. Also would double check with a doctor. Could you be pregnant?
Mine did this but I was pregnant again 4 months pp (it was ectopic but the fluid leaking was a big hint for me)
I would make an appointment.