Witchmark by CL Polk (first book is men, books 2 & 3 are sapphic) The Lady’s Guide to Celestial Mechanics by Olivia Waite
For magic-y stuff and LGBT+, I recommend the Witcher series. If you don't mind YA, I also recommend the Iron Fey series by Julie Kagawa. It's faeries and magic. It's a cozy series for me, but I also might have a different definition of cozy 😅 Otherwise, following for recs 👀
Sooo got you girl! A game of hearts and heists By Ruby Roe
Legends and lattes is a good cozy book with a LGBT lead that is a fantasy
Tipping the velvet is Victorian era lesbians. City of girls is 1940s NYC lesbians (might be off on the exact time period, bit it's definitely not modern day)
The seven husbands of Evelyn Hugo!!