Can you use a rain cover to protect against the wind??

I live by the sea and it's usually always windy (usually a cold wind too!) My newborn hates his pram but today we had to use the rain cover as we got caught out. I noticed once the cover was on he settled for the first time and very quickly! Is it safe enough to use against the wind as long as it's not a hot day? I'm thinking this might be our key to getting out for a daily walk without him crying non stop.