It could simply be that there isn’t enough light to charge them in the Winter. We found that our little lights came back by themselves in the Spring. These were older models. We also bought newer lights, which seem to have enough collecting ability to work through the winter, too.
Also, there could be a buildup of grime on the little panels. Try wiping them down with ordinary ammonia.