I don't know if it's something to worry about or not. You can give it a spray of super fine summer oil which is antifungal to keep it from spreading. I use a product called "Organocide" which is basically sesame oil. It works great for all sorts of maladies, fungal and insect issues. I've killed spider mites, scale, and nipped powdery mildew in the bud with it. Just spray it early in the day or late afternoon.
I've never used it but yes, it will work too. Here's something about neem I just learned- that the plant will take it up systemically when used as a soil drench. Apparently that would be more useful for sucking and chewing insects rather than fungus or mildew, but I thought it was interesting.