Eh, who cares! Do what you want. I think there are many more fashion disasters (don't even get me started on those... mom jeans, tennis shoes with business wear) than wearing white after labor day.
As Marilyn Monroe said, "It's better to be absolutely ridiculous than absolutely boring."
ETA: It looks great! Love the tights (I think that's what they are.. they're kind of dark to tell in the picture).