My success with broccoli and cauliflower is about 50%, romanesco... 0.0%.
I have 100% success with kohlrabi (almost no place for bugs to hide within it), but the taste is not inspiring.
I hope you can put your cauliflower in a sunnier location. Five hours of sunlight, along with using row covers, doesn't sound like the best combination.