Jennifer, I can't believe you can't get rosemary to grow!
Here people literally grow it as a hedge in places. My lavender can be picky - I have one spot where it refuses to grow, but will grow a couple of feet away. Same soil, sun exposure, etc. Haven't worked out yet what the issue is.