To me, Rosemary is a hands-down must-have.
Then again, here in Phoenix, it's used as shrubbery. You can't walk down a street without seeing houses this way and that using it as decorative shrubbery, hedge, etc..
My parents have 4 pretty good-sized bushes of the stuff in their yard as decoration, but when I'm there I frequently will pick a bunch to cook with.
..and I plan on planting out at LEAST 3 plants of the stuff in my new house.