Perennial herbs are a good choice and you'll get a lot of variety.
Bay
Bergamot
Chamomile
Chives
Fennel
Horseradish
Horsetail
Juniper
Lemon Balm
Lovage
Pot Marjoram
Mint
Rosemary
Sage
Savory
Sorrel
Sweet Cicely
Tarragon
Thyme
Valerian
Verbena
This is not exhaustive and I'm sure other people will add different herbs.
You might like to add some herbs you use frequently - such as parsley, basil, oregano, dill and savory - these are anuuals or biennials but would make for a fuller herb garden.