There is nothing wrong with Fragrances when choosing soap as technically everything on this planet is made from a group of chemicals, even Essential oils so it's more a personal choice.
Some people have allergic reactions to Essential oils just as much as fragrance oils. Some oils can make you become photo sensitive in the sun ( Some Citrus Essential oils) so should be avoided when the sun is hot !
Dont be afraid to discover what you like! Mix and match your smells, Go for a fragrance in the morning and an Essential oil at night to calm your nerves!
"what ever makes you happy!"
What do you prefer and why!?