As someone whose research focuses on optimization, I'm generally in the pro camp, but I'll concede that it can be overdone. One of my favorite quotes is of rather fuzzy provenance. I've seen variations of it from multiple authors, phrased as a monologue by, variously, a Zen master, a playboy or a dying man (but not, so far, a dying playboy Zen master). The version I recall:
I had my chances to marry, but I was looking for the perfect woman. Then one day I found her; but she was looking for the perfect man.Optimization is fine for some things, inappropriate for others, and (like everything else in life) not a good idea if taken to an extreme.*
* I'm rather proud of myself that I resisted the nearly-inevitable "extreme point" pun there.