One factor is how long you expect to live. Being busy, enjoying work, and not needing it, I put it off until almost 70.
Late wife though took hers at 62 and croaked at 72 after drawing for about 10 years. In each of these two examples, I think the decision was best.
Another factor to consider, if you are still working, is contributions to an HSA. It’s great to be able to do that, but if you ring the Socialist Security bell, the gov’t will no doubt cram you with Medicare Part A. After all it doesn’t cost you, right? WRONG! It negates your ability to continue loading your HSA, and rotso ruck trying to get them to walk it back.