Brainy folks were also present in Lyndon Johnson's administration especially in the Pentagon where Secretary of Defense Robert McNamara's brilliant 'whiz kids' tried to micro-manage the Vietnam war with disastrous results.
Arbitrary power is like most other things which are very hard very liable to be broken.