I agree that it is not just the extremists who harbor bad thoughts or engage in bad acts but they are usually the source of the polarization and try to keep education and communication of the main stream from moving forward.

Extremists think 'communication' means agreeing with them.