You are right, but the weakness does not come from the millions of Muslims in the world. They do not mind being radical, they have no fear to speak out and to protest and to jihad.
They are scared that the BBC or CNN may call them radicals, so they remain soft instead. The problem lies there, with the Muslim leaders, not the Muslim masses.