Is it fair to call Muslims Terrorists Enablers if they don't speak up?

Terorists murder innocents on purpose. That is different than "collateral damage". Very different. Regardless of Noam Chomasky;s opinion. My question (to Muslims and nonbelievers alike) is: Are "peaceful" Muslims under a moral obligation to stop the terrorists to the best of their ability or at the very least to speak out forcefully against them? If they simply retreat into silence, are they not in collusion with the murderers?