Some alternative medicines enjoy widespread use, and in certain situations are preferred over conventional, validated treatments in spite of the fact that they fail to prove effective when tested scientifically. We propose that the causal illusion, a basic cognitive bias, underlies the belief in the effectiveness of bogus treatments. Therefore, the variables that modulate the former might affect the latter. For example, it is well known that the illusion is boosted when a potential cause occurs with high probability. In this study, we examined the effect of this variable in a fictitious medical scenario. First, we showed that people used a fictitious medicine (i.e., a potential cause of remission) more often when they thought it caused no side effects. Second, the more often they used the medicine, the more likely they were to develop an illusory belief in its effectiveness, despite the fact that it was actually useless. This behavior may be parallel to actual pseudomedicine usage; that because a treatment is thought to be harmless, it is used with high frequency, hence the overestimation of its effectiveness in treating diseases with a high rate of spontaneous relief. This study helps shed light on the motivations spurring the widespread preference of pseudomedicines over scientific medicines. This is a valuable first step toward the development of scientifically validated strategies to counteract the impact of pseudomedicine on society.