The structural saturation and stability, the energy gap, and the density of states of a series of small, silicon-based clusters have been studied by means of the PM3 and some ab initio (HF/6-31G* and 6-311++G**, CIS/6-31G* and MP2/6-31G*) calculations. It is shown that in order to maintain a stable nanometric and tetrahedral silicon crystallite and remove the gap states, the saturation atom or species such as H, F, Cl, OH, O, or N is necessary, and that both the cluster size and the surface species affect the energetic distribution of the density of states. This research suggests that the visible luminescence in the silicon-based nanostructured material essentially arises from the nanometric and crystalline silicon domains but is affected and protected by the surface species, and we have thus linked most of the proposed mechanisms of luminescence for the porous silicon, e.g., the quantum confinement effect due to the cluster size and the effect of Si-based surface complexes.