This paper provides evidence on the sources of differences in inequalities in educational scores in European Union member states, by decomposing them into their determining factors. Using PISA data from the 2000 and 2006 waves, the paper shows that inequalities emerge in all countries and in both period, but decreased in Germany, whilst they increased in France and Italy. Decomposition shows that educational inequalities do not only reflect background related inequality, but especially schools’ characteristics. The findings allow policy makers to target areas that may make a contribution in reducing educational inequalities.