We have studied the relaxation dynamics of a dilute assembly of ferromagnetic particles in suspension. A formalism based on the Smoluchowski equation, describing the evolution of the probability density for the directions of the magnetic moment and of the axis of easy magnetization of the particles, has been developed. We compute the rotational viscosity from a Green-Kubo formula and give an expression for the relaxation time of the particles which comes from the dynamic equations of the correlation functions. Concerning the relaxation time for the particles, our results agree quite well with experiments performed on different samples of ferromagnetic particles for which the magnetic energy, associated with the interaction between the magnetic moments and the external field, or the energy of anisotropy plays a dominant role.