This paper presents a finite element solver for the simulation of steady non-Newtonian flow problems, using a regularized Bingham model, with adaptive mesh refinement capabilities. The solver is based on a stabilized formulation derived from the variational multiscale framework. This choice allows the introduction of an a posteriori error indicator based on the small scale part of the solution, which is used to drive a mesh refinement procedure based on element subdivision. This approach applied to the solution of a series of benchmark examples, which allow us to validate the formulation and assess its capabilities to model 2D and 3D non-Newtonian flows.