We present what is, to our knowledge, the first experimental demonstration of dielectric constant measurement and quantification of supported lipid bilayers in electrolyte solutions with nanoscale spatial resolution. The dielectric constant was quantitatively reconstructed with finite element calculations by combining thickness information and local polarization forces which were measured using an electrostatic force microscope adapted to work in a liquid environment. Measurements of submicrometric dipalmitoylphosphatidylcholine lipid bilayer patches gave dielectric constants of εr ∼ 3, which are higher than the values typically reported for the hydrophobic part of lipid membranes (εr ∼ 2) and suggest a large contribution of the polar headgroup region to the dielectric response of the lipid bilayer. This work opens apparently new possibilities in the study of biomembrane electrostatics and other bioelectric phenomena.