Due to recent advances in experimental and theoretical approaches, the dynamic three-dimensional organization (3D) of the nucleus has become a very active area of research in life sciences. We now understand that the linear genome is folded in ways that may modulate how genes are expressed during the basic functioning of cells. Importantly, it is now possible to build 3D models of how the genome folds within the nucleus and changes over time (4D). Because genome folding influences its function, this opens exciting new possibilities to broaden our understanding of the mechanisms that determine cell fate. However, the rapid evolution of methods and the increasing complexity of data can result in ambiguity and reproducibility challenges, which may hamper the progress of this field. Here, we describe such challenges ahead and provide guidelines to think about strategies for shared standardized validation of experimental 4D nucleome data sets and models.