Datasets to reproduce all plots in the paper. Each spreadsheet (xls file) contains the horizontal and vertical data of every subfigure. The experimental data is collected using the low-temperature confocal microscope. The fluorescence of Nitrogen-Vacancy centers in phosphorus-doped diamond is detected under orange and resonant (red) laser excitation. The custom-made Python software controls the hardware and collects the data.