In Ce-based heavy fermion materials, there is competition between the interactions which lead to a magnetically ordered arrangement of the Ce magnetic moments, and the hybridization between the local moments and conduction electrons, which quenches the local moments. Sometimes the magnetic transition can be tuned to zero temperature at a quantum critical point (QCP), where unusual properties arise due to quantum fluctuations. CeRh6Ge4 orders magnetically at a low temperature of 2.5 K and the system can be readily tuned to a QCP, but CeRh6Ge4 has also been reported to be a ferromagnet, making a QCP highly unusual. Therefore we propose to use low temperature neutron diffraction to determine the magnetic structure, in particular to see whether the system is purely ferromagnetic, or if there is a more complex arrangement of spins, allowing for the quantum criticality to be characterized.