Long gamma-ray bursts (GRBs) are produced during the dramatic deaths of massive stars with very short lifetimes, meaning that they explode close to the birth place of their progenitors. Over a short period they become the most luminous objects observable in the Universe, being perfect beacons to study high-redshift star-forming regions. We aim to use the afterglow of GRB161023A at a redshift z=2.710 as a background source to study the environment of the explosion and the intervening systems along its line of sight. For the first time, we complement ultraviolet (UV), optical and near-infrared (NIR) spectroscopy with millimetre spectroscopy using the Atacama Large Millimeter Array (ALMA), which allows us to probe the molecular content of the host galaxy. The X-shooter spectrum shows a plethora of absorption features including fine-structure and metastable transitions of Fe, Ni, Si, C, and O. We present photometry ranging from 43s to over 500 days after the burst