The Lyman-{alpha} line in the ultraviolet (UV) and the [CII] line in the far-infrared (FIR) are widely used tools to identify galaxies in the early Universe and to obtain insights into interstellar medium (ISM) properties in high-redshift galaxies. By combining data obtained with ALMA in band 7 at ~320GHz as part of the ALMA Large Program to INvestigate [CII] at Early Times (ALPINE) with spectroscopic data from DEIMOS at the Keck Observatory, VIMOS and FORS2 at the Very Large Telescope, we assembled a unique sample of 53 main-sequence star-forming galaxies at 4.4