Ba2CuTeO6 is a newly discovered S=1/2 spin ladder system containing Cu2+ ladders. Our experiments indicate that this material is in very close proximity to the quantum critical point of the coupled two-leg spin ladder system. Ba2CuTeO6 displays ideal ladder behaviour in magnetic susceptibility down to approximately T = 25 K. Below 25 K the behaviour deviates from that of a ladder and a cusp is seen at 16 K indicating magnetic ordering. However, NMR, specific heat and powder neutron diffraction experiments have not detected any long-range ordering at this temperature, suggesting the order is marginal. We propose to search in more detail for signs of long-range magnetic order and also investigate the magnetic correlations in Ba2CuTeO6 using WISH.