A major challenge in first-principles high-throughput materials simulations is automating the selection of parameters used by simulation codes in a way that robustly ensures numerical precision and computational efficiency. Here, we propose a rigorous methodology to assess the quality of self-consistent DFT calculations with respect to smearing and k-point sampling across a wide range of crystalline materials. To achieve this, we develop criteria to reliably control average errors in total energies, forces, and other properties as a function of the desired computational efficiency, while consistently suppressing uncontrollable k-point sampling errors. Our results provide automated protocols for selecting optimized parameters based on different precision and efficiency tradeoffs. This archive contains all data related to the material structures and calculation workflows developed in this work.