We study the taxonomic classification of asteroids observed by Gaia as a continuation of the lightcurve inversion work presented in Paper I (MacLennan et al., 2026A&A...707A.131M, Cat. J/A+A/707/A131). We examine the taxonomic classification of asteroids by using both Gaia Data Release 3 (DR3) photometric and spectroscopic data. Particular focus is placed on Ch-class asteroids, as their potentially hydrated nature makes them promising candidates for sample-return missions and the asteroid mining industry. We utilized the photometric slopes and geometric albedos (via absolute magnitudes) derived from lightcurve inversion, and the Gaia DR3 spectra (from 418nm to 770nm) as classification parameters. We also considered how different parameter sets affect classification accuracies for separate asteroid classes. We classified the asteroids with a combination of linear discriminant analysis and a nearest neighbor classifier. We achieve a classification accuracy of 92% for known S-class asteroids and an accuracy of 85% for Ch-class asteroids with a known set of 328 asteroids. Given the three classification parameters, tentative class designations for 1668 previously unclassified asteroids are provided in the Mahlke taxonomy. We also show that the photometric slope values vary significantly within asteroid classes, with a standard deviation three to four times the mean slope uncertainties. In conclusion, we show that the combination of photometry and spectroscopy can be useful in the taxonomic classification of asteroids observed by Gaia. Further studies of the surface roughness at different scales could help clarify the potential of the photometric slope in classification efforts.