Profiled DDL RAMP

DOI

Collection of profiled models  used to estimate the disrtibuted training time for different Transformer Encoder models partiotioned using Megatron partitioning strategy, for different target losses

Identifier
DOI https://doi.org/10.5522/04/19590799.v1
Related Identifier https://ndownloader.figshare.com/files/34800964
Metadata Access https://api.figshare.com/v2/oai?verb=GetRecord&metadataPrefix=oai_datacite&identifier=oai:figshare.com:article/19590799
Provenance
Creator Ottino, Alessandro
Publisher University College London UCL
Contributor Figshare
Publication Year 2022
Rights https://creativecommons.org/publicdomain/zero/1.0/
OpenAccess true
Contact researchdatarepository(at)ucl.ac.uk
Representation
Language English
Resource Type Dataset
Discipline Construction Engineering and Architecture; Engineering; Engineering Sciences