Code for Caption Crowd (IKILeUS)

Dataset

DOI

CaptionCrowd is an interactive platform developed within the IKILeUS project at the University of Stuttgart to improve video caption accuracy for the Deaf and Hard of Hearing (DHH) community. While automatic captions provide some accessibility, they often contain errors in grammar, homophones, and domain-specific terminology, making comprehension challenging. CaptionCrowd enables users to collaboratively identify and correct inaccurate captions in real-time, improving their quality through community-driven feedback. The platform features a user-friendly web-based video player that allows users to highlight incorrect words in subtitles, with their selections recorded for further analysis. User testing with 16 participants revealed that manually correcting captions can be cognitively demanding, highlighting the ongoing need for enhanced accessibility solutions.

Identifier
DOI	https://doi.org/10.18419/DARUS-4775
Metadata Access	https://darus.uni-stuttgart.de/oai?verb=GetRecord&metadataPrefix=oai_datacite&identifier=doi:10.18419/DARUS-4775

Provenance
Creator	Fathallah, Nadeen (ORCID: 0000-0001-7921-034X); Staab, Steffen
Publisher	DaRUS
Contributor	Fathallah, Nadeen; High Performance Computing Center (HLRS)
Publication Year	2025
Funding Reference	German Federal Ministry of Education and Research (BMBF) 16DHBKI041
Rights	MIT License; info:eu-repo/semantics/openAccess; https://spdx.org/licenses/MIT.html
OpenAccess	true
Contact	Fathallah, Nadeen (University of Stuttgart)

Representation
Resource Type	Code for collaboratove captioning tool, Caption correction logs, User interaction data, Video subtitle datasets, Collaborative annotation records, Accessibility feedback datasets, Processed speech-to-text transcriptions.; Dataset
Format	application/javascript; application/octet-stream; application/x-subrip; text/markdown; text/html; text/plain; charset=US-ASCII; application/json; text/css; text/tab-separated-values; video/mp4
Size	1742; 1368; 1542; 20295; 1378; 474; 5912; 2538; 3571; 564; 2981; 2971; 2979; 1312; 1316; 2123; 2128; 2135; 4030; 3528; 4042; 3532; 3587; 3599; 3593; 4278; 4294; 4296; 2706; 2714; 2712; 1659; 1662; 3716; 3709; 3714; 899; 901; 5432; 5425; 5434; 3427; 3428; 4156; 4163; 4166; 2323; 2312; 2322; 1556; 1561; 3261; 3258; 3271; 1976; 1971; 3004; 3002; 3010; 2060; 2058; 2064; 1805; 1809; 1811; 1040; 1039; 1047; 1048; 3322; 3335; 3329; 206; 212; 207; 214; 4160; 4165; 4173; 2059; 2065; 2069; 2475; 2473; 2477; 2998; 2995; 3003; 3941; 3949; 3954; 2445; 2443; 2449; 2873; 2869; 2874; 1509; 1511; 1183; 1185; 2296; 2288; 2291; 2040; 1908; 2050; 1913; 2759; 2767; 2774; 2239; 2248; 2247; 2259; 2261; 2265; 2196; 2200; 2202; 1359; 1358; 1360; 3063; 3056; 3058; 895; 896; 3148; 3145; 3154; 2318; 2314; 959; 961; 957; 1392; 1393; 1394; 3718; 3703; 1898; 1894; 1899; 3384; 3382; 3385; 1586; 1595; 1589; 1416; 1418; 1144; 683; 1209; 1407; 972; 1681; 4103; 900; 943; 330; 337; 209; 3077; 1713; 4271; 2864; 3849; 1593; 3758; 797; 645; 646; 616; 566; 1005; 902; 614; 922; 1073; 224; 2516; 240; 1376; 7835; 3788; 5451; 1441; 160; 562; 465; 545; 978; 523; 4024; 823; 746; 440; 8367; 296; 111; 158; 40; 629; 2489; 34798; 2594; 8014981; 1439180; 30082245; 25064046; 9555578; 13309348; 4977767; 5031768; 9906544; 4826168; 14063283; 25002015; 14358897; 4244687; 5641069; 8213728; 23061285; 7998118; 25998153; 11794224; 17512682; 10270985; 2799386; 37562301; 6072913; 6409740; 3078066; 12351368; 10513409; 35251222; 13200839; 27756490; 32960507; 30150351; 9123036; 11442280; 6864985; 17929096; 18650295; 23977463; 7460492; 5134379; 13995510; 2083604; 13392520; 8964427; 5978944; 15184044; 7715620; 6509220; 10101; 3678; 4241; 12198; 4997; 5670
Version	1.0
Discipline	Other