To NER or not to NER? A case study of low-resource deontic modalities in EU legislation?

DOI

Deontic modality (obligation, permission, prohibition) in legal documents can convey critical information, and identification of deontic modalities is often performed using Natural Language Processing (NLP) techniques as a Deontic Modality Classification' (DMC) text classification task. As deontic modalities in legal text are not mutually exclusive, a key challenge with DMC is that it classifies the provided text into a single modality while in reality it might have multiple deontic modalities. To address this, this study analyzes the feasibility of performing deontic modality identification as a Named Entity Recognition (NER) task over DMC task approaches in a low-resource data setting with EU legislation. Low-resource NLP approaches can offer solutions to tackle the problem of scarce data. In this paper, we use a rule-based approach with modal verbs and a Decision Tree classifier for DMC task. For NER, we utilize Conditional Random Fields (CRFs) in a low-resource setting and report on the reliability and precision for identification of deontic modality. Our experiments reveal that simpler models, like decision trees, out perform larger models in the low-resource setting of DMC obtaining macro-F1 score of 0.83. For the NER task, the CRF models show consistent performance forobligation' labels with an F1-score of 0.51 but have wavering results for other classes with a max F1-score of 0.26 for permission', and 0.08 forprohibition'.

Lawnotation, 1.0.0

Identifier
DOI https://doi.org/10.34894/D9AKUS
Related Identifier IsCitedBy https://doi.org/10.34894/HQ8LIH
Related Identifier IsCitedBy https://doi.org/10.1007/s10506-024-09423-9
Metadata Access https://dataverse.nl/oai?verb=GetRecord&metadataPrefix=oai_datacite&identifier=doi:10.34894/D9AKUS
Provenance
Creator Chakravarthy, Shashank ORCID logo; Dijck, Gijs van ORCID logo; Wilbik, Anna ORCID logo
Publisher DataverseNL
Contributor Chakravarthy, Shashank; Dijck, Gijs van
Publication Year 2024
Rights CC-BY-4.0; info:eu-repo/semantics/openAccess; http://creativecommons.org/licenses/by/4.0
OpenAccess true
Contact Chakravarthy, Shashank (maastrichtuniversity.nl); Dijck, Gijs van
Representation
Resource Type EU Legilsation; Dataset
Format application/x-ipynb+json; text/csv
Size 220670; 343282; 688377; 54271; 220604
Version 1.0
Discipline Jurisprudence; Law; Social and Behavioural Sciences
Spatial Coverage Maastricht