00_navez_gold_standard_preprocessing_json2df.ipynb

This file is part of "Replication Data for: From nineteenth-century letters to entities: "a NER pipeline for French correspondence and its methodological lessons" - Article for Digital Humanities Benelux Journal".

Version 1.0
File Citation
Zuzana Černáková; Fien Messens; Tess Dejaeghere; Julie M. Birkholz, 2026, "Replication Data for: From nineteenth-century letters to entities: "a NER pipeline for French correspondence and its methodological lessons" - Article for Digital Humanities Benelux Journal", https://doi.org/10.34934/DVN/HNA7QO, Social Sciences and Digital Humanities Archive – SODHA, V1; 00_navez_gold_standard_preprocessing_json2df.ipynb [fileName]
Learn about Data Citation Standards.
Dataset Citation
Zuzana Černáková; Fien Messens; Tess Dejaeghere; Julie M. Birkholz, 2026, "Replication Data for: From nineteenth-century letters to entities: "a NER pipeline for French correspondence and its methodological lessons" - Article for Digital Humanities Benelux Journal", https://doi.org/10.34934/DVN/HNA7QO, Social Sciences and Digital Humanities Archive – SODHA, V1, UNF:6:MemhfA5Fl4s1tvLWf4VR2A== [fileUNF]
Learn about Data Citation Standards.
Contact Owner Share
File Metrics
1 Download
File Metadata  
Preview
MD5 6062b90f470e79ad4062aa678de087d3
Deposit Date 2026-06-22
Metadata Release Date 2026-08-25
Publication Date 2026-08-25
Size 465.1 KB
Type Jupyter Notebook
File Path Notebooks/
Description Preprocessing notebook that converts Label Studio JSON exports into the structured gold-standard corpus used throughout the experiments. The workflow merges annotation projects, extracts entity annotations, aligns character offsets, generates IOB labels, removes unsupported nested entities, and creates the training, development and test datasets used for the NER experiments.
Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Access

Restricting limits access to published files. People who want to use the restricted files can request access by default. If you disable request access, you must add information about access to the Terms of Access field.

Learn about restricting files and dataset access in the User Guide.

Enable access request
You must enable request access or add terms of access to restrict file access.
Save Changes
Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.
Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Select File(s)

Please select one or more files.

Share File

Share this file on your favorite social media networks.

Dataset Terms

This dataset is made available under the following terms. Please confirm and/or complete the information needed below in order to continue.

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the dataset page.

Custom Dataset Terms — the following Custom Dataset Terms have been defined for this dataset.

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

https://www.sodha.be/api/access/datafile/

Request Access

Please confirm and/or complete the information needed below in order to request access to files in this dataset.

These files contain training and evaluation data derived from nineteenth-century letters from the Navez Project. To protect access conditions associated with the source material, the files are restricted. Researchers may request access for non-commercial scholarly use. Requests will be evaluated on a case-by-case basis.
???file.mapData.unpublished.header???

???file.mapData.unpublished.message???

Provenance

Provenance is a record of the origin of your data file and any transformations it has been through. Upload a JSON file from a provenance capture tool to generate a graph of your data's provenance. For more information, please refer to our User Guide.

File must be JSON format and follow the W3C standard.

Select File

You may also add information documenting the history of your data file, including how it was created, how it has changed, and who has worked with it.

Provenance
No changes have been made.
Request Access

  You need to Sign Up or Log In to request access.

Compute

This file is restricted and you may not compute on it because you have not been granted access.