Climbing the Ladder: Automating Data Pipelines and Reproducing Baselines in Low-Resource Settings

This pipeline automates parallel text extraction from bilingual PDFs using a language-agnostic sentence encoder with alignment-error filtering. The methodology ports desinence-biased subword segmentation to a Perl-free implementation to compare small Transformers trained from scratch against NLLB models adapted via low-rank fine-tuning for Sicilian translation.