MetaTT Uses Tensor-Train Adapters for Parameter-Efficient Fine-Tuning

MetaTT employs a shared Tensor Train (TT) adapter to factorize transformer sub-modules, allowing parameter counts to scale with the sum of modes rather than their product. The framework maintains competitive accuracy-to-parameter efficiency tradeoffs compared to LoRA across single-task and multi-task benchmarks.