Linguistic Specialization of Arabic in Text Embedding Models via Multi-Teacher Knowledge Distillation

Contribution

Proposes a multi-teacher distillation framework for Arabic embedding models and introduces Kawn-Embed-Light, achieving state-of-the-art performance among Arabic embedding models under one billion parameters.