## [Abjad at AISA-ArabicFC: Error Analysis and Prompt Engineering for Arabic Function Calling](https://aclanthology.org/2026.arabicnlp-sharedtasks.204.pdf)
[Randa Lakab](https://aclanthology.org/people/randa-lakab/unverified/),
[Shahad Abdulaziz Abdullah Alsultan](https://aclanthology.org/people/shahad-abdulaziz-abdullah-alsultan/unverified/),
[Abrar Almutiri](https://aclanthology.org/people/abrar-almutiri/unverified/)
Abstract
We describe Abjad’s submission to the AISA-ArabicFC shared task (Track B), which targets Arabic function calling with explicit natural-language reasoning prior to the structured call. Rather than fine-tuning, our system builds a robust inference and evaluation pipeline around the organizers’ baseline model, AISA-AR-FunctionCall-Think, diagnosing and fixing two pipeline-level bugs that were silently depressing scores. On the 545-example development set, our system reaches a function-name accuracy of 96.15% but an argument exact-match of only 40.6%, yielding an official Track B score (overall_b) of 0.6665, below the organizer-reported baseline of 0.739. We present a fine-grained error analysis showing that failures concentrate almost entirely in argument value formatting, including currency codes, ISO language codes, and transliteration, rather than in tool selection or task comprehension. These findings suggest that targeted fine-tuning or post-processing for structured-value normalization is a promising direction for improving Arabic function-calling performance. abjad aisa arabicfc.pdf
- Anthology ID:
- 2026.arabicnlp-sharedtasks.204
- Volume:
- [Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks](https://aclanthology.org/volumes/2026.arabicnlp-sharedtasks/)
- Month:
- October
- Year:
- 2026
- Address:
- Budapest, Hungary
- Editors:
- Muhammad Abdul-Mageed ,Tamer Elsayed ,Houda Bouamor ,Samhaa El-Beltagy ,Hend Al-Khalifa ,Ahmed Abdelali ,AbdelRahim Elmadany ,Abdellah El Mekki ,Kareem Darwish ,Sakhar Alkhereyf ,Hamzah Luqman ,Salam Khalifa ,Samar Magdy ,Zaid Alyafeai ,Injy Hamed ,Wajdi Zaghouani ,Imed Zitouni
- Venue:
- [ArabicNLP](https://aclanthology.org/venues/arabicnlp/)
- SIG:
- [SIGARAB](https://aclanthology.org/sigs/sigarab/)
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 1585–1591
- Language:
- URL:
- [https://aclanthology.org/2026.arabicnlp-sharedtasks.204/](https://aclanthology.org/2026.arabicnlp-sharedtasks.204/)
- DOI:
- Cite (ACL):
- Randa Lakab, Shahad Abdulaziz Abdullah Alsultan, and Abrar Almutiri. 2026. Abjad at AISA-ArabicFC: Error Analysis and Prompt Engineering for Arabic Function Calling . InProceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks , pages 1585–1591, Budapest, Hungary. Association for Computational Linguistics.
- Cite (Informal):
- [Abjad at AISA-ArabicFC: Error Analysis and Prompt Engineering for Arabic Function Calling](https://aclanthology.org/2026.arabicnlp-sharedtasks.204/) (Lakab et al., ArabicNLP 2026)
- PDF:
- [https://aclanthology.org/2026.arabicnlp-sharedtasks.204.pdf](https://aclanthology.org/2026.arabicnlp-sharedtasks.204.pdf)