We are pleased to announce that the following tool paper, co-authored by Associate Professor Teeradaj Racharak, has been accepted for presentation in the Tool Track of the 32nd Asia-Pacific Software Engineering Conference (APSEC 2025), to be held from December 2–5, 2025. APSEC is one of the leading international conferences in software engineering, providing a platform for sharing innovative tools, ideas, and technologies across academia and industry.

Accepted Paper

• Chommakorn Sontesadisai, Chalisa Sae-Ngow, Jirateep Rudeerudchanawong, Lapatrada Dangsungnoen, Chaiyong Ragkhitwetsagul, Teeradaj Racharak, Thanwadee Sunetnanta, PromptOps: Automated Tool for Testing Trustworthiness of LLMs, In Proceedings of the 32nd Asia-Pacific Software Engineering Conference (APSEC 2025 Tool Track), December 2–5, 2025

This work presents PromptOps, a novel visual-based testing tool for evaluating the trustworthiness of large language models (LLMs). Built on the principles of metamorphic testing, PromptOps goes beyond traditional accuracy-based evaluation to assess essential model properties such as robustness, fairness, and logical consistency. The tool enables users to design custom test cases via visual programming, define prompts, and automatically generate diverse test scenarios. By identifying areas for improvement in both performance and fairness, PromptOps enhances transparency and provides valuable feedback for model developers seeking to build more trustworthy AI systems.

Congratulations to the authors on this achievement!