From Pilot Implementation to Evaluation and Sustainability
The AISE Project — “An artificial intelligent platform to support students by assessing their performance skills through predictive models created from their writing skills” (Project Code: 2023-1-EL01-KA220-SCH-000157157) is entering an important final phase, with the consortium focusing on the evaluation of the platform, completion of the educational study, dissemination, and long-term sustainability.
📍 Transnational Project Meeting – Preveza, Greece
From 18–20 September 2026, AISE partners met in Preveza, Greece, for a Transnational Project Meeting coordinated by the Directorate of Secondary Education of Preveza. The consortium reviewed progress across WP1–WP4, platform and AI-model evaluation results, feedback from teachers and students, dissemination activities, and the actions required for successful project completion.
🤖 AI Model Evaluation – Promising Results
Ionian University presented the latest results of the AISE automatic essay-scoring methodology. The dataset includes 2,617 digitized student essays, with 261 essays used as a held-out test set.
The GPT-4o-mini model achieved:
- Content: Accuracy 0.820 | Macro-F1 0.813 | Balanced Accuracy 0.826
- Organization: Accuracy 0.790 | Macro-F1 0.774 | Balanced Accuracy 0.779
- Language: Accuracy 0.740 | Macro-F1 0.724 | Balanced Accuracy 0.708
The results demonstrate the strongest performance for Content, followed by Organization and Language. The pilot studies also identified areas for further improvement, particularly the enrichment and balancing of the knowledge bases to strengthen grading reliability across countries and essay topics.
👩🏫 Platform Evaluation & User Feedback
Teacher feedback remains central to the evaluation of the AISE platform. Discussions focused on usability, pedagogical usefulness, trust, perceived reliability, workload reduction, and willingness to continue using the platform.
The consortium also agreed that student feedback should be collected where feasible and that relevant institutional stakeholders should contribute to the final evaluation. The updated platform interface already incorporates feedback received during the evaluation process, including improvements to navigation, data entry and the presentation of results.
📚 WP3 – Educational Study in Four Countries
WP3 educational activities are progressing in Greece, Cyprus, Serbia and Croatia. Partners reviewed participation, essay availability and quality, evaluation responses, and implementation challenges.
💻 Next Steps for the AISE Platform
The consortium identified further priorities for the platform, including the development of an essay database and exploration of interoperability with Learning Management Systems (LMS). Key considerations include anonymization, access rights, search and retrieval, export functions, interoperability standards and secure LMS connectivity.
📢 Dissemination & Sustainability
Partners agreed to strengthen WP4 dissemination through coordinated institutional and professional communication channels, regular project updates, suitable visual material and continued scientific publications based on WP2 and WP3 results.
At the same time, attention is turning to the long-term sustainability of AISE. A practical sustainability plan will address hosting and maintenance, governance, user administration, preservation of the anonymised essay database, model updates, technical documentation, training materials, data protection and potential future integration with LMS environments.
🚀 Looking Ahead
The Preveza meeting represented an important step towards the successful completion of AISE. Partners reaffirmed their commitment to completing the remaining WP2, WP3 and WP4 activities while ensuring the quality, confidentiality and appropriate documentation of project results. Two follow-up online consortium meetings are planned for October and November 2026 to review progress on the final deliverables.
🤝 Working Together for Smarter Assessment
AISE continues to bring together educators, researchers and technology partners to develop ethical, transparent and pedagogically meaningful AI-supported assessment tools for European education. 📌 Stay tuned for the final results of the educational study and the next developments of the AISE platform!
