Integrating Addie and Competency-Based Assessment for Student Pilot Performance Evaluation
Abstract
This study develops and evaluates a structured assessment model integrating the ADDIE instructional design framework with competency-based evaluation to improve student pilot performance measurement. The research applies a research and development approach involving design validation, limited trials, and implementation in flight training. The proposed model, SIM-FLIGHT, assesses both technical and non-technical competencies, including flight performance, safety awareness, and decision-making skills. Data were collected using validated assessment instruments and analyzed through pretest–post-test comparison, N-Gain analysis, and statistical testing. The results indicate a significant improvement in overall student performance, particularly in non-technical competencies, demonstrating the effectiveness of a systematic and measurable evaluation framework. The findings suggest that integrating structured instructional design with competency-based assessment enhances objectivity, feedback quality, and training outcomes in aviation education.
Downloads
References
Dattel, A. R., Babin, A. K., & Wang, H. (2022). Human factors of flight training and simulation. In Human Factors in Aviation and Aerospace, Third Edition (Third Edit). Elsevier Inc. https://doi.org/10.1016/B978-0-12-420139-2.00012-5
Gao, S., Bai, Y., Hong, R., & Wang, L. (2025). Behavioral and psychophysiological responses of initial pilots in collaboration with an experienced but risky captain: A flight-simulation study based on the social facilitation. Safety Science, 187(2898), 106858. https://doi.org/https://doi.org/10.1016/j.ssci.2025.106858
Konrad, G., Khatwa, R., Feyereisen, T., & Kemp, A. (2022). Development of a flight deck human factors design and certification competency taxonomy: Preliminary findings. Transportation Research Procedia, 66(C), 279–291. https://doi.org/10.1016/j.trpro.2022.12.028
Mahsun, Sumarmi, Utaya, S., Handoyo, B., & Wibowo, N. A. (2025). Enhancing Environmental Awareness: Evaluating the Impact of Project-Based Hybrid Learning on Critical Thinking for High School Students. International Journal of Environmental Impacts, 8(1), 123–135. https://doi.org/10.18280/ijei.080113
Muehlethaler, C. M., Knecht, C. P., Doll, U., Migliorini, M., Baikie, J., Zachos, P. K., Röhle, I., Melnikov, S., Steinbock, J., Dues, M., Kapulla, R., MacManus, D. G., Lawson, N. J., Hariri, A., Parjan, Rubiono, G., Cahyo, D. H., Raivi, A. M., Moh, S., … Kim, H. W. (2023). Modularity, reconfigurability, and autonomy for the future in spacecraft: A review. Chinese Journal of Aeronautics, 34(11), 1–23. https://doi.org/10.1016/j.cja.2023.04.019
Patel, S. R., Margolies, P. J., Covell, N. H., Lipscomb, C., & Dixon, L. B. (2018). Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State. Frontiers in Public Health, 6(May). https://doi.org/10.3389/fpubh.2018.00113
Prayitno, H., Ekohariadi, Cholik, M., Anifah, L., Wardhono, A., & Wicaksono, P. (2024). Improving Pilot Competence Through Flying Practice Learning Using Flight Simulator at the Indonesia Civil Pilot Academy of Banyuwangi. Journal of Law and Sustainable Development, 12(1), e2426. https://doi.org/https://doi.org/10.55908/sdgs.v12i1.2426
Prayitno, H., Ekohariadi, Cholik, M., Suhartini, R., & Wardhono, A. (2025). Enhancing Aviation Cadet Competencies Through Simulator Based Training: A Study Using the ADDIE Model and Importance Performance Analysis. International Journal of Transport Development and Integration, 9(3), 485–492. https://doi.org/10.18280/ijtdi.090303
Prayitno, H. et al. (2025). SIM-FLIGHT ( Simulated Integrated Model for Flight Competency Training ) (1st ed.). CV. Smart Global Nusantara. https://smartglobalnusantara.co.id/product/sim-flight/
Rotger, T., Eyers, C., & Fusaro, R. (2024). A Review of the Current Regulatory Framework for Supersonic Civil Aircraft: Noise and Emissions Regulations. Aerospace, 11(1), 1–23. https://doi.org/10.3390/aerospace11010019
Saastamoinen, K., & Maunula, K. (2021). Usefulness of flight simulator as a part of military pilots training - Case study: Grob G 115E. Procedia Computer Science, 192, 1670–1676. https://doi.org/10.1016/j.procs.2021.08.171
Suyatmo, S., Prayitno, H., Wirawan, W. A., Pratiwi, D. I., & Waluyo, B. (2025). Preparing industry-ready graduates: Interplay of lecturer behavior, self-motivation, and soft skill development in vocational education. Acta Psychologica, 261, 105892. https://doi.org/https://doi.org/10.1016/j.actpsy.2025.105892
Thulasy, T. N., Nohuddin, P. N. E., Nusyirwan, I. F., Rahim, N. A., Amrin, A., & Chua, S. (2022). Skills Assessment Criteria for Aircraft Maintenance Technician in the Context of Industrial Revolution 4.0. Journal of Aerospace Technology and Management, 14. https://doi.org/10.1590/jatm.v14.1286
Ziakkas, D., Michael, W. S., & Pechlivanis, K. (2022). The Implementation of Competency-Based Training and Assessment (CBTA) Framework in Aviation Manpower Planning. Transportation Research Procedia, 66(C), 226–239. https://doi.org/10.1016/j.trpro.2022.12.023
Copyright (c) 2026 Hadi Prayitno, Dhian Supardam, Fachrurrazi Burhanuddin
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
.png)
1.png)
.png)
