Comparative Analysis of Entry-Level TOEFL Skill Profiles Among Vocational Students: Implications for ESP Curriculum Development

Authors

  • Irfiani Bakri Politeknik Negeri Manado, Manado, Indonesia
  • Alfridha Dwi Putri Putri Akademi Komunitas Industri Manufaktur Bantaeng, Sulawesi Selatan, Indonesia
  • Rahmat J Institut Teknologi dan Bisnis Maritim Balik Diwa Makassar, Makassar, Indonesia
  • Walangitan Melania Rut Politeknik Negeri Manado, Manado, Indonesia

DOI:

https://doi.org/10.24256/ideas.v14i1.10973

Keywords:

English for Specific Purposes, diagnostic assessment, TOEFL skill profiles, vocational higher education

Abstract

English proficiency has become an essential competency for vocational higher education students due to the increasing demand for effective communication in academic, professional, and workplace contexts. Although the Test of English as a Foreign Language (TOEFL) is widely used to assess English proficiency, previous studies have predominantly focused on overall TOEFL achievement, while limited attention has been given to the diagnostic analysis of TOEFL subskills and their implications for English for Specific Purposes (ESP) curriculum development. This study aims to investigate the entry-level TOEFL skill profiles of first-semester vocational students and examine disciplinary differences across Business Management, Business Administration, and Information Technology programs. Employing a quantitative descriptive-comparative design, the study analyzed secondary TOEFL data from 175 first-semester students. The dataset consisted of Listening Comprehension, Structure and Written Expression, Reading Comprehension, and overall TOEFL scores. Descriptive statistics, proficiency classification, and one-way analysis of variance (ANOVA) were used to identify students’ language proficiency profiles and examine differences among academic programs. The findings revealed that Reading Comprehension achieved the highest mean score, followed by Structure and Written Expression, whereas Listening Comprehension emerged as the weakest skill. The majority of students (76.0%) were classified within the low proficiency category. Furthermore, significant differences were found among academic programs, with Information Technology students consistently outperforming Business Management and Business Administration students across all TOEFL components. The findings indicate that vocational students demonstrate distinct language proficiency profiles and disciplinary variations in English competence. This study contributes to the ESP literature by demonstrating the value of TOEFL subskill profiling as a diagnostic needs-analysis tool and by providing empirical evidence for the development of discipline-sensitive and evidence-based ESP curricula in vocational higher education.

References

Airey, J. (2024). Disciplinary Literacy and English-Medium Instruction (pp. 48–59). https://doi.org/10.4324/9781003476313-4

Aryadoust, V., & Jia, Y. (2026). Assessing Listening Skills in SLA (H. Nesi & P. B. T.-I. E. of L. and L. (Third E. Milin (eds.); pp. 477–481). Elsevier. https://doi.org/https://doi.org/10.1016/B978-0-323-95504-1.01010-3

Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford university press.

Bartlett, T. (2026). Positive Discourse Analysis (H. Nesi & P. B. T.-I. E. of L. and L. (Third E. Milin (eds.); pp. 356–361). Elsevier. https://doi.org/https://doi.org/10.1016/B978-0-323-95504-1.01653-7

Bibby, S. (2021). Listening in the Language Classroom: The Case for Extensive Listening. 23, 1–11.

Brown, H. D., & Abeywickrama, P. (2019). Language assessment: Principles and classroom practices (3rd ed.). In Pearson.

Chapelle, C. A., & Lee, H. (2021). Understanding Argument-Based Validity in Language Testing. May, 19–44.

Feng, H., & Liu, H. (2021). International Perspectives on Teaching the Four Skills in ELT: Listening, Speaking, Reading, Writing. In System (Vol. 98). https://doi.org/https://doi.org/10.1016/j.system.2021.102467

Field, J. (2019). Rethinking the Second Language ListeningTest: From Theory to Practice.

Hossain, K. I. (2025). Social Sciences & Humanities Open Teacher well-being and burnout in English Language Teaching ( ELT ). 12(January).

Hsieh, C. N. (2024). Building a Validity Argument for the TOEFL Junior® Tests. ETS Research Report Series, 2024(1), 1–22. https://doi.org/10.1002/ets2.12379

Husain, F. M., & Mahfoodh, O. H. A. (2021). English for Professionals students’ perceptions of the relevance of internship to their undergraduate courses and career choices. Higher Education, Skills and Work-Based Learning, 11(5), 1068–1088. https://doi.org/https://doi.org/10.1108/HESWBL-02-2020-0020

Hyland, K. (2022). ENGLISH FOR SPECIFIC PURPOSES : WHAT IS IT AND WHERE IS IT TAKING US ? Journal of English for Spesific Purposes, 10(2), 202–220.

Khan, M. O., & Khan, S. (2024). Influence of online versus traditional learning on EFL listening skills: A blended mode classroom perspective. Heliyon, 10(7), e28510. https://doi.org/https://doi.org/10.1016/j.heliyon.2024.e28510

Kohnke, L., & Moorhouse, B. (2020). Facilitating Synchronous Online Language Learning through Zoom. RELC Journal, 53. https://doi.org/10.1177/0033688220937235

Krasova, A., & Moroz, O. (2024). Multilingual English second language students’ voice in digital storytelling. Computers and Composition, 74, 102886. https://doi.org/https://doi.org/10.1016/j.compcom.2024.102886

Kunnan, A. J. (2013). Fairness and Justice in Language Assessment: Principles and Public Reasoning. 36–39.

Li, K. (Ke), Mukundan, J., & Vasodavan, V. (2026). Reducing listening anxiety in blended learning: The role of AI-driven feedback and strategy in EFL education. Acta Psychologica, 267, 107105. https://doi.org/https://doi.org/10.1016/j.actpsy.2026.107105

Mahdian Rad, H., & Baleghizadeh, S. (2025). A systems model of L2 listening comprehension: Investigating the role of cognitive, metacognitive, and affective factors. System, 133, 103786. https://doi.org/https://doi.org/10.1016/j.system.2025.103786

Masruddin, M., Amir, F., Langaji, A., & Rusdiansyah, R. (2023). Conceptualizing linguistic politeness in light of age. International Journal of Society, Culture & Language, 11(3), 41-55.

Mazidah, E. N., & Masruroh, L. (2024). CIPP MODEL EVALUATION ON TOEFL COURSE AT HIGHER EDUCATION. Edulitics Journal, 9(1), 12–23.

Putri, A. D. (2026). INNOVATIVE ENGLISH TEACHING METHODS IN THE DIGITAL ERA: DIGITAL PROJECT-BASED LEARNING (PBL). Future Science Publisher.

Putri, A. D., Bakri, I., & Fisma. (2024). Employing the Trilingual Quran As a Tool To Improve Vocabulary Skills Among Tenth-Grade Students At Babul Khaer Islamic Boarding School. International Journal of Research on English Teaching and Applied Linguistics, 5(2), 51–60.

Qiu, X., & Xu, J. (2022). “Listening should be done communicatively”: Do task-supported language teaching and post-task self-reflection facilitate the development of L2 listening proficiency? System, 109, 102897. https://doi.org/https://doi.org/10.1016/j.system.2022.102897

Rodney H. Jones ; Christoph A. Hafner. (2021). EVALUATING AN ESP COURSE EFFECTIVENESS THROUGH STUDENTS’ PERCEPTIONS AND IMPROVEMENT LEVEL: A CASE STUDY WITH MIDEPLAN PROFESSIONALS.

Rose, H. & Galloway, N. (2019). Global Englishes for Language Teaching. Cambridge University Press.

Rose, H., McKinley, J., & Galloway, N. (2020). Global Englishes and language teaching: A review of pedagogical research. Language Teaching, 54, 157–189. https://api.semanticscholar.org/CorpusID:228817578

Sadeghi, K., & Richards, J. C. (2021). Professional development among English language teachers: challenges and recommendations for practice. Heliyon, 7(9), e08053. https://doi.org/https://doi.org/10.1016/j.heliyon.2021.e08053

Stansfield, O., & Abas, S. (2025). Exploring EFL Views about the Value of Test Preparation Exam for TOEFL. Innovation in Language Testing and Teaching, 1(1), 77–86. https://doi.org/10.61227/iltt.v1i1.180

Taupik, M. (2025). A Needs Analysis of English Language Skills for Academic and Employment Purposes at STIA Tabalong. 10(3), 763–774.

Usman, N., Hendrik, H., & Madehang, M. (2024). Difficulties in understanding the TOEFL reading test of english language education study program at university. IDEAS: Journal on English Language Teaching and Learning, Linguistics and Literature, 12(1), 755-773.

Vogt, K., Tsagari, D., Csépes, I., Green, A., Sifakis, N., Vogt, K., Tsagari, D., Csépes, I., Green, A., & Sifakis, N. (2020). Linking Learners ’ Perspectives on Language Assessment Practices to Teachers ’ Assessment Literacy Enhancement ( TALE ): Insights from Four European Countries Linking Learners ’ Perspectives on Language Assessment Practices to Teachers ’ Assessment Litera. https://doi.org/10.1080/15434303.2020.1776714

William Grabe, F. L. S. (2020). Teaching and Researching Reading (Third). Routledge.

Wingate, U. (2016). Academic literacy across the curriculum: Towards a collaborative instructional approach. Language Teaching, 51, 1–16. https://doi.org/10.1017/S0261444816000264

Zafar, S., & Singh, N. (2026). Strategy Use in SLA (H. Nesi & P. B. T.-I. E. of L. and L. (Third E. Milin (eds.); pp. 604–609). Elsevier. https://doi.org/https://doi.org/10.1016/B978-0-323-95504-1.01042-5

Downloads

Published

2026-07-08

Citation Check