Comparative study of oral proficiency in direct (OPI) and semi-direct (VOCI) testing modes: Measures of complexity, accuracy, and fluency

Abstract

This study aims at comparing oral proficiency performance at two oral proficiency testing modes, namely Oral Proficiency Interview (OPI) and Video Oral Communication Instrument (VOCI) in terms of specific measures of complexity (length of ASUs, and MS-TTR), accuracy (error-free ASUs), and fluency (frequency of filled and silent pauses). It also examines the relation between task type and CAF measures in both testing modes. It further explores the test takers' perceptions and preferences towards the direct testing mode (OPI) and the semi-direct testing mode (VOCI), and then compares those perceptions and preferences with their testing performance in terms of the CAF measures. In order to achieve the goals of this study, four instruments were used to collect the data (OPI, VOCI, online background survey, and interviews conducted in Arabic). Convenience sampling was used to recruit nine senior Saudi male students, majoring in different fields in Engineering at a South-Central University in the United States. OPIs and VOCIs responses were recorded, then manually transcribed using InqScribe software. Wilcoxon Signed Rank test reveals that while complexity measures did not show any statistically significant differences in both testing modes, accuracy (Error-free ASU) and fluency (Silent pauses) showed significant differences in the OPI and VOCI testing modes. It was also found that the narrative task impacted the MS-TTR in the VOCI testing mode and the number of silent pauses in the OPI testing mode. Participants reported a variety of positive and negative perceptions towards OPI and VOCI. This study further presents information about test takers' experiences about both tests. It was also found that participants had a higher accuracy and fluency in the OPI testing that they claimed they felt more comfortable with. The current research suggests possible empirical and practical implications and some questions for future studies.