Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges

Olaitan Olawale Opeyemi; Oluwatimilehin Samson Ariyo; Joshua Onyedikachi Ike

doi:doi:10.11648/j.ajmie.20240903.12

Research Article |

| Peer-Reviewed

Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges

Olaitan Olawale Opeyemi^*

, Oluwatimilehin Samson Ariyo, Joshua Onyedikachi Ike

Published in American Journal of Mechanical and Industrial Engineering (Volume 9, Issue 3)

Received: 17 July 2024 Accepted: 10 August 2024 Published: 26 September 2024

Views: Downloads:

Download PDF

Share This Article

Twitter
Linked In
Facebook

Abstract

The technical colleges in Nigeria face challenges in assessing the psycho-productive skills of motor vehicle mechanic students due to a lack of standardized assessment tools. This study focused on the development and validation of psycho-productive multiple-choice skill tests (PMCST) for assessing the practical performances of technical college students in motor vehicle mechanic work across Ekiti and Ondo States. Adopting an instrumentation research design, instrumentation research design was considered appropriate because the study developed an instrument for assessment of practical skills of students. The study targeted a population of 350 National Technical Certificate (NTC) III students, encompassing three ability groups: 57 high, 201 average, and 92 low ability students. A draft copy of the PMCST, comprising 180 items, was generated and utilized as the instrument for assessment in five technical colleges across both states. Data analysis was performed using the split-half technique and Kudder-Richardson (K-R20), yielding a reliability coefficient of 0.84 for the test. Significant differences were found in the mean scores of the three ability groups. Among the recommendations arising from the study is the suggestion that examination bodies such as NABTEB, WAEC, and NECO integrate the PMCST into their certification processes for NTC students.

Published in	American Journal of Mechanical and Industrial Engineering (Volume 9, Issue 3)
DOI	10.11648/j.ajmie.20240903.12
Page(s)	52-62
Creative Commons	This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.
Copyright	Copyright © The Author(s), 2024. Published by Science Publishing Group

Keywords

Motor Vehicle Mechanic Work, State Wide Assessment, Psycho Productive Multiple-Choice Skill Test Items, Validation, Reliability, Item Construction

References

[1]	Academic Technology Service (2003). Scoring Office: Writing Test items. Retrieved March 14, 2021, from Michigan State University website http://www.msu.edu
[2]	Academic Technology Office (2009). Introduction to Item Analysis Retrieved March, 14, 2021, from http://www.msu.edu/adopt/soweb/itand.htm
[3]	Airforce Handbook (2002). Information for Designers of Instructional Systems: Test and Measurement Handbook. Vol. 12 Retrieved February 25, 2021, from http://www.e-publishing.af.mil/shared/media/epubs/AFH36-2235V12.pdf
[4]	Ali, A. (2006). Conducting Research in Education and the Social Sciences. Enugu: Tachiwa Network. Ltd.
[5]	Allen, M. J. & Yen, W. M. (2002). Introduction to Measurement Theory. Pacific Groove. CA: Brooks/Cole.
[6]	Aworefa, T. A. (2005). Designing Instruments for Measuring Students Educational Outcomes: The NABTEB Approach. Retrieved February 25, 2021 From http://www.curriculum.wcape.school.za/resource_files/22110445_28.doc
[7]	Ayuba, Z. G. (2007). Development and Validation of Auditory and Visual Perceptual Test for skills in Machine Tool Technology and Practice. Unpublished Ph.D Thesis, University of Nigeria, Nsukka.
[8]	Audu, E. (2010). Development and Validation of Decision-making Inventory for Secondary school Principal in Plateau State. Journal of Home Economics Research, 18(1) 43-45.
[9]	Burkar, B. (2006). Development and Validation of Laboratory-Based test for Assessing Practical Skills of Higher National Diploma Student in Electronic Maintenance and Repairs. Unpublished Ph.D Thesis, University of Nigeria, Nsukka.
[10]	Burton, S. J., Sudweeks, R. R., Merril, P. F., & Wood., B (2012). How to Prepare Better Multiple-Choice Test Items: Guidelines for University Faculty. Retrieved June 14, 2021, from http://www.testing.byu.edu/info/handbooks/betteritems.pdf
[11]	Clark, D (2000). Learning Domains or Blooms’ Taxonomy. Retrieved June 14, 2021, from http://www.nwlink.com/wdondark/hrd/bloom.htm
[12]	Clark, D (2004). Instructional Systems Development: Evaluation Phase (Chapter VI) Retrieved September 25^th, 2021 from http://www.nwlink.com/donclark/ hrd/sat.html
[13]	Cohen, L., Manion, L., & Morrision, K (2011). Research methods in education 7/e. New York: Routldge Taylor & Francis.
[14]	Daramola, C. O. (1990). Nomadic Education: A reflection of Rural Development. Nigerian Journal of Educational Foundations 1(1) 93-99 Retrieved on July 14, 2009, from http://www.unilorin.edu.ng/staffprofile/educ/codaramola_profile.htm
[15]	Federal Ministry of Education, Science and Technology (2014). National Policy on Education. Lagos: NERDC Press.
[16]	Federal Ministry of Education (2020) Draft: Roadmap for Nigerian Educational Sector. Abuja: Federal Ministry of Education.
[17]	Fraenkel, J. R., & Wallen, N. E. (2012). How to Design and Evaluate Research in Education. 5/e. New York: McGraw Hill.
[18]	Igbo, C. A (1997). Development and Validation of Psycho-productive Skill Test for Assessing Senior Secondary School Students in Clothing and Textile Unpublished Ph.D Thesis. University of Nigeria, Nsukka.
[19]	Manitoba Trade Programs (2009). Motor Vehicle Mechanic. Retrieved on August 18, 2009, from http://www.gov.mb/ca/trade/export/tap/tap-show.html
[20]	Mayberry. P. W., & Carey, N. B. (1999). Job Performance Tests for Motor Transport Mechanics. Vol II: Administrative Duties and Job Knowledge Test. Retrieved August 18, 2021, from http://www.oai.dtic.mil/oai/oai?vert=getRecord&netadataprefix=htm
[21]	Mehrens, W. A., & Lehman, I. J. (1991). Measurement and Evaluation in Education and Psycholoy. (4/e). Orlando, EL: Holt Reinhart and Winston Inc.
[22]	Morris, L. L., Fitz-Gibbon, C. C., & Lindneim, E. (1987). How to Measure Performance and use tests. Newburg Park California: SAGE Publications, Lnc.
[23]	NBTE (2003). Motor Vehicle Mechanics Work-National Technical Certificate (NTC) and Advanced National Technical Certificate (ANTC). National Board for Technical Education. National Technical Certificate.
[24]	Nworgu, B. G. (2003). Educational Measurement and Evaluation: Theory and Practice. Nsukka: University Trust Publishers.
[25]	New Horizon. (2002). Assessment terminology: A Glossary of Useful Terms. Retrieved September 25, 2009, from http://www.newhorizons.org/strategies/assess/terminology.htm
[26]	Nkemakolam, E. O. (2003). Taxonomy of Education Measures: In Nworgu B. G. (Ed), Measurement and Evaluation: Theory and Practice. Nsukka: University Trust Ltd.
[27]	Ogbu, E. J. (2011). Development and Factorial Validation of Basic Electricity Interest Inventory. Nigerian Vocational Association Journal (NVA) 14(1) 1-12.
[28]	Okoro, O. M. (2012). Measurement and evaluation in education Obosi: Pacific Publisher Ltd.
[29]	Okoro, O. M. (2000). Programme evaluation in education. Obosi: Pacific Publishers Ltd.
[30]	Olaitan, S. O., & Ali, A. (1999). The Making of Curriculum: Theory, Process, and Product, and Evaluation. Owerri: Cape Publishers Ltd.
[31]	Olaitan, S. O. (1996). Vocational and Technical Education in Nigeria: Issues and Analysis. Onitsha: Noble Graphic Press.
[32]	Okeme, I. (2011). Development and Validity of Psycho-productive skill Multiple-choice items for students of Agricultural Science in secondary schools. Unpublished Ph.D. Thesis. Department of Vocational Teacher Education. University of Nigeria, Nsukka.
[33]	Onyilofe, M. P. (2008). Development and Validation of Criterion-Referenced Tests For Assessing Student Performance in Petrol Engine Maintenance in Technical Colleges. Unpublished ME.D Thesis. Department of Vocational Teacher Education. University of Nigeria, Nsukka.
[34]	Ombugus, D. A and Umaru, R. I (2016). Psycho-productive skill multiple-choice test items for assessing student in mechanical engineering craft practice in technical colleges. European Journal of Education Studies. 2(2).
[35]	Osinem, E. C. (2008). Managing Agricultural Education and Training: Resources, Principle & Methods. Enugu: Belony International Publishers.
[36]	Salami, K. A. (2004). Auto-Technology Fundamentals. Series 1-3. Ibadan: University Press Plc.
[37]	Simpson, E. J (1972). The Classification of Educational Objectives in the Psychomotor Domain. The Psychomotor Domain 3(2) 43-46.
[38]	Egbita, N. M. (2013). Development and Validation of Metalwork Process skills for NCE (Tech) students at the Institute for Science, Technology and Education, Nigeria. Journal of Education and Practice. 5(1) 63-72.
[39]	Williams, P. S. (2012). Factorial Validation Psycho-productive skill test for Assessing senior secondary school students in Woodwork in Ondo State. Nigerian Association of Teachers of Technology (NATT) 22^nd National conference proceedings, 184-188.
[40]	Wikipeadia (2020). Assessment. Retrieved on September 25 2021 from http://www.en.wikipeadia.org/wiki/Assessment
[41]	Zimmerman, D. W., Williams, R. H., Zumbo, B. D., & Ross, D. (2005). Louis Guttman’s Contributions to Classical Test Theory. International Journal of Testing, 5, 81-95.
[42]	Zimmerman, B. B., Sudweeks, R. B., Shelly, M. F., & Wood, B. (1990). How to Prepare Better Test: Guidelines for University Faculty. Provo, U. T: Brigham Young University Testing Services. Retrieved on June 14, 2021 from http://www.testing.bgu.edu/info/handbook/bettertests.pdf

Cite This Article

Plain Text BibTeX RIS

APA Style

Opeyemi, O. O., Ariyo, O. S., Ike, J. O. (2024). Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges. American Journal of Mechanical and Industrial Engineering, 9(3), 52-62. https://doi.org/10.11648/j.ajmie.20240903.12

Copy | Download

ACS Style

Opeyemi, O. O.; Ariyo, O. S.; Ike, J. O. Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges. Am. J. Mech. Ind. Eng. 2024, 9(3), 52-62. doi: 10.11648/j.ajmie.20240903.12

Copy | Download

AMA Style

Opeyemi OO, Ariyo OS, Ike JO. Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges. Am J Mech Ind Eng. 2024;9(3):52-62. doi: 10.11648/j.ajmie.20240903.12

Copy | Download

@article{10.11648/j.ajmie.20240903.12,
  author = {Olaitan Olawale Opeyemi and Oluwatimilehin Samson Ariyo and Joshua Onyedikachi Ike},
  title = {Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges
},
  journal = {American Journal of Mechanical and Industrial Engineering},
  volume = {9},
  number = {3},
  pages = {52-62},
  doi = {10.11648/j.ajmie.20240903.12},
  url = {https://doi.org/10.11648/j.ajmie.20240903.12},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ajmie.20240903.12},
  abstract = {The technical colleges in Nigeria face challenges in assessing the psycho-productive skills of motor vehicle mechanic students due to a lack of standardized assessment tools. This study focused on the development and validation of psycho-productive multiple-choice skill tests (PMCST) for assessing the practical performances of technical college students in motor vehicle mechanic work across Ekiti and Ondo States. Adopting an instrumentation research design, instrumentation research design was considered appropriate because the study developed an instrument for assessment of practical skills of students. The study targeted a population of 350 National Technical Certificate (NTC) III students, encompassing three ability groups: 57 high, 201 average, and 92 low ability students. A draft copy of the PMCST, comprising 180 items, was generated and utilized as the instrument for assessment in five technical colleges across both states. Data analysis was performed using the split-half technique and Kudder-Richardson (K-R20), yielding a reliability coefficient of 0.84 for the test. Significant differences were found in the mean scores of the three ability groups. Among the recommendations arising from the study is the suggestion that examination bodies such as NABTEB, WAEC, and NECO integrate the PMCST into their certification processes for NTC students.
},
 year = {2024}
}

Copy | Download

TY  - JOUR
T1  - Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges

AU  - Olaitan Olawale Opeyemi
AU  - Oluwatimilehin Samson Ariyo
AU  - Joshua Onyedikachi Ike
Y1  - 2024/09/26
PY  - 2024
N1  - https://doi.org/10.11648/j.ajmie.20240903.12
DO  - 10.11648/j.ajmie.20240903.12
T2  - American Journal of Mechanical and Industrial Engineering
JF  - American Journal of Mechanical and Industrial Engineering
JO  - American Journal of Mechanical and Industrial Engineering
SP  - 52
EP  - 62
PB  - Science Publishing Group
SN  - 2575-6060
UR  - https://doi.org/10.11648/j.ajmie.20240903.12
AB  - The technical colleges in Nigeria face challenges in assessing the psycho-productive skills of motor vehicle mechanic students due to a lack of standardized assessment tools. This study focused on the development and validation of psycho-productive multiple-choice skill tests (PMCST) for assessing the practical performances of technical college students in motor vehicle mechanic work across Ekiti and Ondo States. Adopting an instrumentation research design, instrumentation research design was considered appropriate because the study developed an instrument for assessment of practical skills of students. The study targeted a population of 350 National Technical Certificate (NTC) III students, encompassing three ability groups: 57 high, 201 average, and 92 low ability students. A draft copy of the PMCST, comprising 180 items, was generated and utilized as the instrument for assessment in five technical colleges across both states. Data analysis was performed using the split-half technique and Kudder-Richardson (K-R20), yielding a reliability coefficient of 0.84 for the test. Significant differences were found in the mean scores of the three ability groups. Among the recommendations arising from the study is the suggestion that examination bodies such as NABTEB, WAEC, and NECO integrate the PMCST into their certification processes for NTC students.

VL  - 9
IS  - 3
ER  -

Copy | Download

Author Information

Olaitan Olawale Opeyemi

Department of Industrial Technical Education, University of Nigeria, Nsukka, Nigeria

Contact Email

http://orcid.org/0000-0002-7071-7133
Oluwatimilehin Samson Ariyo

Department of Industrial Technical Education, University of Nigeria, Nsukka, Nigeria
Joshua Onyedikachi Ike

Department of Industrial Technical Education, University of Nigeria, Nsukka, Nigeria

Download PDF

Sections

Plain Text BibTeX RIS

APA Style

Opeyemi, O. O., Ariyo, O. S., Ike, J. O. (2024). Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges. American Journal of Mechanical and Industrial Engineering, 9(3), 52-62. https://doi.org/10.11648/j.ajmie.20240903.12

Copy | Download

ACS Style

Opeyemi, O. O.; Ariyo, O. S.; Ike, J. O. Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges. Am. J. Mech. Ind. Eng. 2024, 9(3), 52-62. doi: 10.11648/j.ajmie.20240903.12

Copy | Download

AMA Style

Opeyemi OO, Ariyo OS, Ike JO. Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges. Am J Mech Ind Eng. 2024;9(3):52-62. doi: 10.11648/j.ajmie.20240903.12

Copy | Download

@article{10.11648/j.ajmie.20240903.12,
  author = {Olaitan Olawale Opeyemi and Oluwatimilehin Samson Ariyo and Joshua Onyedikachi Ike},
  title = {Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges
},
  journal = {American Journal of Mechanical and Industrial Engineering},
  volume = {9},
  number = {3},
  pages = {52-62},
  doi = {10.11648/j.ajmie.20240903.12},
  url = {https://doi.org/10.11648/j.ajmie.20240903.12},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ajmie.20240903.12},
  abstract = {The technical colleges in Nigeria face challenges in assessing the psycho-productive skills of motor vehicle mechanic students due to a lack of standardized assessment tools. This study focused on the development and validation of psycho-productive multiple-choice skill tests (PMCST) for assessing the practical performances of technical college students in motor vehicle mechanic work across Ekiti and Ondo States. Adopting an instrumentation research design, instrumentation research design was considered appropriate because the study developed an instrument for assessment of practical skills of students. The study targeted a population of 350 National Technical Certificate (NTC) III students, encompassing three ability groups: 57 high, 201 average, and 92 low ability students. A draft copy of the PMCST, comprising 180 items, was generated and utilized as the instrument for assessment in five technical colleges across both states. Data analysis was performed using the split-half technique and Kudder-Richardson (K-R20), yielding a reliability coefficient of 0.84 for the test. Significant differences were found in the mean scores of the three ability groups. Among the recommendations arising from the study is the suggestion that examination bodies such as NABTEB, WAEC, and NECO integrate the PMCST into their certification processes for NTC students.
},
 year = {2024}
}

Copy | Download

TY  - JOUR
T1  - Psycho-Productive Skill Test Items Construction and Validation in Motor Vehicle Mechanic Work for State Wide Assessment in Technical Colleges

AU  - Olaitan Olawale Opeyemi
AU  - Oluwatimilehin Samson Ariyo
AU  - Joshua Onyedikachi Ike
Y1  - 2024/09/26
PY  - 2024
N1  - https://doi.org/10.11648/j.ajmie.20240903.12
DO  - 10.11648/j.ajmie.20240903.12
T2  - American Journal of Mechanical and Industrial Engineering
JF  - American Journal of Mechanical and Industrial Engineering
JO  - American Journal of Mechanical and Industrial Engineering
SP  - 52
EP  - 62
PB  - Science Publishing Group
SN  - 2575-6060
UR  - https://doi.org/10.11648/j.ajmie.20240903.12
AB  - The technical colleges in Nigeria face challenges in assessing the psycho-productive skills of motor vehicle mechanic students due to a lack of standardized assessment tools. This study focused on the development and validation of psycho-productive multiple-choice skill tests (PMCST) for assessing the practical performances of technical college students in motor vehicle mechanic work across Ekiti and Ondo States. Adopting an instrumentation research design, instrumentation research design was considered appropriate because the study developed an instrument for assessment of practical skills of students. The study targeted a population of 350 National Technical Certificate (NTC) III students, encompassing three ability groups: 57 high, 201 average, and 92 low ability students. A draft copy of the PMCST, comprising 180 items, was generated and utilized as the instrument for assessment in five technical colleges across both states. Data analysis was performed using the split-half technique and Kudder-Richardson (K-R20), yielding a reliability coefficient of 0.84 for the test. Significant differences were found in the mean scores of the three ability groups. Among the recommendations arising from the study is the suggestion that examination bodies such as NABTEB, WAEC, and NECO integrate the PMCST into their certification processes for NTC students.

VL  - 9
IS  - 3
ER  -

Copy | Download