نوع مقاله : مقاله پژوهشی (کیفی )

نویسندگان

1 دانش‌آموخته کارشناسی ارشد رشته مدیریت آموزشی، گروه مدیریت و برنامه‌ریزی آموزشی، دانشکده روانشناسی و علوم تربیتی، دانشگاه تهران،

2 استادیار گروه مدیریت و برنامه‌ریزی آموزشی، دانشکده روانشناسی و علوم تربیتی، دانشگاه تهران، تهران، ایران

3 استادیار گروه روش‌ها و برنامه‌های آموزشی، بخش تخصصی پژوهش و سنجش، دانشکده روانشناسی و علوم تربیتی، دانشگاه تهران، تهران، ایران

چکیده

پژوهش حاضر با هدف شناسایی موانع اجرای بهینه ارزشیابی آموزشی در شرکت ملی گاز ایران و ارائه راهکارهایی برای بهبود آن انجام شده است. بدین منظور با بهره‌گیری از ظرفیت رویکرد پژوهش کیفی و روش گروه‌های کانونی، به شناسایی موانع پدیده مورد مطالعه پرداخته شد. داده‌ها با استفاده از روش نمونه‌گیری هدفمند از نوع ملاکی و مصاحبه کانونی با 4 گروه کانونی (شامل 20 نفر) از بین کارکنان واحد آموزش و تجهیز نیروی انسانی شرکت ملی گاز ایران گردآوری شد و با استفاده از روش تحلیل مضمون تحلیل گردید. تحلیل داده‌ها به شناســایی 138 گزاره مفهومی، 21 مضمون پایه و 5 مضمون اصلی شامل "موانع فردی"، "موانع سازمانی"، "موانع آموزشی"، "موانع مدیریتی" و "موانع محیطی" منتج گردید. با توجه به یافته‌های پژوهش، توجه به موانع شناسایی شده به منظور اجرای بهینه فرایند ارزشیابی آموزشی در شرکت ملی گاز ایران ضرورت دارد؛ لذا در پایان راهکارهایی به منظور کاهش تأثیر موانع بر اجرای بهینه فرایند ارزشیابی آموزشی و بهبود آن ارائه شد.

کلیدواژه‌ها

موضوعات

عنوان مقاله [English]

Identifying barriers to the optimal implementation of educational evaluation in National Gas Company of Iran: a qualitative study

نویسندگان [English]

  • omid oshaghi 1
  • Mitra Ezati 2
  • keyvan Salehi 3

1 Msc of Educational Management Field, Department of Educational Management and Planning, Faculty of Psychology and Education, University of Tehran, Tehran, Iran

2 Assistant Professor, Department of Educational Management and Planning, Faculty of Psychology and Education, University of Tehran, Tehran, Iran

3 Assistant Professor, Department of educational methods and programs, Division of Research and Evaluation, Faculty of Psychology and Education, University of Tehran, Tehran, Iran

چکیده [English]

Abstract
The current research was conducted with the aim of identifying barriers to optimal implementation of educational evaluation in National Gas Company of Iran and providing solutions for its improvement. Therefore, using the capacity of qualitative research approach and focus group method, the barriers of the studied phenomenon were identified. The data was collected by using the Purposive sampling method (criterion type) and focus interview with 4 focus groups (including 20 people) among the employees of the training and equipping of human resources unit of National Gas Company of Iran and the data was analyzed by using thematic analysis method. Data analysis resulted in the identification of 138 conceptual propositions, 21 basic themes and 5 main themes including "individual barriers", "organizational barriers", "educational barriers", "managerial barriers" and "environmental barriers". According to the findings of the research, it is necessary to pay attention to the identified barriers in order to optimally implementation of the educational evaluation process in the National Gas Company of Iran; therefore, at the end, solutions were presented in order to reduce the effect of barriers on the optimal implementation of the educational evaluation process and its improvement.
Extended abstract
Introduction
Today, due to technological advances and rapid changes in the environment of organizations (Pfoser et al, 2020), the professional development of human resources is considered one of the most important factors in adapting and facing these rapid changes (Rama Devi & Shaik, 2020), in creating a competitive advantage and value creating for organizations (Ashofteh & Orangian, 2021). In this regard, training is one of the main strategies for the professional development of the organization's human resources (Nguyen, 2020); because training is a systematic process of changing the professional behavior and level of competencies (knowledge, ability and skills) of the organization's employees (Urbancová et al, 2021), which affects the performance of the employees and will ultimately ensure the success of the organization (Sahinidis & Bouris, 2018). Effective training courses can be influent in gaining experience and improving the performance of people, and guaranteeing the survival and perfection of the organization by including strategic progress (Bazgir et al, 2020). The current economic recession has reduced the amount of budget allocated to training and development of human resources; therefore, organizations should always design and implement effective training courses in order to strengthen and expand the knowledge, attitude and skills of employees in order to improve, provide innovative ideas and provide quality services. Therefore, it is necessary for organizations to ensure the effectiveness of training courses in order to achieve their goals by providing the necessary grounds for continuous improvement of training courses (Taheri, 2016). One of the basic measures in providing effective training courses is the optimal implementation of the evaluation process of training courses. The most common definition of educational evaluation considers it as a process to examine education in order to determine whether the educational objectives have been realized in an effective and efficient way. (Sahni, 2020). The optimal implementation of the educational evaluation process, as one of the basic methods of quality assurance, makes it possible to guarantee the quality of education by identifying the weak points of the educational program and laying the groundwork to fix them (Tarazi et al, 2020). Creating the necessary conditions for the continuous improvement of training courses, preventing the deviation of training courses and fixing its defects, and helping to answer to superior authorities and suppliers of the costs of training courses are some of the reasons for the necessity of identifying obstacles to the optimal implementation of the training evaluation process (Taheri, 2016). Thus, in the present research, we have tried to answer the question: "What are the obstacles to the optimal implementation of the educational evaluation process in the National Gas Company of Iran?"
Theoretical framework
Educational evaluation is a regular process of forming a value judgment about the quality of the educational program, making decisions regarding the improvement and modification of the educational program during future planning (Al-Mughairi, 2018). The purpose of educational evaluation is to provide appropriate information for decision-making; in other words, the results of the educational evaluation provide a set of appropriate information for making decisions regarding the continuation, change or termination of the educational program (Sadeghi et al, 2018). In this regard, there are several models each of which considers specific aspects of evaluation. Some models have focused their attention on evaluating learner behavior, educational materials or related methods. Another group of models emphasizes the importance of the role of evaluation in educational planning and tries to improve educational planning by using multiple models, and another group of models also emphasizes the importance of gathering information for decision-making (Taherkhani & Hamidi, 2020).
In relation to the subject of the research, Tarazi et al, (2020) in a research with the aim of identifying the criteria and components affecting the evaluation of the effectiveness of in-service training courses for the employees of Refah Karkaran Bank, considers the factors affecting the process of evaluating the effectiveness of the said courses include individual factors (emotions, awareness and cognition, behavior, physical changes and usefulness), group (emotions in the group, awareness and cognition in the group, behavior in the group and usefulness in the group), organizational (financial, efficiency, processes and resources) and social (customer, community development and business ethics). Urbancová et al, (2021) in research entitled "Effective educational evaluation: the role of influencing factors on evaluating the effectiveness of employee training" concluded that educational evaluation methods (self-evaluation and direct evaluation by supervisors and colleagues), feedback to employees, the size of the organization, and human and financial resources affect the process of evaluating the effectiveness of employee training. Al-Mughairi, (2018) also in his research entitled "Evaluation of training and development of employees: case study: a national oil and gas industry" states that the obstacles of the educational evaluation process include people without evaluation qualifications, use of inappropriate evaluation methods, low and limited cooperation of the managers of the organization and the lack of financial resources.
Methodology
The current research is practical in terms of purpose and nature, and from the point of view of data collection, it is based on the qualitative research approach and the focus group method. The field of research was Iran National Gas Company (headquarters companies and operational areas), and in this field, the participants included all the employees of the training and manpower training unit of Iran National Gas Company. The selection of the participants was based on the purposeful sampling method of the criterion type among the employees of the training and equipping of human resources unit of National Gas Company of Iran. The data was collected using the focal interview technique, and after completing 4 focal interviews, the level of data saturation was reached. In order to analyze the data, the theme analysis method was used.
Research findings
After conducting 4 focal interviews (including 20 people) with the employees of the Human Resources Training and Equipping Unit of Iran National Gas Company and analyzing the resulting data, 21 basic themes and 5 main themes were extracted, which include: individual barriers (insufficient participation of the organization's employees, lack of specialized knowledge in the organization's employees, lack of required skills in the organization's employees, insufficient knowledge and awareness of the organization's employees about the requirements of the educational evaluation process and incorrect implementation of the requirements of the educational evaluation process by the organization's employees), Organizational barriers (problems in the processes of the organization's human resources planning unit, problems in the processes of the organization's human resources training and equipping unit, problems related to organizational culture, problems related to the organization's human resources, limited credits and required budget, low interaction and cooperation of different units of the organization and lack of efficient and effective motivational systems in the organization), educational barriers (weakness of training course instructors and less and limited use of new and appropriate methods, models and indicators), managerial barriers (insufficient participation of managers, heads and supervisors of the organization, lack of required skills in managers, heads and supervisors of the organization, negative attitude of managers, heads and supervisors of the organization, low and limited support of managers, heads and supervisors of the organization, and incorrect implementation of the requirements of the evaluation process educational by the managers, heads and supervisors of the organization), and environmental barriers (lack of necessary and appropriate infrastructure and lack of mechanisms facilitating the educational evaluation process).
Conclusion
The present research was conducted with the aim of identifying obstacles to the optimal implementation of educational evaluation in the National Gas Company of Iran and providing solutions for its improvement. The results of this research are consistent with the findings of researchers such as Tarazi et al, (2020), Urbancová et al, (2021) and Al-Mughairi (2018). In explaining the findings of the research, it can be said that individual barriers, organizational barriers, educational barriers, managerial barriers and environmental barriers have caused the process of educational evaluation in Iran's National Gas Company not to be carried out optimally, and the expected results are not obtained from the training courses; therefore, it is necessary to think about improving the existing situation and thereby improve the quality of the educational evaluation process and consequently, the quality of training courses and their effectiveness, and in this way strengthen the skills and abilities of employees to perform their job duties and responsibilities. For this purpose, according to the findings, solutions have been identified to reduce the effects of obstacles and improve the educational evaluation process in the National Gas Company of Iran, such as including the index of the active participation of the organization's employees in the educational evaluation process in the annual performance evaluation form of the organization's employees in order to motivate the organization's employees to participate actively in the process of educational evaluation and etc. According to the results obtained from this research, it is suggested that in future researches, the obstacles of the educational evaluation process and providing improvement solutions in other organizations should be taken into consideration and compared with the results of the current research. Also, in future researches, the effect of each of these obstacles identified in the current research can be investigated separately on the process of educational evaluation. And finally, future researchers can conduct research similar to the current research in certain time intervals when the organization takes corrective measures, so that continuous monitoring can be done in this field.

کلیدواژه‌ها [English]

  • Staff Training
  • . Educational Evaluation
  • .Focus Group
  • .Barriers to implementation of evaluation
Ahangari, M., Torkzadeh, J., Mohammadi, M., Marzoghi, R., & Hashemi, S. (2019). Identifying the Components of Evaluating the Internal Effectiveness for Academic E-courses: Qualitative Study. Journal of Iranian Higher Education, 11(1):125-159. [In Persian]
Al-Mughairi, A. M. (2018). The evaluation of training and development of employees: The case of a national oil and gas industry. PhD Thesis, Brunel Business School, Brunel University.
Alias, S. A., Ong, M. H. A., Rahim, A. R. A., & Hassan, R. (2019). The Role of Training Design Factors in Influencing Training Effectiveness among Public Service Employees. International Journal of Academic Researchn Business and Social Sciences, 9(5), 898-913. doi: 10.6007/IJARBSS/v9-i5/6016
Ashofteh, H., & Orangian, E. (2021). Evaluating the effectiveness and calculating the rate of return on investment of training courses using Kirk Patrick and Phillips models. Management and Educational Perspective3(3), 143-179. [In Persian] dor: 20.1001.1.27169820.1400.3.3.6.4
Baniasadi, A., & Salehi, K. (2019). Introduction on the Principles and Process of Construction and Validation of the Interview Protocol. Higher Education Letter12(46), 177-203. [In Persian]
Bazargan, A. (2015). An introduction to qualitative and mixed research methods (Common approaches in behavioral sciences). Tehran: Didar. [In Persian]
Bazgir, T., Hejazi, A., & Hossein afshar, M. (2020). Determining effectiveness of On-the-job training courses on empowering primary school managers in Tehran. New strategies for teacher education, 6(10): 63-87. [In Persian]
EL Hajjar S. T., & Alkhanaizi M. S. (2018). Exploring the Factors That Affect Employee Training Effectiveness: A Case Study in Bahrain. SAGE Open.1-12. doi: 10.1177/2158244018783033
Esmaeili, Gh. (2015). Examining the views of teachers and managers about the effectiveness of in-service training. Master's thesis, Faculty of Psychology and Education, University of Tehran. [In Persian]
Ezati, M., Youzbashi, A., & Shateri, K. (2017). Assessing the Current Situation of Training Courses and Providing a Qualitative Model for Improving the Effectiveness of training courses (case study: State Tax Organization). Quarterly Journal of Training & Development of Human Resource, 4(12), 127-148. [In Persian]
Fan, H. (2020). Factors Affecting Training Effectiveness at Suning.com. Bachelor's thesis, Turku University of Applied Sciences.
Farnia, M., Malekiavarsin, S., & Farshbaf Joor, V. (2013). Examining the Effectiveness of Educational Courses Presented for the Agricultural and non-Agricultural Members of Cooperatives in the East Azerbaijan Province by the Use of Kirkpatrick Model. Co-Operation and Agriculture1(4), 63-84. [In Persian]
Fathi Vajargah, K. (2015). Planning in-service training for employees. Tehran: Humanities Research and Development Center. [In Persian]
Ganji, F. (2016). Investigating the application of the principles of adult education in the in-service training courses of teachers in the 9th district of Tehran. Master's thesis, Faculty of Psychology and Education, University of Tehran. [In Persian]
Hosseinpour, R., Rezayat, Gh. H., & Sayad Neghban, Gh. (2019). Designing a model for evaluating the effectiveness of educational courses and training of the military organization. Journal of Islamic Education, 27(44), 25-57. [In Persian] doi: 204848
Ibrahim, H., Mohd Zin, M. D. L., & Vengdasamy, P. (2020). The Influence of Individual Characteristics, Training Content and Manager Support on On-the-Job Training Effectiveness. Journal of Asian Finance, Economics and Business, 7(11), 499-506. doi: 10.13106/jafeb.2020.vol7.no11.499
Kodwani, A. D., & Kodwani, M. (2021). Exploring determinants of pre-training motivation and training effectiveness: a temporal investigation. Evidence-based HRM, 9(4), 321-337. doi: 10.1108/EBHRM-05-2020-0070
Mahadevan, A. (2019). Influence of training and development on employee performance in nutritional industry, Malaysia. International Journal of Education Learning and Training, 4(1). 1-10. doi: 10.24924/ijelt/2019.04/v4.iss1/01.10
Mohammadi, M. (2021). Measure The Effectiveness On-the-Job Training Courses (Case Study: Mazandaran Regional Water Company). Knowledge Retrieval and Semantic Systems, 8(27), 171-197. [In Persian] doi: 10.22054/jks.2020.48013.1257
Mohammadi, R., Khorsandi Yamchi, A., & Inanlo, M. (2019). Evaluating the effectiveness of in-service training for primary school teachers based on the Kirkpatrick model. Scientific Quarterly of School Management, 8(3), 371-433. [In Persian]
Mohanty, P. C., Dash, M., Dash, M., & Das, S. (2019). A study on factors influencing training effectiveness. Espacios, 40(2), 7-15.
Nguyen, A. (2020). In-Service Training Management-A Case Study in Vietnam. International Education Studies, 13(10), 1-7. doi: 10.5539/ies.v13n10p1
Paul, J. (2020). Identifying the Factors to Enhance Training Effectiveness: A Case Study of Kngy Teacher Volunteers, Myanmar. ABAC ODI JOURNAL VISION. ACTION. OUTCOME, 7(2), 1-12.
Payam, A., & Mirshah Velayati, F. (2019). Evaluating the effectiveness of training courses for employees (non-academic staff) of Humanities and Cultural Studies Research Institute based on ISO 10015. Journal of Applied Research in Management and Accounting, 5(18): 28-42. [In Persian]
Pfoser, S., Putz, L. M., & Jung, E. (2020). Recommendations for Human Resources Development in Danube Inland Ports. In International Conference on Dynamics in Logistics. doi: 10.1007/978-3-030-44783-0_1
Rama Devi, V., & Shaik, N. (2020). Evaluating training & development effectiveness - A measurement model. Asian Journal of Management Research, 2(1), 722-735.
Sabbaghian, Z., Akbari, S. (2014). Comprehensive organizational training with an adult education approach. Tehran: Humanities Research and Development Center. [In Persian]
Sadeghi, M. E., Erfanian Khanzadeh, H., & Hossein, V. (2018). Evaluation and assessment of effectiveness of specialized training courses of Iranian railways system based on Kerkpatrick’s Model. Iranian Journal of Engineering Education20(79), 43-62. [In Persian] doi: 10.22047/ijee.2019.151789.1586
Sahinidis, E., & Bouris, j. (2018). Employee Perceived training effectiveness relationship to employee attitudes. Journal of European industrial training, 32(1), 63-76. doi: 10.1108/03090590810846575
Sahni, J. (2020). Managerial Training Effectiveness: An Assessment through Kirkpatrick Framework. TEM Journal, 9(3), 1227‐1233. doi: 10.18421/TEM93-51
Taheri, M. (2016). Exploring and designing an executive model of organizational effectiveness: a study based on the theory of contexts. Quarterly Journal of Training & Development of Human Resources, 3(9), 137-161. [In Persian]
Taherkhani, M., & Hamidi, N. (2020). Evaluating the Effectiveness of In-Service Training Courses in Enhancing Staff Capacity of the Office of the Documentation and Property Administration of Qazvin Province Theme IX (Employee Empowerment) State Service Management Law. Journal of Development & Evolution Mnagement12(41), 21-36. [In Persian]
Tarazi, M., Parsa Moein, K., & Afkaneh, S. (2020). Identifying the Affecting Criteria and Components on the Effectiveness of in - service Training Courses for Employees of the Refah Bank. Career and Organizational Counseling12(42), 95-120. [In Persian] doi: 10.52547/jcoc.12.1.95
Urbancová, H., Vrabcová, P., Hudáková, M., & Ježková Petr˚u, G. (2021). Effective Training Evaluation: The Role of Factors Influencing the Evaluation of Effectiveness of Employee Training and Development. Sustainability, 13(5), 1-14. doi: 10.3390/su13052721