Request for Information: Provision of Program Evaluator for Program Duta Guru (PDG)

1. To assess the overall impact of the PDG programme, particularly on the improvement in STEM teaching quality, and student interest and performance in STEM subjects.
2. To evaluate the effectiveness of each programme component and how they contribute to the overall programme objectives and YP Education Pillar’s theory of change.
3. To assess the programme’s relevance to the needs of the Malaysian education landscape, teachers, students, and schools.
4. To benchmark the PDG programme against similar initiatives to identify the best practices and areas for improvement.
5. To gather feedback from key stakeholders (ministry, teachers, students, school leadership, and partners)
6. To identify challenges, gaps, and provide evidence-based recommendations to enhance programme design, implementation, outcomes, and long-term sustainability.

The selected evaluator will be expected to undertake the following:

1. Desk Review
   • Review national education blueprint, programme documents, reports, monitoring data, training materials, and any available baseline data.
   • Assess the programme’s theory of change, and key performance indicators (KPIs).
     
     
2. Data Collection and Analysis
   • Collect quantitative and qualitative data to measure and analyse, but not limited to, the following:
     • The programme relevance in meeting the needs of the nation and national aspiration for STEM education
     • Changes in teacher competency and confidence in teaching STEM.
     • Availability and use of STEM resources and equipment in schools.
     • Changes in student interest, awareness, and participation in STEM activities.
     • Trends in student performance in STEM subjects (where school-level data is available).
   • Conduct interviews, focus group discussions (FGDs), and/or surveys (based on suitability) with, but not limited to:
     • Programme strategic partner – Ministry of Education
     • Programme implementation partners – Teach for Malaysia, Petrosains
     • Students of DG teachers and those who participated in STEM enrichment activities.
     • School administrators and leadership e.g. Pembimbing Program Duta Guru, Penyelaras STEM Negeri
   • Propose a robust sampling strategy that ensures demographic representation (e.g., rural vs. urban, different states), and compare a controlled sample (teachers/schools/students who participated in the PDG intervention) with a non-controlled sample (those who did not participate) to assess differences in outcomes across both groups.
   • Enhance the current Student Motivation Survey
   • Compare current programme outcomes to baseline or pre-intervention data.
   • Benchmark the programme with similar initiatives by other local or international organisations.
     
     
3. Evaluation of Program Impact and Effectiveness
   • Assess the effectiveness of the teacher training programme to contribute to improved teaching skills and student’s interest.
   • Assess how effectively the programme’s components are aligned and contributing to improved teaching skills and students’ interest.
   • Evaluate the relevance of programme activities to local/national STEM education needs.
   • Identify successes, challenges, and lessons learned.
   • Assess the sustainability of programme outcomes (e.g., capacity of schools and teachers to continue STEM activities post-program).
     
     
4. Recommendations and Strategic Insights
   • Provide practical, evidence-based recommendations to improve:
     • Teacher training content, delivery methods, and follow-up support.
     • School-level STEM resources and learning environments.
     • Student engagement strategies.
     • Monitoring and evaluation processes for future program cycles.
   • Recommend strategies to enhance long-term impact and scalability.
     
     
5. Final Report and Presentation
   • Prepare a comprehensive evaluation report, including findings, analysis, case studies, and actionable recommendations.
   • Present key findings and recommendations to Yayasan PETRONAS’ leadership and program team.

The evaluator is expected to deliver the following within 5 months:

1. Inception Report, including evaluation framework, proposed methodology, data collection tools, and work plan.
2. Interim Progress Report
3. Draft Evaluation Report for review and feedback.
4. Final Evaluation Report and Presentation of Key Findings to YP