Home / Courses / NGO Management and Policy Development
NGO Management and Policy Development · MSD2740

Impact Evaluation and Casual Inference

The science of impact evaluation is a rigorous field that requires thorough knowledge of the area of work, simple to complex study designs, as well as knowledge of advanced statistical methods for causal inference. Many programme funders and managers want to know whether their programmes have produced measurable impact. They want to be able to measure that impact and express it in numbers.

The key focus of impact evaluation is attribution and causality – that the programme is indeed responsible for the observed changes reported. To achieve this, a major challenge is the possibility of selecting an “untouched” comparison group and using the appropriate statistical methods for inference.

Register Online Face to Face Registration Download Course Details
Impact Evaluation and Casual Inference
Online fee from
$200 USD
Standard: $300 · Save $100
Course Outcomes

Expected learning outcomes

  • Introduction to impact evaluation
  • The need for and culture of impact evaluation
  • Programme indicators
  • Introduction to programmes and logic models
  • What really is impact – efficiency versus effectiveness
  • Counterfactuals – looking for a suitable control
  • Experimental and quasi-experimental study designs
  • Research ethics in IE and design implications
  • Causality
  • Attribution and research validity in impact evaluation
  • Potential biases in impact evaluation
  • Design and statistical methods for controlling for confounders
  • Statistical techniques for causal inference
Curriculum

Course modules and outline

  • We will review the what, how, and why of impact evaluation, with particular emphasis on the role of control groups, pre-&-post measurement, and covariate data to define counterfactual scenarios (including formal definition of all terms).
  • We will review detailed examples of the main methods for evaluation - randomized experiments and quasi-experiments (including natural experiments, and matching methods) - with a clear description of the pros and cons of each method.
  • We will work in groups to develop a plan for evaluating some real life projects. The emphasis will be on defining the counterfactual situation and identifying potential confounders. 
  • We will do stylized evaluations in class and in evenings using STATA so we can apply the concepts. 
  • Finally, we will place econometric evaluations within the broader context - how can we move beyond press-button evaluations; what do we do under time, resource and data constraints; when and where should we rely on theory-based evaluations and mixed methods to complement and/or substitute for econometric evaluations.
  • Participants will have to think about and articulate a solution to the evaluation problem in all three aspects of the empirical work - study design, data collection, and analysis.
Target Audience

Who should attend?

  • Epidemiologists
  • Biostatisticians
  • Programme managers
  • Programme funders
  • Mid-level to senior researchers
  • Postgraduate students
  • Consultants
  • Programme technical experts
Why Attend

Key course benefits

Practical capacity building approach
Designed for government, NGOs and public institutions
Real-world African case studies
Certificate of completion
Applicable tools and templates
Interactive facilitation and exercises
Course Enquiry

Need more information?

Ask Magna Skills about this course

Use the PHPMaker enquiry form to request a quotation, proposal letter, invoice, group training package, online access, or face-to-face training arrangement.

Make Course Enquiry WhatsApp Us

Debug

sql: SELECT COUNT(*) FROM `userlevels` WHERE `userlevelid` = -2, executionMS: 0.00056099891662598

sql: SELECT `userlevelid`, `userlevelname` FROM `userlevels`, executionMS: 0.00044512748718262

sql: SELECT COUNT(*) FROM `userlevelpermissions` WHERE `userlevelid` = -2, executionMS: 0.00079798698425293

sql: SELECT `tablename`, `userlevelid`, `permission` FROM `userlevelpermissions` WHERE `userlevelid` IN (-2), executionMS: 0.0028719902038574

sql: SELECT c.*, cc.Category_Name, cc.Summary AS CategorySummary, cc.Category_Description FROM courses c LEFT JOIN course_categories cc ON cc.id = c.Category WHERE c.id = 2740 LIMIT 1, executionMS: 0.00093698501586914

sql: UPDATE courses SET Views = IFNULL(Views,0) + 1 WHERE id='2740', executionMS: 0.0018110275268555

sql: SELECT * FROM course_modules WHERE CourseID = 2740 AND Status IN ('Active','1') ORDER BY SortOrder, id LIMIT 20, executionMS: 0.00065302848815918

sql: SELECT * FROM course_highlights WHERE CourseID = 2740 AND Status IN ('Active','1') ORDER BY SortOrder, id LIMIT 8, executionMS: 0.00035500526428223

sql: SELECT * FROM course_learning_outcomes WHERE CourseID = 2740 AND Status IN ('Active','1') ORDER BY SortOrder, id LIMIT 10, executionMS: 0.00030112266540527

sql: SELECT * FROM course_target_audience WHERE CourseID = 2740 AND Status IN ('Active','1') ORDER BY SortOrder, id LIMIT 8, executionMS: 0.00026798248291016

sql: SELECT * FROM resources WHERE CourseID = 2740 AND Status IN ('Published','Active','1') ORDER BY id DESC LIMIT 5, executionMS: 0.00040793418884277

sql: SELECT * FROM reviews WHERE CourseID = 2740 AND CanPublish = 1 AND Status IN ('Approved','Published','1') ORDER BY id DESC LIMIT 4, executionMS: 0.00042986869812012

sql: SELECT * FROM gallery_albums WHERE CourseID = 2740 AND Status IN ('Published','Active','1') ORDER BY IsFeatured DESC, AlbumDate DESC, id DESC LIMIT 3, executionMS: 0.00079083442687988

sql: SHOW COLUMNS FROM `venues` LIKE 'id', executionMS: 0.0022480487823486

sql: SELECT v.*, v.`id` AS VenueKey, (SELECT COUNT(*) FROM apply a WHERE a.Venue = v.`id` AND a.Course_Title = 2740) AS CourseApplications, (SELECT COUNT(*) FROM apply a WHERE a.Venue = v.`id`) AS TotalApplications FROM venues v ORDER BY CourseApplications DESC, TotalApplications DESC, v.Venue ASC, executionMS: 1.5213420391083

sql: SHOW COLUMNS FROM `courses` LIKE 'Category', executionMS: 0.00067687034606934

sql: SELECT id, Course_Title, Course_Code, Short_Description FROM courses WHERE Category = 815 AND id <> 2740 ORDER BY id DESC LIMIT 6, executionMS: 0.00073504447937012

sql: SELECT COUNT(*) FROM apply WHERE Course_Title = 2740, executionMS: 0.083044052124023

sql: SELECT COUNT(*) FROM enroll WHERE Course = 2740, executionMS: 0.0005190372467041

sql: SELECT ROUND(AVG(Rating),1) FROM reviews WHERE CourseID = 2740 AND CanPublish = 1, executionMS: 0.0003199577331543

sql: SELECT COUNT(*) FROM course_modules WHERE CourseID = 2740, executionMS: 0.00024986267089844

sql: SELECT COUNT(*) FROM course_lessons cl INNER JOIN course_modules cm ON cm.id = cl.ModuleID WHERE cm.CourseID = 2740, executionMS: 0.00027203559875488

sql: SELECT COUNT(*) FROM course_highlights WHERE CourseID = 2740, executionMS: 0.00017786026000977

sql: SELECT COUNT(*) FROM course_learning_outcomes WHERE CourseID = 2740, executionMS: 0.00014495849609375

sql: SELECT COUNT(*) FROM course_target_audience WHERE CourseID = 2740, executionMS: 0.00014805793762207

sql: SELECT COUNT(*) FROM resources WHERE CourseID = 2740, executionMS: 0.00015783309936523

sql: SELECT COUNT(*) FROM reviews WHERE CourseID = 2740, executionMS: 0.00013518333435059

sql: SELECT COUNT(*) FROM gallery_albums WHERE CourseID = 2740, executionMS: 0.0001380443572998

sql: SELECT COUNT(*) FROM course_enquiries WHERE CourseID = 2740, executionMS: 0.00012397766113281