Appendix B: Evaluation methodology

The following section describes the evaluation methodology including key informant interviews, case studies, and the document and data review.

1. Key Informant Interviews

Interviews were conducted with 38 key informants between April and July 2022 including 20 Provincial and Territorial representatives, 11 service providers representing NGOs across the country, as well as 7 Justice Canada Departmental representatives. Interviews were conducted via videoconference in a semi-structured format following an interview guide tailored to each respondent group. Key informants were provided with the interview guide in advance and given the option to participate in the interview in the Official Language of their choice. The following table provides more details on the individuals interviewed.

Table 4: Overview of Key Informant Interviews
Key Informant Group Group Description # of Key Informants Interviewed # of Interviews
PT Family Justice Program Representatives At least one representative from each Province/Territory was interviewed. Additional informants were interviewed when recommended due to the division of roles and areas of expertise within PT Programming. This resulted in multiple representatives from the Northwest Territories, Quebec, Manitoba, and Alberta. Representatives included managers, program coordinators, executive directors, program advisors and analysts as well as legal positions including counsel, Crown counsel, senior solicitors, and children’s lawyers. 20 18
NGOs that Provide Family Justice Services Representatives from PLEI organizations across the country as well as not-for-profit organizations that provide family justice services such as supervised parenting and information for self-represented litigants were interviewed. Representatives were at the executive director and manager levels. 11 10
Justice Canada Departmental Representatives Justice Canada representatives involved in the design and delivery of the CFJF such as representatives from the Innovations, Analysis, and Integration Directorate and Family Law and Youth Justice Policy Section were interviewed. Representatives were at the director general, director, manager, senior program and policy analyst, and counsel levels. 7 5
Total 38 33

The scale used to summarize quantitative responses from key informants is as follows: a few = <25% of respondents; several = 25-49% of respondents; half = 50% of respondents; a majority = 51-75% of respondents; most = 76-90% of respondents; and almost all = >90% of respondents.

2. Case Studies

Three case studies were conducted of CFJF projects. Each case study addressed a different theme:

  1. Diverse and underserved populations;
  2. Implementation of Divorce Act amendments; and
  3. Supporting the well-being of family members engaging in the family justice system. Data collection for each case study included interviews with project stakeholders and a document and file review. Case studies were summarized in individual case study reports, which were reviewed and validated by selected organizations.

Details about each case study and their approach are outlined below:

Case Study #1. British Columbia Ministry of Attorney General, Family Justice Services Division: “Online Parenting After Separation for Indigenous Families.” (British Columbia)
Case Study Topic Diverse and underserved populations
Project Funding Recipient Organization The Family Justice Services Division within the Justice Services Branch of the British Columbia Ministry of Attorney General provides information, dispute resolution, and mediation services to parents undergoing separation and divorce to help them understand and resolve their parenting and support issues.
CFJF Funding Amount $103,000.00
Years 2017-18 to 2019-20
Project Objectives The overall goals of the project were to develop, implement, and evaluate a culturally sensitive and appropriate online version of the Parenting After Separation program for Indigenous parents in British Columbia. The project aimed to adapt content to consider the unique realities of Indigenous peoples, which attracts more Indigenous parents to the course and educates them in a more engaging and meaningful way. The project also aimed to increase access to family justice for Indigenous parents by informing them of, and encouraging them to use, other Family Justice Services Division services such as mediation.
Case Study Methodology This case study included interviews with 3 representatives including 1 project lead, and 2 project staff involved in the delivery of the project; a review of documents and files associated with the project including: the project funding agreement with Justice Canada, quarterly research briefs, and a project evaluation report; and a review of websites and other documents in open-domain such as the Family Justice Services Division website, news articles, and the course materials and videos. Data was compiled, analyzed, and summarized in a Case Study Report.
Case Study #2. Luke’s Place Support and Resource Center for Women and Children: “Building Awareness about Divorce Act Changes Impacting Women.” (Ontario)
Case Study Topic Implementation of Divorce Act amendments
Project Funding Recipient Organization Luke’s Place is an award-winning non-profit organization/center of excellence based in Durham Region, Ontario that works with women subjected to abuse to support them, their children, and their communities through the family law process.
CFJF Funding Amount $141,775.00
Years 2021-22 to 2022-23
Project Objectives This project aims to serve the needs of diverse and underserved families experiencing separation and divorce by providing new legal tools for women and their communities related to changes to the Divorce Act. The organization will provide training to service providers on these changes, focusing on family violence and post-separation parenting arrangements. The project will also include a public legal education campaign to increase awareness about the changes to the law as they affect women leaving abuse.
Case Study Methodology This case study included an interview with the Provincial Program Manager & Digital Communications Consultant at Luke’s Place; a review of documents and files associated with the project including project overview, summaries, annual reports, toolkits, online course/training materials; and a review of websites and other documents in open domain regarding the recipient organization. Data was compiled, analyzed, and summarized in a Case Study Report.
Case Study #3. Le Petit Pont: "Let's equip parents for the future of children and our community." (Quebec)
Case Study Topic Supporting the well-being of family members engaging in the family justice system.
Project Funding Recipient Organization Located in Saint-Hyacinthe and Longueuil, Quebec, Le Petit Pont is an independent community organization supporting the creation and maintenance of the parent/child bond. It offers supervised visitation services, as well as information and support services for families in the context of separation and conflict.
CFJF Funding Amount $246,467.00
Years 2017-18 to 2020-21
Project Objectives The objective of the project was to carry out and evaluate parental, family or conflict coaching meetings with parents and children allowing to observe and analyze the difficulties that arise in the context of separation or divorce, and to propose concrete means and provide follow-up. The project aimed to facilitate the adaptation of the family to the context of separation and divorce, in the interest of the children. Parental coaching focuses on the well-being of the family to develop ways that can prevent conflict rather than trying to heal families in the aftermath of conflict.
Case Study Methodology This case study included interviews with 2 representatives of the organization; a review of project documents including the funding agreement, a field visit report prepared by Justice Canada, the final project report, a review engagement report, a survey of the coaching services, the presentation of the evaluation results, promotional tools; a review of websites and other documents in open domain regarding the project. Data was compiled, analyzed, and summarized in a Case Study Report.

3. Document and Data Review

A variety of documents and data were reviewed as part of the CFJF evaluation including CFJF planning and reporting documents (e.g., PT and project funding contribution agreements and final reports), family justice related survey summaries and databases, as well as external research reports and statistics related to family justice needs and emerging trends. Survey data from two Justice Canada surveys was analyzed and summarized: 1) the Parent Education Program Survey; and 2) the Mediation Services Program Survey:

Table 5: Parent Education Program Survey – Respondents by PT Program
Region/Parent Education Program (N=10,083) # %
Alberta: Parenting After Separation 7,519 75%
Saskatchewan: Parenting After Separation and Divorce 1,072 11%
Newfoundland and Labrador: Parent Information 604 6%
Manitoba: For the sake of the children 488 5%
Prince Edward Island: Positive Parenting from Two Homes 239 2%
New Brunswick: For the sake of the children 141 1%
Not specified 14 < 1%
Nunavut: Parent Mediation 3 < 1%
Nova Scotia: Parent Information Program 3 < 1%
Total 10,083 100%
Table 6: Mediation Services Program Survey – Respondents by PT Program
Participants by Region/Family Mediation (N=247) # %
Newfoundland and Labrador: Family Justice Services 142 57%
Alberta Family Mediation 49 20%
Manitoba Mediation Services 41 17%
Not specified 7 3%
Prince Edward Island: Mediation Services 4 2%
Nunavut Family Mediation 4 2%
Total 247 100%