ARCHIVED - Evaluation of The Prion Diseases Program
Annexes
Annex A
Steering Committee
The members of the Steering Committee for the evaluation are listed below.
- Graham Tipples Director, Surveillance and Reference Services
- Hank Krueger Director, Business Operations, Public Health Agency of Canada
- Stephanie Czub Head, National BSE Reference Centre, CFIA
- Jane Buxton Physician Epidemiologist, BCCDC
- Jan Trumble-Waddell Senior Advisor, Chief Public Health Officer, Public Health Agency of Canada
Annex B
Evaluation Framework
Evaluation Issues | Evaluation Questions | Indicators | Data Sources |
---|---|---|---|
1. Relevance | 1.1 Is there a clear and relevant vision and are there clear objectives for activities under PDP? |
|
|
1.2 How has the mandate changed since program inception and what internal and external factors have contributed to the identified changes? |
|
|
|
1.3 Does the initiative continue to be consistent with the PHAC mandate and government-wide priorities? |
|
|
|
1.4 Is there a continued need for the program? Do current client needs and risk environment indicate a continued need? |
|
|
|
2. Success | 2.1 Are activities being implemented as planned and producing the expected outputs? (See Logic Model) |
|
|
2.2 Have the expected outcomes and reach been achieved through program activities? (See Logic Model) |
|
|
|
2.3 Have there been any unexpected outcomes? |
|
|
|
3. Design and Delivery | 3.1 Are there appropriate management and decision-making structures in place to meet the objectives? |
|
|
3.2 Are there effective partnerships / linkages to external programs in place and do they support the delivery of the program? |
|
|
|
3.3 Has there been an assessment and strategic use of lessons learned? |
|
|
|
3.4 Are the resources adequate to achieve the expected outputs and outcomes? |
|
|
|
3.5 Are there alternative means of achieving these same program objectives that might be more efficient or effective? |
|
|
Title | Date | Author |
---|---|---|
Program Documents | ||
Project Management Plan: Capacity to conduct surveillance and laboratory investigation of prion diseases: epidemiology and surveillance | 1998 | LCDC |
Project Management Plan: Winnipeg Human and Animal Prion Reference Laboratory | 1998 | LCDC |
National Microbiology Laboratory, Business Plan 06/07 HGPD | Apr 13 2006 | PDP |
Annual Report Template for National Microbiology Laboratory Programs Reporting Period April 1 2006 – March 31 2007 | 2007 | PDP |
Annual Report Template for National Microbiology Laboratory Programs Reporting Period April 1 2005 – March 31 2006 | 2006 | PDP |
Annual Report / Business Plan for National Centres HGPD Program, Reporting Period April 1 2005 – March 31 2006 Evaluation Form | 2006 | PDP |
Canadian Public Health Laboratory Network, Reference Centre Advisory Subcommittee: Annual Report/Business Plan for National Centres, Evaluation Form | ||
PDP Organization Chart | Jan 19 2007 | PDP |
The Canadian Creutzfeldt-Jakob Disease Surveillance System (CJDSS): Purposes, Functions and Basic Results (presentation) | Nov 2006 | M Coulthart |
Report: UK Prion Laboratory Scan | Oct 1998 | M Coulthart |
EUROCJD Surveillance Audit Template | Mar 2008 | M Coulthart |
International Audit of the National Canadian CJD Surveillance System | Apr 2005 | University of Edinburgh |
Canadian Creutzfeldt-Jakob Disease Surveillance System, Five-Year Cumulative Report 1998-2003 | Apr 2005 | PHAC |
PHAC Documents | ||
Reports on Plans and Priorities | Various | PHAC |
Departmental Performance Reports | Various | PHAC |
Reference Documents | ||
WHO Guidelines on Tissue Infectivity Distribution in Transmissible Spongiform Encephalopathies http://www.who.int/bloodproducts/TSEPUBLISHEDREPORT.pdf |
2006 | WHO |
WHO Manual for Surveillance of Human Transmissible Spongiform Encephalopathies, including Variant Creutzfeldt-Jakob Disease http://whqlibdoc.who.int/publications/2003/9241545887.pdf | 2003 | WHO |
Other | ||
Health Canada Policy on the Approval and Management of Adjunct Professorships | 2007 | HC |
A special meeting of the Steering Committee was held on September 12, 2008 to elicit expert input into the key areas of success and relevance of the PDP. The objectives of the session were to:
- provide expert opinion on the continued need for the Prion Diseases Program (PDP) within PHAC, given client needs and the current risk environment;
- provide expert opinion on the degree of Program success achieved to date in the areas of surveillance, reference services and research; and
- discuss future directions that may guide PDP design going forward.
The following are the key program success and opportunities for improvement that were identified during the workshop discussions.
Successes
- The CJD Surveillance System appears to be effective, finding the expected number of cases when compared to international benchmarks. The Canadian system compares favourably to the European model and is more comprehensive than the US system.
- While PHAC involvement in primary diagnosis and data collection of disease surveillance is unique with respect to human prion diseases, the rarity and specialized expertise required to diagnose indicates a need for ongoing federal involvement.
- Reference services appear to be fulfilling the required functions with good high quality work and ISO Accreditation in place.
- Quality research is taking in place evidenced by peer-reviewed publications, and other outputs.
- It is viewed as very important to maintain research capacity to ensure expertise within PHAC.
- Collaborations with other government departments and other organizations on research are effective.
Opportunities for Improvement
- Surveillance system could be making better use of data in terms of publishing and sharing.
- There is a need for the surveillance system to become better linked with provinces and territories.
- The Program relies heavily on a single individual and succession planning should be considered.
- Improvements (e.g. quicker turnaround times, new tests, better integration, etc) in the reference services could be made.
- Productivity of the PDP research activities is less than other NML programs in terms of peer reviewed publications.
- The research activities could be more clearly linked with the PHAC mandate, research priorities developed and promulgated. Research activities could be better integrated with the CJDSS.
- The recent relocation of the basic pathobiology research out of the PDP raises questions of integration. Other mechanisms may need to be considered to ensure alignment of research priorities.
- Stable funding for research needs to be maintained.
Annex G
Activities and Outputs Identified in Annual Planning and Reporting
Activity, Outputs | Status | Source |
---|---|---|
CJDSS | ||
A. CJDSS Operations | ||
Core Activities:
|
Ongoing annually | CJD-SS cumulative report pg 9, 32 |
|
Ongoing annually | CJD-SS cumulative report pg 8 |
|
Ongoing annually | CJD-SS cumulative report pg 9 |
|
Ongoing | CJD-SS cumulative report pg 39 |
|
Published In progress Published | C.3.2. Abstracts 2005 CJD-SS cumulative report pg 14, 40 Annual Report Template 05-06 – Coulthart pg 24 |
|
Ongoing annually | CJD-SS cumulative report pg 8 |
Non-core Activities:
|
Incomplete to date | International Audit 2005 – pg 2 |
|
In progress | CJD-SS cumulative report pg 39 |
|
In progress | NML Annual Report 2007-2008, Module B: Protocol revision is in progress; not yet submitted to Health Canada REB |
B. Reference services | ||
Core Activities:
|
Ongoing, annually “Commended” |
CJD-SS cumulative report pg 28 International Audit 2005 pg 3 |
Non-core Activities:
|
In progress | Annual Report Template 05-06 Coulthart pg 20 |
|
Incomplete | Annual Report Template 05-06 Coulthart pg 22 |
|
In progress | CJD-SS cumulative report pg 11, 27 |
|
Done | Annual Report Template 08-09 p.22 confirm when it was achieved |
|
Incomplete | Annual Report Template 05-06 Coulthart pg 22 |
C. Advice and education | ||
Core Activities:
|
Ongoing | CJD-SS cumulative report pg 39 |
|
Ongoing | CJD-SS cumulative report pg 21 |
|
Ongoing | PHAC CJD website lists 1-800. NML Annual Report 2005-2006 and 2006-2007 both indicate the provision of 1-800 services |
|
Ongoing | CJD-SS cumulative report pg 40 |
Technical Research in Prion Diseases | ||
Core Activities:
|
Published Complete | C.3.2 Abstracts 2005 |
|
Complete | |
|
Published | C.3.2 Abstracts 2006 |
|
Complete | NML Annual Report 2008-2009, Module D – S. Booth, Project Title: Biomarker discovery for the diagnosis of prion diseases. |
|
Published Done | C.3.1 List of Peer Reviewed Publications |
Non-core Activities:
|
Documentation not found | |
|
Done | Director M. Coulthart was a founder of PrioNet (PrioNet website) |
|
Done | M. Coulthart and S. Booth are Full Scientific Members |
Pathobiology Research in Prion Diseases | ||
|
In Progress | NML Annual Report 2008-2009 Module D – S. Booth, Project Title: Identification of MiRNA Driven Regulatory Circuits Involved in Prion-Induced Neurodegeneration |
|
In Progress | NML Annual Report 2008-2009 Module D – S. Booth, Project Title: The use of proteomics for surrogate markers of prion infection |
|
Documentation not found | |
|
In Progress | NML Annual Report 2008-2009 Module D – D. Knox, Project Title: A Genetic “Knock-Down” Approach to Identify Host Cellular Factor Essential for Infectious Agent Replication and Pathogenesis |
|
In Progress | NML Annual Report 2008-2009 Module D – S. Booth, Project Title: Investigation of protein - protein interactions from scrapie infected mice brain tissue using NAPPA |
|
In Progress | NML Annual Report 2007-2008 Module D – D. Knox, Project Title: The Identification of Molecular Biomarkers in Bovine Urine Sept 2008 – news story re: success in the project |
|
NML Annual Report 2006-2007 Module B Manuscript in preparation describing results of biochemical and genetic studies of Canadian-born cases of BSE, 2003-2008 (Poster presented at PrioNet Canada annual scientific meeting (Toronto, Ontario Feb 2008) Technical plan under development for genetic epidemiology studies of sporadic CJD |
|
|
Done | NML Annual Report 2006-2007 Module D (S. Booth) Title: Dissection of the molecular pathways leading to neuronal cell death in prion induced neurodegeneration |
Goal#1 Develop an enhanced public health network for human prion diseases in Canada, incorporating the Canadian Creutzfeldt-Jakob Disease Surveillance System (CJDSS). | ||
---|---|---|
Activities / Outputs | Status | Source |
1.1 Complete the establishment of an integrated PHAC Prion Diseases Program, and its management transition from CIDPC to NML by: | ||
|
Done | 2006-07 NML Business Plan completed |
|
In progress | NML Annual Report 2007-2008 Module B: Staffing and office space issues partially resolved |
|
Done | NML Annual Report 2007-2008 Module B |
1.2 Continue operations of the CJDSS, to detect, characterize and report all cases of human prion diseases in Canada through: | ||
|
Done | NML Annual Report 2007-2008 Module B |
|
Done | NML Annual Report 2007-2008 Module B |
|
Done | NML Annual Report 2007-2008 Module B |
|
Done | NML Annual Report 2007-2008 Module B |
1.3 Update and reconstitute the study protocol for CJDSS by: | ||
|
Done | NML Annual Report 2007-2008 Module B |
|
In progress | Protocol revision is in progress; Re-design of questionnaire is in progress |
|
In progress | NML Annual Report 2007-2008 Module B: not yet submitted to Health Canada REB. |
1.4 Improve linkages and communication between CJDSS and provincial and regional public health authorities by: | ||
|
In progress | NML Annual Report 2007-2008 Module B: Federal/Provincial sharing of personal health information in relation to CJD has been discussed during drafting of PHAC legislation and regulations |
|
In progress | NML Annual Report 2007-2008 Module B: Discussion with Chief Medical Officers of Health continues |
1.5 Conduct publication, outreach and education activities for human prion diseases by: | ||
|
In progress | NML Annual Report 2007-2008 Module B: Several peer-reviewed manuscripts describing 10-year findings of CJDSS are in development |
|
In progress | NML Annual Report 2007-2008 Module B: Half-day information session successfully conducted at McMaster University, April 20 2007; return invitation has been extended for Fall 2008 |
|
In progress | NML Annual Report 2007-2008 Module B |
|
In progress | NML Annual Report 2007-2008 Module B: Connection with CJD Foundation established through presentation at CJD2007 conference in Vancouver November 2007; invited for return engagement at CJD2008, Washington DC July 2008 |
|
Ongoing | NML Annual Report 2007-2008 Module B: Numerous (>10) media interviews conducted |
1.6 Provide expert consultation and advice on risks of human prion diseases in Canada by: | ||
|
Ongoing | NML Annual Report 2007-2008 Module B: External consultations provided as needed on CJD infection-control questions to hospital-based stakeholders Presentation delivered to Infection Control Practitioners conference (Sudbury, March 2008) Internal consultations provided as needed for CJD-related issues such as F/P/T information sharing |
|
In progress | NML Annual Report 2007-2008 Module B: Attended and presented at scientific conferences (EUROCJD May 2007; CJD2007 November 2007; PrPCanada February 2008) Continued participation on APRI Surveillance and Control Advisory Committee; CSA prion decontamination standards committee |
Goal#2 Contribute to a reduction in impact of human prion diseases through laboratory reference services for the surveillance and clinical investigation of human prion diseases. | ||
Activities / Outputs | Status | Source |
2.1 Maintain and improve service delivery for existing laboratory testing platforms for CJD by: | ||
|
Ongoing | NML Annual Report 2007-2008 Module B: Full reference services offered for biochemical, molecular genetic and neuropathology analyses (see Section C.1.2 for statistics) |
|
In progress | NML Annual Report 2007-2008 Module B: Technical validation of CSF tau, P-tau and S100B protein assays complete; test deployment is planned for 2008-09 |
|
In progress | NML Annual Report 2007-2008 Module B: Technical validation study of PRNP sequencing from formaldehyde-fixed brain tissues is ongoing |
|
In progress | NML Annual Report 2007-2008 Module B: Methods for biochemical subtyping of disease-associated prion protein in human brain tissue have been acquired and validated using a proficiency panel of previously typed materials |
|
In progress | NML Annual Report 2007-2008 Module B: ISO 17025 accreditation was achieved for human PRNP sequencing (SCC audit: Winter 2008) |
|
Ongoing | NML Annual Report 2007-2008 Module B: Advice is provided to physicians on request as needed, regarding optimal use of clinical testing services for CJD |
2.2 Develop "next-generation" assay platforms for known and candidate biological markers of clinical-stage prion disease by: | ||
|
In progress | NML Annual Report 2007-2008 Module B: Methodology and instrumentation for fluorescence-based quantitative Western blotting have been acquired Technical plan for mass spectrometry-based protein marker assays developed |
|
In progress | NML Annual Report 2007-2008 Module B: Technical plan to acquire recently developed technologies for ultrasensitive assays of disease-associated prion protein in body fluids under development |
Goal#3 Improved understanding of the biology of prion diseases and their infectious agents. | ||
Activities / Outputs | Status | Source |
3.1 Continue studies of genomics, proteomics, cell biology, strain typing and infectivity in prion disease models, including gene expression in animal models of TSE. | In progress (June 2004- Dec 2008) | NML Annual Report 2006-2007 Module D (S. Booth) Title: Primary transmission of BSE, CJD, and CWD into mice; strain-typing and model development |
3.2 Undertake transmission studies of Chronic Wasting Disease (CWD) to nonhuman primates, to assess risk and determine characteristics of possible human forms of CWD. | Discontinued | NML Annual Report 2007-2008: Module B: Active participation in this long-term project discontinued due to loss of PHAC BSE Research Program funding |
3.3 Continue transmission studies in mice of Canadian BSE, vCJD and CWD cases to establish and study rodent models of forms of prion disease important in Canadian public health and publish a related manuscript. | In progress | NML Annual Report 2007-2008: Module D (S. Booth) Title: Biomarker discovery for the diagnosis of prion diseases |
3.4 Continue studies of novel preclinical biomarkers for prion disease by developing and applying cutting-edge proteomic and biochemical assay platforms and performing genomic analysis of cells that act as reservoirs of prion infectivity. | In progress | NML Annual Report 2007-2008: Module D (S. Booth) Title: Identification of MiRNA Driven Regulatory Circuits Involved in Prion-Induced Neurodegeneration |
3.5 Continue studies of genetic epidemiology of human and animal prion diseases and publish related results and case reports. | Done | PDP Publication list |
Outcomes | Findings |
---|---|
Creutzfeldt-Jakob disease surveillance system (CJDSS): | |
Assessment and mitigation of risks to Canadians from prion infection through blood, food, tissues, organs, medical procedures and dentistry, by performing active surveillance for all forms of human prion diseases (CJD) in Canada. |
|
Technical research in prion diseases | |
Development of faster, simpler, more economical and more accurate methods and strategies for detection and diagnosis of prion diseases, to improve the effectiveness of CJD surveillance, prevention and control |
|
Improved understanding of prion-transmission risks in Canada. |
|
Strengthening of Canadian capacity for collaborative prion disease research, to deal more effectively with emerging challenges to human and animal health on national and international levels |
|
Pathobiology research in prion diseases | |
Contribute to enhanced scientific understanding of basic biological mechanisms, processes and behaviour of prions and prion diseases, to support and improve Canadian capacity for their diagnosis, treatment, surveillance, risk assessment, prevention and control |
|
Outcomes | Findings |
---|---|
Develop an enhanced public health network for human prion diseases in Canada, incorporating the CJDSS |
|
Provide laboratory reference services for surveillance and clinical investigation of human prion diseases |
|
Improved understanding of the biology of prion diseases and their infectious agents |
|
2. Outcomes Related to PDP Logic Model
Outcomes | Findings |
---|---|
Short Term Outcomes | |
Understanding of incidence and diversity of human prion diseases in Canada |
|
Timely intervention for CJD-related health events |
|
Expert technical support for investigation of suspected CJD |
|
Improved physician awareness of CJD |
|
Improved scientific understanding of prion diseases |
|
New opportunities for technical improvements |
|
Long Term Outcomes | |
Effective, active surveillance and public health intervention for all human prion diseases in Canada |
|
Improved awareness of CJD |
|
Dissemination of pathobiology research |
|
Technical improvements |
|
Page details
- Date modified: