Language selection

Search

Horizontal Evaluation of the Canadian Shellfish Sanitation Program
Final Report
Project number 96744
June 9, 2022

Horizontal Evaluation of the Canadian Shellfish Sanitation Program
(PDF, 2.4 MB)

Table of contents

  1. 1.0 Evaluation context
    1. 1.1 Objectives and scope
  2. 2.0 Program context
    1. 2.1 Program resources
    2. 2.2 Roles and Responsibilities
    3. 2.3 Program stakeholders and partners
    4. 2.4 Operating environment
    5. 2.5 Regional distribution of CSSP
  3. 3.0 Evaluation findings
    1. 3.1 Program Mandate & Evolving Context
    2. 3.2 Program resources
      1. 3.2.1 Funding
      2. 3.2.2 Tracked expenditures
      3. 3.2.3 Estimated current costs
      4. 3.2.4 Resource gaps
    3. 3.3 Governance and leadership
    4. 3.4 Program delivery
      1. 3.4.1 Achievement of results
      2. 3.4.2 Gaps in implementation
      3. 3.4.3 Information for decision-making
      4. 3.4.4 Availability of performance information
      5. 3.4.5 Communication with stakeholders and partners
  4. 4.0 Conclusions and Recommendations
  5. 5.0 Annexes
    1. Annex A – Evaluation methodology
    2. Annex B – Costs analysis methodology
    3. Annex C – Illnesses caused by consuming shellfish contaminated with biotoxins
    4. Annex D – CSSP classifications
    5. Annex E –The legislative mandates of the three federal partners
    6. Annex F – CSSP roles and responsibilities
    7. Annex G – More details on estimated current* CSSP delivery costs
    8. Annex H – Management Action Plan (MAP)
  6. Footnotes

1.0 Evaluation context

The horizontal evaluation of the Canadian Shellfish Sanitation Program (CSSP) was led by Fisheries and Oceans Canada’s (DFO) Evaluation Division and was supported by an interdepartmental working group with evaluation representatives from the other two federal organizations responsible for the delivery of the CSSP: the Canadian Food Inspection Agency (CFIA) and Environment and Climate Change Canada (ECCC).

There has not been a comprehensive evaluation of the CSSP since 2007, although components of the program have been covered in evaluations and audits undertaken by DFO and ECCC since then.

The CSSP horizontal evaluation took place between April 2021 and June 2022 and was conducted in compliance with the Treasury Board Policy on Results.

1.1 Objectives and scope

The objective of the evaluation was to identify challenges and opportunities in the management and delivery of the Canadian Shellfish Sanitation Program to provide senior management from CFIA, DFO and ECCC with evidence-based information to support ongoing discussions about future program direction, decisions and improvements. The scope was established through a planning phase, which included consultation with program representatives from all three partner organizations.

The evaluation examined the delivery of the program by all three federal partners and in all three regions where CSSP is implemented i.e., Pacific, Quebec and Atlantic regions (see section 2.5 for more details) over the last five years (2016-17 to 2020-21). Where relevant and feasible, evidence was collected reaching back to 2010 to allow for the examination of trends. Of note, a significant lack of resources to deliver the program was raised as a major concern during consultations, therefore the evaluation included a detailed cost analysis to examine this issue.

Evaluation questions

The evaluation was designed to provide evidence on where the program is working well, as well as to identify where improvements could be made. It included an assessment of program relevance, performance and design and delivery.

Relevance

  1. What is the mandate of the CSSP and how has it evolved over time?
  2. To what extent is the program responding to existing and evolving needs? Are there any gaps?

Performance

  1. What activities and outputs are currently being conducted and are there any gaps in what the agency/departments are able to do? If so, what are the impacts on the program's ability to deliver the program as intended?  Are there any unintended impacts?
  2. What resources are allocated to deliver the CSSP and what is used above and beyond what is allocated? How are resource allocations and usage tracked for CSSP? What resources are needed to deliver the program as intended?
  3. To what extent is the program meeting its intended results?

Design & delivery

  1. To what extent does the program have effective governance within each partner organization; and between partner organizations?
  2. To what extent do the partner organizations have information to support effective decision-making?
  3. To what extent is the CSSP delivered effectively and efficiently? Are there alternative ways to deliver the program or any of its components and still achieve the intended results?
  4. Does the program provide equitable and inclusive access to shellfish harvesting sites for safe consumption?

Evaluation methodology

Six lines of evidence were used to answer the evaluation questions.

Annexes A and B present details on evaluation methodology, including limitations.

2.0 Program context

The CSSP is a federal food safety program that aims to minimize health risks associated with the consumption of contaminated bivalve molluscan shellfish. It has a long history of federal organizations working together and many of the activities of the present-day program (e.g., testing for biotoxins, testing water quality in shellfish growing areas and enforcing regulations in harvest areas) remain the same as those seen throughout the evolution of the program.

While the responsible federal organizations have changed over the years, in February 1990, a Memorandum of Understanding (MOU) was signed between the (then named) Department of the Environment and the Department of Fisheries and Oceans, defining their respective roles and responsibilities for the CSSP. The Canadian Food Inspection Agency was created in 1997 and the MOU was revised in 2000 to reflect the transfer of fish inspection activities from DFO to the new Agency.

The CSSP, which is jointly delivered by CFIA, DFO and ECCC, continues to operate under the MOU (2000) which has the stated goal:

To provide reasonable assurance that molluscan shellfish are safe for consumption as food by controlling the harvesting of all molluscs within the tidal waters of Canada.

CFIA is responsible for providing horizontal coordination to facilitate the development and implementation of the CSSP.

What are bivalve molluscan shellfish?

Bivalve molluscan shellfish are a class of shellfish that have two hinged shells with a soft-bodied invertebrate contained inside. Many bivalves are edible; for example, oysters, clams, cockles, scallops and mussels. Since this group of shellfish are filter feeders, biotoxins and contaminants present in the water can bio-accumulate in their tissues.

CSSP is a high-priority program for the three federal partners as there are several illnesses that can be caused by eating contaminated shellfish, including three caused by eating shellfish contaminated with biotoxins: paralytic shellfish poisoning, amnesic shellfish poisoning and diarrhetic shellfish poisoning (see Annex C). These illnesses can have severe or life-threatening effects.

Note: For simplicity, the word shellfish is used in this report to refer to bivalve molluscan shellfish, which are the species covered by the controls in the CSSP. Some marine species commonly referred to as shellfish, such as shrimp or crab, are not covered by the CSSP.

2.1 Program resources

In 2018-19, the three federal partner organizations estimated the cost of the CSSP to be approximately $17.87 million per year for operations and maintenance (O&M), salary and full-time equivalent employees (FTEs). One of the goals of the evaluation was to obtain a more comprehensive understanding of resources spent by the program and any gaps that exist. Updated, more detailed figures based on financial analysis conducted during the evaluation can be found in section 3.2 of the report.

2.2 Roles and Responsibilities

The CSSP controls the harvest of shellfish by classifying waters (see Annex D) as approved, conditionally approved, restricted, conditionally restricted or prohibited. Water can also be unclassified. Classifications are based on comprehensive water quality monitoring and analysis and pollution source assessments. Areas are given either an open or closed status according to whether shellfish may or may not be harvested.

Roles and responsibilities of each partner organization flow from their legislated mandates (see Annexes E and F for details) and are laid out in the MOU (2000)Footnote 1 as follows:

While the three federal organizations have specific roles and responsibilities, their interdependence cannot be understated when it comes to delivering the intended results of the CSSP. Decision-making and program operations within each partner organization are dependent on the information collected and shared between partners. As such, there are four levels of interdepartmental governance to support integrated and collaborative decision-making (see section 3.3). Decisions at interdepartmental committees are made by consensus.

2.3 Program stakeholders and partners

The primary beneficiaries of the CSSP are domestic and international consumers of Canadian shellfish. The program was originally designed for the wild commercial harvest sector to meet requirements for export to international markets. It has since expanded to encompass aquaculture. Export countries, primarily the USA, continue to be the target markets; however, over time there has been increasing pressure to respond to more non-commercial (recreational and subsistence) harvest and Indigenous access for food, social and ceremonial (FSC) purposes. Program stakeholders and partners include:

2.4 Operating environment

The program is delivered in three CSSP regions (see section 2.5) with regional differences and challenges that contribute to complexities in program delivery. Below are some examples of complexities, although this list is not exhaustive. 

2.5 Regional distribution of CSSP

The Canadian Shellfish Sanitation Program is delivered in three CSSP regions where there is known shellfish harvesting in tidal and sub-tidal waters: Pacific, Quebec, and Atlantic. It is currently not delivered in Northern Canada or Labrador. Each federal partner has a national headquarters (NHQ) to provide internal support and policy guidance within their respective organization. As the CSSP cannot realistically cover all harvest areas along the 78,000 kilometers of coastline in the three CSSP regions, the program takes a risk-management approach for program delivery, prioritizing the allocation of available resources to areas of highest risk.

Description

This is a map of Canada showing the three regions where the CSSP is delivered. There are three regions and a national headquarters in Ottawa.

In the CSSP Pacific region, it covers 27,000 km of coast line. There are 621 existing growing areas which equates to 31% of the growing areas covered by the program. This region supports 76 million dollars in annual wild commercial shellfish landings and aquaculture production.

In the CSSP Quebec region, it covers 6,000 km of coast line. There are 434 existing growing areas which equates to 22% of the growing areas covered by the program. This region supports 5 million dollars in annual wild commercial shellfish landings and aquaculture production.

In the CSSP Pacific region, it covers 45,000 km of coast line. There are 963 existing growing areas which equates to 48% of the growing areas covered by the program. This region supports 163 million dollars in annual wild commercial shellfish landings and aquaculture production; this latter figure excludes all scallops.

Source for growing area numbers and commercial shellfish landings and aquaculture production: DFO

*The CSSP Pacific region only includes the Province of British Columbia.

**The CSSP Atlantic region encompasses three DFO regions: Maritimes, Gulf, and Newfoundland and Labrador regions. For CFIA and ECCC, the CSSP Atlantic region includes New Brunswick, Nova Scotia, Prince Edward Island (PEI), and Newfoundland and Labrador. The program, however, is not delivered in Labrador.

3.0 Evaluation findings

3.1 Program Mandate & Evolving Context

Key findings

The food safety mandate of the CSSP has remained consistent since 1925.

The CSSP is first and foremost a food safety program. This mandate, as stated in key documents, focuses on the following two objectives:

  1. Minimize health risks from the consumption of bivalve molluscan shellfish; provide reasonable assurance that shellfish are safe for consumption by controlling their harvest within the tidal waters* of Canada.
  2. Fulfill Canada’s international obligations to meet the terms of bilateral agreements and standards, in particular the bilateral agreement between the USA and CanadaFootnote 2, signed April 30, 1948, to improve the sanitary practices prevailing in the shellfish industries of the two countries.

*Note: There are areas on both the Pacific and Atlantic coasts where CSSP resources are used for sub-tidal species (e.g., geoducks). This presents a gap between program delivery and the stated program objectives.

These objectives have been in place since the beginning of the program. In 1924, there was an epidemic of typhoid fever following the consumption of contaminated oysters in the USA, which killed 150 people. In response, Canada passed regulations under the Fish Inspection Act in 1925 requiring that imported oysters be certified as a “safe food product”. Subsequently, the bilateral agreement was signed between the USA and Canada to certify that shellfish moving in either direction across borders were “safe to eat”.

Since then, the USA has continued to be Canada’s most significant trading partner for shellfish. In 2019, Canadian exports of molluscan shellfish** to the USA were valued at approximately $230 millionFootnote 3, which accounted for about 48% of all Canadian molluscan shellfish exports. In 2019, the USA accounted for 57% of all of Canada’s scallop exports, 86% of oyster exports, and 91% of mussel exportsFootnote 4. These numbers highlight the importance of the American market to the shellfish industry in Canada.

**Note: Data related to molluscan shellfish in this report may include species that are not covered by the CSSP (e.g., giant scallop) as data disaggregated by sub-species is not available.

The CSSP mandate is similar to the mandates of other international jurisdictions examined in the evaluation, all of which focus primarily on the safety of shellfish for consumption.

Washington State, US
“… prevent illness in people who eat Washington-grown molluscan shellfish”
New Zealand
“identify, monitor, evaluate and manage the risks associated with the commercial growing, harvesting, sorting and transporting of [shellfish] intended for human consumption”
Australia
“… assure the food safety of shellfish managed in accordance with its operational guidelines”
United Kingdom
“… ensure the shellfish on the market do not contain unsafe levels”
Chile
“… ensure the safety of the resources, particularly with respect to marine biotoxins”

While the importance of international export to the Canadian shellfish industry is evident, significant domestic demand also exists.

Data shows that Canada is the largest exporter of shellfish within North America, responsible for 43.6% of North American shellfish exports, compared to the USA (38.8%) and Mexico (17.6%)Footnote 5. Canada’s export of shellfish was worth close to $500M in 2019, representing over 35 million kilograms of product (see Figure 1).

Figure 1: Volume (millions of kg) and value (millions of CAD) of Canadian exports of mussel, oyster, clam, geoduck and scallop, compared to imports, per year
Description

Figure 1 is a bar graph. It shows the volume and value in of Canadian exports of mussel, oyster, clam, geoduck and scallop, compared to imports, for the years 2015 to 2021 included.

Volume is in millions of kilograms; value is in millions of Canadian dollars.

Import volume including scallops

In 2015, import volume including scallops was 19 million kilograms.
In 2016, it was 18 million kilograms.
In 2017, it was 14 million kilograms.
In 2018, it was 12 million kilograms.
In 2019, it was 12 million kilograms.
In 2020, it was 11 million kilograms.
In 2021, it was 9 million kilograms.

Import value including scallops

In 2015, import value including scallops was 166 million dollars.
In 2016, it was 160 million dollars.
In 2017, it was 161 million dollars.
In 2018, it was 146 million dollars.
In 2019, it was 152 million dollars.
In 2020, it was 139 million dollars.
In 2021, it was 109 million dollars.

Export volume including scallops

In 2015, export volume, including scallops was 33 million kilograms.
In 2016, it was 34 million kilograms.
In 2017, it was 36 million kilograms.
In 2018, it was 35 million kilograms.
In 2019, it was 38 million kilograms.
In 2020, it was 29 million kilograms.
In 2021, it was 24 million kilograms.

Export volume excluding scallops

In 2015, export volume, excluding scallops was 25 million kilograms.
In 2016, it was 28 million kilograms.
In 2017, it was 30 million kilograms.
In 2018, it was 29 million kilograms.
In 2019, it was 31 million kilograms.
In 2020, it was 23 million kilograms.
In 2021, it was 20 million kilograms.

Export value including scallops

In 2015, export value including scallops was 411 million dollars.
In 2016, it was 406 million dollars.
In 2017, it was 436 million dollars.
In 2018, it was 426 million dollars.
In 2019, it was 479 million dollars.
In 2020, it was 389 million dollars.
In 2021, it was 304 million dollars.

Export value excluding scallops

In 2015, export value, excluding scallops was 209.3 million dollars.
In 2016, it was 227 million dollars.
In 2017, it was 256 million dollars.
In 2018, it was 263.4 million dollars.
In 2019, it was 293.2 million dollars.
In 2020, it was 220.3 million dollars.
In 2021, it was 181.2 million dollars.

Note: This graph excludes some species due to specificity of data. Further, data is presented both with and without scallops as often scallops are not covered under the CSSP but are not disaggregated from the data.

Source: Canadian Trade

Canada’s exports of shellfish have been increasing since 2015, although they have decreased during the COVID-19 pandemic (2020 and 2021). According to the Outlook to 2027 for Canadian Fish and SeafoodFootnote 6, the exports of shellfish were expected to reach a value of $600M in 2025.

Nevertheless, according to export and production figuresFootnote 7Footnote 8, Canada exports only 25% of its total shellfish production (38,000 metric tonnes out of over 153,000 metric tonnes). Additionally, while imported products are not part of the CSSP, they do provide an indication of a certain level of domestic demand for shellfish consumption (see Figure 1) being equal to a third or more of the volume and value exported. Statistics Canada reports that an average of 1.4 kilograms of shellfish* has been available per person over the last 10 years. Further, according to a survey conducted by the Canadian Aquaculture Industry Alliance in 2011Footnote 9, 43% of Canadians eat shellfish* and average shellfish consumption frequency is 1.9 times a month. In general, access to fresh protein and produce all year was important to over four in five Canadians.

*Note: It is not clear whether species like shrimp and crab are included in the definition of shellfish used in these two studies.

Regarding domestic shellfish consumption, data to understand the portion of commercial shellfish sold interprovincially (under CFIA jurisdiction) or intraprovincially within provinces of origin (under provincial authorities) was not readily available.

The delivery of the CSSP’s mandate is focused on commercial markets and maintaining export.

The CSSP’s first objective (minimizing health risks) encompasses both domestic and international consumers of Canadian shellfish who are protected by the various controls put in place by the program. However, the importance of international consumers to the program is underscored by the mandate’s second objective (fulfilling international obligations to facilitate trade). Given the significance of the domestic shellfish market and level of consumption, the program could be more explicit about the intended delivery to domestic consumers, particularly those who may rely on safe, non-commercial shellfish for food security; for example, recreational harvesters and Indigenous Food, Social and Ceremonial (FSC) harvesters.

The program’s emphasis on commercial harvesters, including for export markets, was reinforced by internal interviewees. When asked if the mandate of the program has changed over time, about half (46%) said that commercial markets continue to be the priority and 29% perceived there is a push to focus more on the commercial/market side and less on other types of harvest.  There were examples of recreational areas, in particular, being given the lowest priority or even removed from program coverage, and there is a lack of guidance on the priority level of Indigenous FSC harvest in the program.

One element that appears to be a principal driver for the program’s emphasis on maintaining the export market is the trading relationship with the USA, which, as explained previously, is Canada’s largest trading partner for shellfish. The bilateral agreement in place with the USA requires regular audits of the CSSP to ensure a USFDA-equivalent* level of protection exists for consumers. Some of the audits have resulted in recommendations to ECCC that are very resource intensive to implement (see below), but the importance placed on the US market means that maintaining access is prioritized despite the challenges this presents. The use of significant ECCC program resources to meet these requirements results in rationalization in other aspects of the program, including the number of areas monitored. However, given that shellfish exported to the USA amounts to just 12% of Canada’s total production, it is possible that the resources dedicated to this aspect of the program is disproportionate. These factors have the potential to directly impact recreational and FSC harvesters, who have not been given the same level of priority as commercial harvesters in designating sites for program delivery (see below).

*Note: USFDA is the United States Food and Drug Administration

Shellfish sanitation programs in some countries are more explicit than the CSSP regarding the scope of their program delivery and stakeholders. For example, recreational harvesting does not fall under the Shellfish Program in New South Wales (NSW), Australia. While the government does provide some information for recreational harvesters about dangers and prohibitions related to harvesting shellfish, the NSW Food Authority officially recommends only eating shellfish harvested under a recognized commercial program. On the other hand, New Zealand does include recreational harvesting under their program, recognizing it as a common and traditional activity, and provides extensive resources for recreational harvesters such as YouTube videos on safe shellfish handling, storage and preparation; a mobile app with localized information on status of areas, species, etc.; and regular surveys of recreational harvest activity to understand trends and changes.

The CSSP’s operational context has evolved, resulting in new and increased challenges and pressures, as well as additional demands and interest.

The context within which the CSSP operates has evolved over time in ways that place significant pressures and demands on program delivery, particularly since there has been no known increase in program resources since 2000 (see section 3.2 for more details).

Government priorities have changed

Among the Government of Canada’s key priorities is reconciliation with Indigenous Peoples. The government has increased and accelerated its efforts in this area over the period of the evaluation, recognizing its constitutional and treaty obligations and, in 2021, passing into law an Act respecting the United Nations Declaration on the Rights of Indigenous Peoples. In 2019, all Ministers’ mandate letters included direction to build on the progress made with First Nations, Inuit and Métis people, and the same year Fisheries and Oceans Canada and the Canadian Coast Guard (CCG) released a Reconciliation Strategy committing to the recognition and implementation of Indigenous and treaty rights. In the most recent mandate letters of 2021, reconciliation with Indigenous Peoples has remained a top priority across government.

Indigenous peoples have the right to maintain and strengthen their distinct political, legal, economic, social and cultural institution

United Nations Declaration on the Rights of Indigenous Peoples

External pressures and challenges

Harmful Algal Blooms

A harmful algal bloom (HAB) occurs when toxin-producing algae grow excessively in a body of water. They are sometimes referred to as “red tides,” because the bloom of algae often turns the water redFootnote 10, however many toxin-producing algal blooms do not cause discolouration of the water and cannot be readily seen from shore. HABs carry a higher concentration of biotoxins that can accumulate in the tissues of bivalve shellfish.

Increased demands from CSSP stakeholders and partners

*Note: DFO Pacific region administers a survey to recreational license holders and captures some data on self-reported shellfish harvest through digging and handpicking on beaches. The CSSP Quebec region tracks requests to reopen harvest areas for recreational harvest.

While the CSSP is responsible for almost all elements related to shellfish harvest, this is not the case in many other jurisdictions. In countries such as the USA, Australia, and Mexico there is federal oversight and regulations for shellfish sanitation, but much of the program delivery occurs at the state level. This highlights the comparatively more involved role and heavier burden of the CSSP, which is exclusively administered federally.

Increased demands from commercial stakeholders and partners

Figure 2: Canada’s aquaculture production value of bivalve molluscan shellfish in millions of CAD
Description

Figure 2 is a bar graph showing Canada’s aquaculture production value of bivalve molluscan shellfish in Canadian dollars. In 2011, the value was 69 million dollars; in 2012 the value was 82 million dollars; in 2013 the value was 85 million dollars; in 2014 the value was 83 million dollars; in 2015 the value was 90 million dollars; in 2016 the value was 88 million dollars; in 2017 the value was 93 million dollars; in 2018 the value was 106 million dollars; and in 2019 the value was 116 million dollars.

Source: Aquaculture Production Quantities and Value

Figure 3: Value (thousand CAD) and share of value of wild harvest landings (CAD %) of bivalve molluscan shellfish under CSSP, per region, per year
Description

Figure 3 shows the value (in thousands of Canadian dollars) and share of value of wild harvest landings (% of Canadian dollars) of bivalve molluscan shellfish under CSSP, per year for the years 2010 to 2019. Year after year, the CSSP Atlantic region had the greatest value and share of total wild harvest landings, followed by the CSSP Pacific region and then the CSSP Quebec region.

In 2010, the CSSP Quebec region had 3,293 thousand dollars of landings or 3.8% of the share of landings; the CSSP Pacific region had 34,950 thousand dollars of landings or 40.3% of the share of landings; and the CSSP Atlantic region had 48,460 thousand dollars of landings or 55.9 % of the share of landings.

In 2011, the CSSP Quebec region had 3,051 thousand dollars of landings or 3.1% of the share of landings; the CSSP Pacific region had 40,659 thousand dollars of landings or 41.4% of the share of landings; and the CSSP Atlantic region had 54,537 thousand dollars of landings or 55.5% of the share of landings.

In 2012, the CSSP Quebec region had 2,719 thousand dollars of landings or 3.4% of the share of landings; the CSSP Pacific region had 26,193 thousand dollars of landings or 32.9% of the share of landings; and the CSSP Atlantic region had 50,654 thousand dollars of landings or 63.7% of the share of landings.

In 2013, the CSSP Quebec region had 1,225 thousand dollars of landings or 1.3% of the share of landings; the CSSP Pacific region had 34,473 thousand dollars of landings or 38% of the share of landings; and the CSSP Atlantic region had 55,080 thousand dollars of landings or 60.7% of the share of landings.

In 2014, the CSSP Quebec region had 2,447 thousand dollars of landings or 2.5% of the share of landings; the CSSP Pacific region had 41,591 thousand dollars of landings or 41.8% of the share of landings; and CSSP Atlantic region had 55,527 thousand dollars of landings or 55.8 % of the share of landings.

In 2015, the CSSP Quebec region had 2,706 thousand dollars of landings or 2.5% of the share of landings; the CSSP Pacific region had 33,427 thousand dollars of landings or 30.7% of the share of landings; and the CSSP Atlantic region had 72,925 thousand dollars of landings or 66.9% of the share of landings.

In 2016, the CSSP Quebec region had 1,337 thousand dollars of landings or 1.0% of the share of landings; the CSSP Pacific region had 32,769 thousand dollars of landings or 24.9% of the share of landings; and the CSSP Atlantic region had 97,241 thousand dollars of landings or 74% of the share of landings.

In 2017, the CSSP Quebec region had 1,047 thousand dollars of landings or 2% of the share of landings; the CSSP Pacific region had 52,171 thousand dollars of landings or 36.9% of the share of landings; and the CSSP Atlantic region had 88,231 thousand dollars of landings or 62.4 % of the share of landings.

In 2018, the CSSP Quebec region had 3,200 thousand dollars of landings or 2.3% of the share of landings; the CSSP Pacific region had 51,464 thousand dollars of landings or 36.3% of the share of landings; and the CSSP Atlantic region had 87,228 thousand dollars of landings or 61.5 % of the share of landings.

In 2019, the CSSP Quebec region had 1,933 thousand dollars of landings or 2% of the share of landings; the CSSP Pacific region had 50,063 thousand dollars of landings or 38.4% of the share of landings; and the CSSP Atlantic region had 78,255 thousand dollars of landings or 60.1 % of the share of landings.

Source: Seafisheries Landings

*Note: Production and landing values are often lower than export values (used in Figure 1) due to value-added processing

Aquaculture, and specifically shellfish aquaculture, is viewed as a growth industry in other countries. It is also seen as an area with potential for greater Indigenous involvement. For example, a stated intention/aspiration of the Māori in New Zealand is “the ability to actively and meaningfully participate in the aquaculture industry.”Footnote 12

The program is unable to accommodate increased demand.

When external stakeholders and partners of the program wish to have a new shellfish harvest area classified, they are required to submit a proposal to the Regional Interdepartmental Shellfish Committee (RISC) for review and, once accepted by all three federal partners, for RISC approval. These proposals are referred to as “Section 14 classification requests.” As shown in the graph below, there has been an overall upward trend in new requests for the Quebec and Pacific regions for the years shown. Numbers have remained relatively stable for the CSSP Atlantic region from 2016-17 to 2020-21 (there were no requests for 2020-21). There has been a total of 80 known requests over the last five years.

The evaluation team found these numbers to be low compared to anecdotal reports of demand as described by key informants in interviews; however, it is likely that these numbers are not fully indicative of demand. Internal documentation from 2015 made it clear that the development of any new shellfish harvesting areas would not occur due to a lack of CSSP capacity, unless approved by the National DG Operations Committee. Interviewees from all three federal partners and from industry mentioned there are deterrents to industry or First Nations making requests, such as high costs as a result of user pay initiatives introduced around 2015, internal capacity constraints (e.g., for small businesses), and the low probability of approval.

The program is considering expansion options to address some of the increased demands and changing context for the CSSP, however at the time of writing this report the three partner organizations had not yet reached consensus on how the program could expand.

Figure 4: Number of Section 14 classification requests, per fiscal year
Description

Figure 4 shows the Number of Section 14 classification requests, per fiscal year by region. Data was available for the CSSP Quebec region for the years 2010-11 to 2020-21. Data was available for the CSSP Pacific and Atlantic regions for the years 2016-17 to 2020-21.

In 2010-11 in the CSSP Quebec region there was 1 Section 14 requests; in 2011-12 there were 3; in 2012-13 there were 7; in 2013-14 there was 1; in 2014-15 there were 6; in 2015-16 there were 9; in 2016-17 there were 7; in 2017-18 there were 5; in 2018-19 there were 4; in 2019-20 there were 15 and in 2020-21 there were 8 requests.

In 2016-17 in the CSSP Atlantic region there were 3 Section 14 requests; in 2017-18 there was 1; in 2018-19 there were 3; in 2019-20 there was 1; and in 2020-21 there were no requests.

In 2016-17 in the CSSP Pacific region there were 2 Section 14 requests; in 2017-18 there were 12; in 2018-19 there were 6; in 2019-20 there were 5; and in 2020-21 there were 7.

Source: ECCC (Quebec and Pacific from 2010-11 to 2020-21), CFIA (Atlantic from 2016-17 onward)

While the program has been trying to adjust to its evolving context, progress is very slow

Various initiatives and national and regional working groups have been put in place to try to adjust to the program’s evolving context; however, progress has been slow. One CSSP initiative to note was the “Modernization exercise/Long-Term Sustainability Project” initiated in 2014, aspects of which are ongoing today (see details below). It was intended to review and modernize the CSSP to address increasing demands associated with an expanding shellfish harvesting industry in Canada and ensure future program sustainability by optimizing its use of resources. A more recent (2020-21) review has focused on assessing whether the CSSP is meeting program objectives, identifying challenges and gaps, and identifying areas for program improvement or potential expansion, including introducing appropriate measures to address Indigenous FSC shellfish harvesting in Canada.

Details of Modernization Exercise/Long-Term Sustainability Project (2014 and ongoing)

Harvest area prioritization exercise

In February 2015, in light of resource constraints, CSSP staff were directed to prioritize in the following order, based on the level of food safety risk exposure:

  1. Significant and sustained commercial harvesting areas (both wild and aquaculture);
  2. Low-production commercial harvest areas; and
  3. Areas with only recreational harvest.

No written guidance was provided on the priority level of Indigenous FSC harvest.

This direction has come at a sacrifice of field delivery in lower-priority commercial areas, some FSC areas, and virtually all recreational and non-Indigenous cultural areas (except where there was overlap with prioritized commercial areas).

Growing area inventory and declassification exercise

In order to determine if CSSP resources are allocated appropriately, each shellfish harvesting area was to be evaluated based on indicators such as the volume and value of shellfish harvested, whether leases or licences have been issued, as well as whether invasive species or shellfish disease are present.

See section 3.4 for more details on the growing area inventory.

Alternative service delivery

After an analysis of alternative service delivery (ASD) models was conducted, various ASD options were piloted to address increasing program expansion demands. The main option tested was the implementation of a “user-pay” principle for new stakeholders and partners requesting new services from the program.

A few ASD agreements have been put in place with ECCC and CFIA for sampling and testing. In these agreements industry and Indigenous applicants agreed to bear costs related to water and shellfish sampling and/or testing.

3.2 Program resources

Key findings

3.2.1 Funding

CSSP total funding allocations are unknown.

No recent and reliable source of information could be found regarding the total funding officially allocated to the CSSP.

Foundational documents indicate that in June 2000, the CSSP was allocated $4 million in annual funding and 25.8 full time equivalent (FTE) employees under the Human Health component of the Program for Sustainable Aquaculture. These resources were intended to increase consumer and market confidence in aquaculture shellfish products and did not target delivery of the program in areas dedicated to recreational, FSC and wild commercial harvest. Figure 5 illustrates how these resources were allocated to ECCC, CFIA and DFO.

In addition, in 2001-02, $51.4M of funding over five years was approved to expand the CSSP to the north. However, only $5.5 million ($4M for ECCC and $1.5M for DFO) was spent, as the project was abandoned in March 2003.

The evaluation was not able to confirm the amount of funding that existed prior to 2000 to deliver the program.

Figure 5: Annual funding (millions) and FTEs allocated to the CSSP in June 2000
Description

Figure 5 shows Annual funding and full-time equivalent employees (FTEs) allocated to the CSSP in June 2000.

Overall the program received 4 million dollars in funding. DFO and ECCC both received 1.5 million dollars or 37.5% each of the total; CFIA received 1 million dollars or 25% of the total.

Overall the program received 25.8 FTEs. DFO received 14 FTEs or 54% of the total; ECCC received 6.5 FTEs or 25% of the total; and CFIA received 5.3 FTEs or 21% of the total allocation.

3.2.2 Tracked expenditures

The program does not have an accurate representation of actual CSSP expenditures

At ECCC, the CSSP is delivered entirely under the Shellfish Water Classification Program (SWCP). Operating and maintenance budgets related to the CSSP are accurately captured in their SAP financial system, under specific cost centers dedicated to the SWCP.

There are no dedicated CSSP resources within the CFIA. Funding goes through food business lines. However, since CSSP is a high-priority program due to the risks associated with contaminated shellfish, subject matter experts (SMEs)Footnote 13 said that CSSP-related activities are likely to receive the level of resources required (at the expense of lower-risk activities). For the purposes of resource tracking, CFIA’s finance group manually calculated CSSP expenditures through extracted data from various systems using significant assumptions.

Within DFO, most resources dedicated to the CSSP are shared with non-CSSP activities under DFO’s mandate and as such are not specifically allocated to the program. SMEs confirmed that resources currently allocated to the CSSP are unknown, as they are not accurately represented in the financial system.

An internal audit conducted in 2017-18 concluded that DFO lacked adequate information on its financial and human resource allocations to ensure sound CSSP management. The CSSP project code created in 2013 to improve tracking of expenditures had not been used consistently. As recommended by the audit, a memo was circulated to remind staff to use the dedicated project code to track CSSP expenditures accurately. Although there has been some improvement, regional staff seem confused regarding the practices to follow. As most FTEs are not solely dedicated to the CSSP, it is considered complex to use the project code to track salary expenditures. For O&M expenditures, some regions entered actual expenditures against the CSSP dedicated project code only up to the CSSP allocated budgets. In these cases, expenditures greater than budgets are not being captured.

While ECCC’s expenditures are accurately represented, there are concerns with the reliability of CFIA’s and DFO’s tracking of CSSP expenditures. While some tracking is taking place, the fact that certain activities, such as patrolling for compliance or food safety testing, are combined with the same activities for other fish species or foods respectively, makes it more difficult to identify costs.

Despite many limitations, the evaluation was able to present a picture, albeit incomplete, of CSSP expenditures as being around $13 million annually (see Figure 6). Findings further on in the report indicate the cost of delivering the CSSP is significantly higher than what is tracked.

Figure 6: CSSP expenditures as tracked by each federal partner’s system (millions)
Description

Figure 6 shows CSSP expenditures as tracked by each federal partner’s financial system from 2016-17 to 2020-21.

In 2016-17, DFO tracked 1.1 million dollars in expenditures; ECCC tracked 6.6 million dollars in expenditures; and CFIA’s tracked expenditures were unknown.

In 2017-18, DFO tracked 0.7 million dollars in expenditures; ECCC tracked 6.4 million dollars in expenditures; and CFIA’s tracked expenditures were unknown.

In 2018-19, DFO tracked 1.1 million dollars in expenditures; ECCC tracked 6.9 million dollars in expenditures; and CFIA tracked 5.5 million dollars in expenditures.

In 2019-20, DFO tracked 1.1 million dollars in expenditures; ECCC tracked 6.4 million dollars in expenditures; and CFIA tracked 5.6 million dollars in expenditures.

In 2020-21, DFO tracked 1.0 million dollars in expenditures; ECCC tracked 6.1 million dollars in expenditures; and CFIA’s tracked expenditures were unknown.

*Because the manual calculation of CSSP expenditures by CFIA requires a significant amount of effort, this exercise was undertaken for two years only (2018-19 and 2019-20).

Source: CFIA, DFO and ECCC financial systems.

While resource tracking issues have been noted in previous reviews, the CSSP has been unsuccessful at addressing them.

The 2007 horizontal evaluation of the CSSP recommended the development of a central tracking and reporting system for CSSP costs:

2007 Evaluation Recommendation

The CSSP Secretariat should develop a tracking and reporting system for CSSP costs and performance.

Management Response and Implementation Strategy

The objective will be to prepare a project plan identifying a proposed process for development and implementation of a tracking and reporting system. This will be developed in consultation with the National Interdepartmental Shellfish Committee.

Fifteen years later, there is still no centralized cost-tracking and reporting system for the integrated program. The implementation of the management response was considered closed in 2012. In their justification, the program stated that “as there are no shared costs for the CSSP, each partner would continue to report on CSSP costs separately as required by their organization”, and “tracking of costing will be integrated into CSSP ADM and DG work planning and will be reviewed annually … Horizontal costing issues will be addressed through the CSSP governance structure as they arise.” Each federal partner still has the same tracking mechanisms and ECCC is still the only federal partner systematically tracking its CSSP expenditures. More rigorous tracking mechanisms are needed to better equip the program to accurately and completely quantify the real cost of delivering the CSSP, including to determine actual resource gaps.

Figure 7: Many ECCC interviewees (54%) consider the current resource tracking mechanisms to be effective, whereas a majority of CFIA (89%) and relative majority of DFO interviewees (40%) said they are not effective.
Description

Figure 7 shows responses to a question asked of internal interviewees about the effectiveness of current resource tracking mechanisms.

54% of ECCC interviewees perceived current mechanisms to be effective; 8% perceived them to be not effective and 34% provided a mixed response.

11% of CFIA interviewees perceived current mechanisms to be not effective and 89% provided a mixed response.

27% of DFO interviewees perceived current mechanisms to be effective; 40% perceived them to be not effective and 33% provided a mixed response.

Note: Interviewee responses were classified as “mixed” where they gave responses to the question that were both positive and negative.

In addition to proper coding, interviewees made some suggestions about how to improve the tracking of CSSP expenditures: 

3.2.3 Estimated current costs

There is a significant gap between tracked expenditures and what is estimated as the current cost to deliver the program.

An activity-based costing analysis was performed in collaboration with SMEs to estimate the current costs for delivering the CSSP, including those above and beyond what is officially tracked. The evaluation used these estimates as a proxy for current costs.

CFIA’s estimates for current CSSP costs were similar to the figures calculated by CFIA’s finance group for 2018-19 and 2019-20, although FTEs calculated by the CFIA finance group were greater than the number estimated by SMEs.

DFO’s estimates for current CSSP costs were significantly higher than both known funding and tracked expenditures. This confirms that DFO’s tracked expenditures do not provide an accurate representation of all costs associated with carrying out CSSP activities.

ECCC’s costing analysis results for tracked expenditures and current costs estimates are assumed to be identical, given that all CSSP-related costs are fully and accurately recorded in the system.

As shown on Figure 8, there is a significant gap between CSSP tracked expenditures ($13.2 million) and what is estimated as the current cost for the delivery of the CSSP as estimated by SMEs ($21.9 million). DFO’s CSSP delivery costs as estimated by staff ($9.9 million) represent the largest portion (45%) of the total current CSSP delivery cost. ECCC is next with 30% of the costs ($6.5 million).

See Annex G for additional details on estimated costs to deliver the CSSP.

Figure 8: Comparison of CSSP tracked expenditures and current costs estimates, by partner (millions)
Description

Figure 8 is a comparison of CSSP tracked expenditures and current cost estimates, by federal partner in millions of dollars.

Expenditures tracked in systems total 13.2 million dollars. ECCC tracked 6.5 million dollars in expenditures or 49% of the total; CFIA tracked 5.6 million dollars in expenditures or 43% of the total; and, DFO tracked 1.1 million dollars in expenditures or 8% of the total.

The current cost estimate for the CSSP program is 21.9 million dollars. DFO’s cost is estimated to be 9.9 million dollars or 45% of the total; ECCC is estimated to cost 6.5 million or 30% of the total cost; and, CFIA is estimated to cost 5.5 million dollars or 25% of the total estimated cost.

Source: CFIA, DFO and ECCC financial systems and SMEs’ estimates.

87% of internal key informants said the program DOES NOT have the level of resourcing needed to be delivered as intended. (n = 62)

3.2.4 Resource gaps

The CSSP is insufficiently funded.

The significant gap between what is tracked and what is estimated as current costs suggests that resources are being reallocated from other funding sources in order to be able to deliver the CSSP at its current level.

All three federal partners are at maximum capacity:

CFIA laboratory capacity for marine biotoxin testing is reported to be at maximum capacity within current resource levels. Further, the agency is not able to add new monitoring stations and has had to decline some requests from industry to do additional testing. They also divert resources from other CFIA activity areas to meet increasing demands and pressures.

ECCC has experienced internal O&M reductions within its program since 2018. All ECCC regions are facing some program delivery issues, and in several areas the network of monitoring stations has been reduced significantly. This has resulted in extended closures and the reduction of potentially viable approved waters. Pollution sources and wastewater systems are not being reassessed regularly, except in critical harvest areas, meaning the sampling frequency required by the program is not always respected. Continued re-prioritization to fit delivery within resource allocations is not sustainable for ECCC program delivery. Since ECCC is the department that begins the process of opening a harvest area (through recommended classification), lack of resources at ECCC for water monitoring and other activities such as pollution source assessments has been identified as a major bottleneck to CSSP delivery.

Given limited resources, establishing new monitoring sites can mean removing others.

At DFO, funding allocated to CSSP does not cover costs, so resources are reallocated from other regional funding sources on an opportunistic basis, impacting the delivery of other departmental mandated priorities, such as whale protection on both coasts, aquatic invasive species, marine protected areas and more.

In the CSSP, laboratories are used for water quality testing by ECCC, and for biotoxin and microbiological testing by CFIA. While interviewees described capacity challenges around water quality monitoring in Quebec, particularly due to reliance on contractors, the capacity issues are most limiting for the program when it comes to those laboratories used by CFIA for biotoxin testing.

A comparison of the laboratories available to the CFIA to test shellfish for biotoxins and those available to shellfish sanitation programs in other jurisdictions shows that other countries have a larger number of laboratories at their disposal (see details below), which is notable given the potential geographic scope of program delivery in Canada. CFIA has three accredited laboratories conducting marine biotoxin testing, in Burnaby British Columbia; Longueil, Quebec; and Dartmouth, Nova Scotia. Even if each of these labs were able to take on more samples, the time it takes for samples to travel to the labs for testing would present a challenge in serving more remote parts of the coastlines due to required timeframes for samples to arrive at laboratories.

Comparison of the laboratories available to the CFIA to test shellfish for biotoxins and those available to shellfish sanitation programs in other jurisdictions
Country km of coastline* # of laboratories
Canada 78,000 in the three CSSP regions** 3 ISO 17025 accredited labs which test for biotoxins
Mexico 9,330 11 ISO 17025 accredited labs which test for biotoxins
Australia 25,760 At least 10 biotoxin labs

**This does not include Canada’s northern coastline, where CSSP is not currently delivered but where some demand does exist, as described earlier in the report.

*Source: Coastline - The World Factbook (cia.gov)

Insufficient resources adds significant pressures and increases potential risks.

Samples being tested for water quality. Photo credit: ECCC

With the limited capacity and uncertainties related to funding, it has not been possible to hire additional indeterminate staff (or retain skilled contractors) for the CSSP. For that reason, the CSSP is using more temporary staff, students, volunteers and/or contractors to do the additional work, rather than using internal capacity. This has impacted operational planning and delivery by creating a dependency on third-party availabilities and rates and removing certain knowledge and expertise from within the program.

The unintended impact of insufficient resources is that the program is pressured to make some decisions based on resource limitations, rather than what is most needed to provide fulsome coverage (e.g., keeping a harvest area closed for a longer time when there is no capacity to monitor the area).

Managing increased demands in the environment of under-resourcing also places considerable stress on core staff, which has had a negative impact on staff morale in some regions. In some cases, significant overtime is required, particularly for DFO’s C&P officers. CSSP program staff on the ground are also the public face of the program and are often required to interact with stakeholders or partners and can bear the brunt of their dissatisfaction.

As previously described, in recent years the CSSP has put in place alternative service delivery (ASD) arrangements with the intent of saving costs while being able to respond to expansion requests. However, each ASD arrangement still requires initial and ongoing program effort to maintain the harvest area classification and related operational requirements. There is also significant overhead and involvement from staff to train and monitor ASD partners.

While ASD does alleviate program delivery pressures, it is not a cost-neutral exercise for any CSSP federal partner.

Due to the Canada’s extensive coastline, the CSSP will always require a risk-based level of prioritization as it is impossible to deliver even a fully resourced program for every potential shellfish harvesting area in the country. However, there are food safety risks associated with recreational and FSC harvesting in areas where the program is not or has ceased to provide coverage. Interviewees explained that in regions where areas are considered “harvest at your own risk” once declassified, people harvesting may not be aware of the change. As well, where long-term closures have been in place without ongoing sampling, people may not feel that the closures are legitimate and may disregard them. These risks may be greater in remote areas, where recreational or FSC harvest of shellfish is both a traditional practice and a way to ensure food security.

3.3 Governance and leadership

Key findings

There are several governance mechanisms in place to support the implementation and delivery of the CSSP.

As shown in the table below, the CSSP is governed by interdepartmental governance committees at four levels, all of which are chaired by the CFIA members. While there is no formal Deputy Minister committee, Deputy Ministers in the three partner organizations meet on an ad hoc basis.

Interdepartmental governance committees
Committee Roles and responsibilities
Assistant Deputy Minister Steering Committee
  • Provides horizontal coordination function and strategic leadership and direction to facilitate development and implementation of CSSP.
  • Participants are ADMs/VPs from CFIA, DFO and ECCC. Agriculture and Agri-Food Canada and Health Canada participate as needed.
Director General Operations Committee
  • Senior decision-making body that provides program-wide oversight and strategic direction for program delivery.
  • Participants are DGs/Executive Directors from DFO, ECCC and the CFIA.
National Interdepartmental Shellfish Committee (NISC)
  • Mandate is to facilitate the effective and efficient delivery of the CSSP across Canada.
  • Identify, prioritize and address national CSSP issues relating to policy development and implementation. Review national shellfish-related legislative, regulatory, policy and procedural issues of mutual concern, including proposed amendments to the program manual.
  • Reports to and sends recommendations to CSSP DG Operations committee for decision.
  • Participants are members and advisors from DFO, ECCC and the CFIA; chairpersons from the RISCs, and representatives from Health Canada.
Regional Interdepartmental Shellfish Committees (RISCs)
  • There is one RISC for each CSSP region. Their purpose is to discuss and advance regional issues regarding the CSSP and provide a formal communication exchange mechanism and operational structure which allows the three partners to manage, prioritize and co-ordinate CSSP activities and to advise NISC on any pertinent national or regional issues that require national direction.
  • Participants are area/regional representatives from DFO, ECCC and the CFIA and relevant provincial authorities, with invited stakeholder (e.g., industry) or partner (e.g., Indigenous groups) participants as observers.
  • Review proposals for classification or declassification and make decisions.

A secretariat, staffed by one person and housed within CFIA, performs the role of coordination and support for the ADM and DG committees.

There is a need for more strategic coordination, direction, and national leadership.

The evaluation conducted in 2007 recommended “A strengthened role for the ADM Steering Committee that includes clear CFIA leadership …”. While it is understood that the recommendation was fully addressed, there is confusion as to whether CFIA is the federal lead, as there are discrepancies between internal documents and publicly available information. This lack of clarity may explain why some interviewees perceived that there is hesitation by CFIA to play a stronger role in facilitating program level decision-making and initiatives that target program improvements. There were instances of a lack of leadership and direction observed at both the national and regional levels. While high-level decisions for the program are made by consensus among the three partners, and the agency does not have the authority to direct its federal partners or impose decisions, there is a need for more focused effort to resolve long-standing issues, such as how to address increasing demands.

An issue raised by some interviewees was the challenge of delivering a single program by three federal partners with different mandates. Despite the presence of centralized, interdepartmental governance structures, there has been difficulty agreeing on the scope of the program and making key decisions jointly rather than based on each individual organization’s priorities. Decisions made by each partner can have significant impacts on the other partners, which is problematic when they are not made together.

It should be noted that delivery of shellfish sanitation programs by several federal partners is not unique to Canada. In each of the other jurisdictions examined for the evaluation, program responsibilities are shared between multiple federal government organizations, or even other levels of government.

42% of all internal interviewees raised concerns about the lack of strategic coordination, direction and leadership.

Over half of these respondents specifically mentioned the need for more guidance and direction from senior management, especially regarding who the program is being delivered for and how to approach Indigenous reconciliation objectives in the context of the CSSP.

Many of the issues raised about lack of strategic direction and leadership are not new.

The CSSP has been the subject of several different audits and evaluations since 2007, in which similar concerns were cited. However, of note, CFIA has not conducted any reviews on its portion of program delivery since the 2007 horizontal evaluation of the CSSP.

Some actions were taken by management in response to the 2007 evaluation, in particular the development of a performance measurement strategy; however, this document is no longer current, and the issues persist.

Previous evaluations and audits

*Note: these evaluations included a component of CSSP as part of a broader evaluation.

Examples of previous findings about lack of strategic direction and leadership in the CSSP
Report Issues Identified
2007 Horizontal Summative Evaluation of the Canadian Shellfish Sanitation Program

Lack of strategic guidance and direction for the program as a whole
“the current policy and scope statement for the program is not clear in terms of how broad the coverage of the program should be”

CSSP not being governed as a single, coherent program
“In the absence of a formal centralized governance structure, federal partners are implementing the operational components of the program within their respective mandates, but this is done within departmental and internal program "silos" and is resulting in inconsistent approaches for delivery at the regional levels.”

Findings resulted in the following recommendation:
The CSSP ADMs Committee should redefine the policy and scope, including vision and guidance framework, for the program.

2017-18 DFO Evaluation of the Sustainable Aquaculture Program

Lack of clear direction
“a lack of clear direction for CSSP, and communication issues between national and regional offices have produced limited tangible results.”

Inefficient coordination among partners
“Budget constraints at ECCC and inefficient coordination among the partners are resulting in slow progress on the reclassification of water for aquaculture leases.”

Regional governance is working well.

According to internal key informants, the structure of the interdepartmental governance is, for the most part, working well at the regional level. Internal interviewees said that, due to the longevity of this program, people have developed strong working relationships over time, particularly as members of the RISCs.

Overall, operational roles and responsibilities of the three partners are clear, well understood, and they complement each other. About 70% of all interviewees said there was no duplication between the three federal partners or with other jurisdictions.

The expertise and dedication of operational staff is acknowledged and appreciated by both interdepartmental colleagues and by external stakeholders and partners.

While the program is not without challenges, a few internal key informants said that the CSSP is one of the best examples in the federal government of multiple departments working together to deliver a single program to Canadians.

An example of Indigenous participation in governance

In the Shellfish Program for Washington State, USA, Indigenous Tribes have a role in the management of the shellfish industry. The treaty Indian tribes in western Washington are strongly supportive of the public safety value of the National Shellfish Sanitation Program and have sent several representatives to the Interstate Shellfish Sanitation Conference (ISSC) every year since 1990. They also regularly participate in committees and task forces to address issues. In recognition of tribal commitment to safe bivalve shellfish, a seat for Northwest tribal participation was created on the ISSC Executive Board. Years of commitment to the ISSC has resulted in a tribal representative being appointed chair of that organization’s Foreign Relations Committee for the past decade.

While the RISCs work well, they are not receiving the national direction they need.

Close to 60% of internal interviewees perceived there was a clear, consistent and agreed upon process for interdepartmental decision-making.

1/3 said it takes a long time to come to agreement and that while there are processes in place, they do not work for every situation.

Overall, day-to-day operational decision-making is smooth. However, there are challenges when issues are elevated from the regional to the national level for advice or decision. Challenges range from long delays receiving a response, to the absence of decision-making, to issues being referred back to the RISCs without resolution. Delays receiving national direction in the regions are reported to range from one to four years. The lack of timely policy decisions or direction leads to inefficiencies in the regions. This has been particularly true regarding finalizing decisions about declassification.

A few program personnel indicated that the NISC strikes a lot of working groups. In 2020-21, there were eight national working groups on a range of topics. There is evidence that the working groups are making progress on key initiatives, and the existence of working groups is evidence of the three partners working together on program issues. However, advice and guidance as a result of their work is slow. According to their ToR, “NISC activities should lead to timely advice” … and the committee should “strive to resolve issue within a maximum two-year timeframe.” Given the multi-year timeframes cited by interviewees for the provision of national direction, this objective is not always being met.

One issue is that regional and national personnel do not have the same understanding of the role of the NISC when issues cannot be resolved in the regions. This may be partly attributable to inconsistencies in governance documents. The Terms of References (ToRs) for the RISCs state that when consensus cannot be reached in the region, issues will be brought forward to the NISC for direction and/or decision. Further, the CSSP manual states that the RISCs will provide recommendations to the NISC on all regional aspects that require national direction. However, activities highlighted in the ToR for the NISC do not state responsibilities for regional issues management or decision-making. The NISC ToR  states they will “establish sub-committees and working groups, as required, to deal with specific issues and to develop appropriate policies and/or procedures for dealing with them”; there is no mention of those groups coming to decisions.

As currently structured, the NISC does not operate as a decision-making body – rather, the DG Operations committee is the senior decision-making body for the CSSP. The NISC ToR explains that they bring forward proposals and recommendations to the DG Operations Committee for decision (e.g., related to policy or changes to the program manual).

Some key informants suggested it is time to “dust off” the MOU and program manual through a comprehensive review.  There is evidence to support this need; the evaluation found inconsistencies between the MOU, program manual and the Terms of Reference for the interdepartmental shellfish committees.

Overall, there is consistency across the program where needed, with a few exceptions.

DFO fishery officers posting sign to inform people the area is closed for the harvest of bivalve shellfish.
Photo credit: DFO

Another issue raised was that of a disconnect between the regional and national level at both CFIA and DFO. At CFIA, it was noted that the national level is not always aware of important regional challenges. At DFO, decisions are sometimes made at the DG level in National Headquarters, but when it comes to implementation at the regional level, the Regional Directors General are not always in agreement and are not obliged to abide by these decisions. This was described to be particularly problematic regarding declassification recommendations and decisions.

It’s difficult to know who has the final say at DFO.

3.4 Program delivery

Key findings

3.4.1 Achievement of results

Despite challenges and issues in the program, evidence shows the CSSP is achieving its intended results where the program is being delivered.

Both internal and external interviewees were asked to provide a rating in response to the following question:

To what extent is the program achieving its intended results through its current key activities and outputs?

  1. Minimizing the consumption of contaminated bivalve molluscan shellfish (thereby minimizing health risks).
  2. Ensuring that only shellfish that meet food safety and quality standards reach domestic and international markets.

Most interviewees, both internal and external, agree that the two main objectives of the program are being met to either a great or moderate extent. There have been no deaths as a result of shellfish poisoning for over 30 years and the CSSP continues to successfully enable international export and conveyance of shellfish across provincial borders.

Minimizing Health Risks

53% of internal interviewees said “to a great extent”

69% of external interviewees said “to a great extent”

Ensuring shellfish safety and quality

54% of internal interviewees said “to a great extent”

69% of external interviewees said “to a great extent”

Many interviewees qualified their responses, saying that the program is meeting its intended results to a great extent “in the areas covered by the program.”

In 1987, four persons died of amnesic shellfish poisoning (ASP)Footnote 18 due to the consumption of PEI mussels contaminated with domoic acid.  ASP was unknown in Canada prior to this tragedy. Monitoring has been successful in Canada and elsewhere, with no deaths from ASP reported since the 1987 episode, in any country with a monitoring program. The other cases that occurred in Canada since were either 'paralytic shellfish poisoning' (PSP) or 'diarrhetic shellfish poisoning' (DSP) and there have been no deaths from these incidents.

Factors that are helping the program to achieve results include:

Reasons why some interviewees did not rate their responses as “to a great extent” include:

*Note: Vibrio parahaemolyticus is a naturally occurring bacteria that grows rapidly in warming water. Vibrio illness can lead to severe gastrointestinal distress, including abdominal cramps, vomiting and diarrhea, and in serious cases can result in death. While of concern, it is not a contaminant covered by the CSSP.

While ECCC’s monitoring has decreased over the last ten years, they have been able to perform their role by prioritizing delivery in high-risk areas.

ECCC monitors waters to detect contamination levels and identify pollution sources. They make recommendations for classification to the RISCs for review and approval.

As shown in Figure 9, the number of areas monitored by ECCC from 2010-11 to 2020-21 has been in decline in both the Atlantic and Quebec regions while in Pacific region it remained relatively stable. Figure 10 shows that the number of samples being collected has decreased for the three regions over the same time period.

The low numbers for 2020-21 are partly due to the impacts of the pandemic (e.g., laboratory closures, restricted travel). Otherwise, the decreases in areas monitored/samples collected are largely due to resource constraints. The decreased resourcing has been occurring in conjunction with an increase in the number of requests received by program stakeholders/partners to classify new areas for harvest. Therefore, despite a decrease in ECCC’s capacity to deliver, interest in the program and requests for more harvest areas continue to grow, likely widening the gap in meeting stakeholder and partner demands.

ECCC manages the situation by giving priority to high-risk areas, and in some cases, new demands were able to be accommodated through prioritization; however, in the case of new requests for areas that have never been classified, they cannot be answered.

Figure 9: Number of areas monitored by ECCC, per region, per fiscal year*
Description

Figure 9 shows the number of areas monitored by ECCC, per region, for fiscal years 2010-11 to 2020-21 for the CSSP Pacific and Quebec regions and from 2016-17 to 2020-21 for the CSSP Atlantic region.

In 2010-11, ECCC monitored 178 areas in the Quebec region and 138 areas in the Pacific region.

In 2011-12, ECCC monitored 148 areas in the Quebec region and 137 areas in the Pacific region.

In 2012-13, ECCC monitored 153 areas in the Quebec region and 137 areas in the Pacific region.

In 2013-14, ECCC monitored 148 areas in the Quebec region and 138 areas in the Pacific region.

In 2014-15, ECCC monitored 141 areas in the Quebec region and 138 areas in the Pacific region.

In 2015-16, ECCC monitored 143 areas in the Quebec region, and 138 areas in the Pacific region.

In 2016-17, ECCC monitored 144 areas in the Quebec region, 272 areas in the Atlantic region, and 137 areas in the Pacific region.

In 2017-18 , ECCC monitored 116 areas in the Quebec region, 270 areas in the Atlantic region, and 137 areas in the Pacific region.

In 2018-19, ECCC monitored 114 areas in the Quebec region, 272 areas in the Atlantic region, and 137 areas in the Pacific region.

In 2019-20, ECCC monitored 101 areas in the Quebec region, 262 areas in the Atlantic region, and 137 areas in the Pacific region.

And,

In 2020-21, ECCC monitored 92 areas in the Quebec region, 205 areas in the Atlantic region, and 135 areas in the Pacific region.

Source: ECCC.

Figure 10: Number of samples collected per area monitored by ECCC, per region, per fiscal year*
Description

Figure 10 shows the number of samples collected per area monitored by ECCC, per CSSP region, for fiscal years 2010-11 to 2020-21. Data was only available for the CSSP Atlantic region for the years 2016-17 to 2020-21.

In 2010-11, ECCC collected 44.5 samples per area monitored in the Quebec region and collected 50.1 samples per area monitored in the Pacific region.

In 2011-12, ECCC collected 37.6 samples per area monitored in the Quebec region and collected 51.6 samples per area monitored in the Pacific region.

In 2012-13, ECCC collected 38.9 samples per area monitored in the Quebec region and collected 58.6 samples per area monitored in the Pacific region.

In 2013-14, ECCC collected 40.4 samples per area monitored in the Quebec region and collected 54.1 samples per area monitored in the Pacific region.

In 2014-15, ECCC collected 37.4 samples per area monitored in the Quebec region and collected 49.6 samples per area monitored in the Pacific region.

In 2015-16, ECCC collected 37.9 samples per area monitored in the Quebec region and collected 48.9 samples per area monitored in the Pacific region.

In 2016-17, ECCC collected 36.7 samples per area monitored in the Quebec region, collected 69.9 samples per area monitored in the Atlantic region and collected 48.7 samples per area monitored in the Pacific region.

In 2017-18, ECCC collected 33.1 samples per area monitored in the Quebec region, collected 59.2 samples per area monitored in the Atlantic region and collected 47.4 samples per area monitored in the Pacific region.

In 2018-19, ECCC collected 34.8 samples per area monitored in the Quebec region, collected 68.6 samples per area monitored in the Atlantic region and collected 53.7 samples per area monitored in the Pacific region.

In 2019-20, ECCC collected 32.8 samples per area monitored in the Quebec region, collected 66.7 samples per area monitored in the Atlantic region and collected 45.9 samples per area monitored in the Pacific region.

In 2020-21, ECCC collected 23 samples per area monitored in the Quebec region, collected 41.8 samples per area monitored in the Atlantic region and collected 40 samples per area monitored in the Pacific region.

*Information was not provided for the Atlantic region which limited the evaluation’s ability to determine a trend over the ten-year period.

Source: ECCC.

Note: 2020-21 low numbers are due in part to the pandemic.

While CFIA’s biotoxin analyses has decreased over the last five years, it has been effective in monitoring harvest areas covered by the CSSP, providing reasonable assurance of safe shellfish for consumption.

The CFIA tests shellfish from CSSP harvest areas for biotoxins. The CFIA also verifies compliance of shellfish as part of their inspection activities at SFCR-licensed* operators to ensure that shellfish being conveyed across provincial borders or exported abroad are safe for consumption. Regulatory limits for toxins and other hazards in the edible tissues of shellfish are set by Health Canada. Product that exceeds the regulatory limit is subject to controls (e.g., recall, disposal) and cannot be shipped domestically or abroad for consumption.

Figure 11 demonstrates that on average CFIA conducted 20,828 biotoxin analyses per year for the period 2016-17 to 2020-21. The level of analyses has declined 11.7 percent over the past five years.

Although the number of analyses conducted by CFIA each year has been decreasing, the proportion of shellfish biotoxin analyses exceeding the regulatory limit remained constant between 1.5% and 2.5%. Any worsening in these percentages could indicate more frequent or more intense biotoxin blooms, which could result in the need to close areas more frequently or leave them in closed status for longer periods.

CFIA also conducts analyses on shellfish for certain microbiological contaminants. For example, work related to norovirus monitoring and testing led to increased collaborative work and building informal relationships with partners, including Health Canada, the USFDA, American laboratories and others.

*Note: SFCR is the acronym for Safe Food for Canadians Regulations.

Figure 11: Number of bivalve biotoxin analyses by CFIA on samples collected in harvest areas for monitoring purposes, by fiscal year
Description

Figure 11 is a bar graph showing number of bivalve biotoxin analyses by CFIA on samples collected in harvest areas for monitoring purposes, for the fiscal years 2016-17 to 2020-21.

In 2016-17 there were 22,390 analyses; in 2017-18 there were 21,093 analyses; in 2018-19 there were 20,765 analyses; in 2019-20 there were 20,113 analyses; and in 2020-21 there were 19,779 analyses.

Note: The low analyses on samples conducted for the year 2020-21 was likely impacted by the implementation of Covid 19 pandemic restrictions (e.g., no travel, plant closures).

Source: CFIA.

Recalls are a risk mitigation action to prevent illness or death, by removing food from further sale or use at any point in the supply chain. In the case of shellfish, recalls can be initiated as a result of unacceptable test results, or the results of a food safety investigation, and the subsequent heath risk assessment.

As shown in Figure 12, there were a small number of recalled shipments of shellfish between 2012-13 and 2019-20. The number of recalls that were issued per 10,000 metric tonnes of bivalve molluscan shellfish produced/landed were stable, with a peak in 2015-16 mainly associated with a vibrio outbreak in British Columbia.

Figure 12: Number of recalls issued per 10,000 metric tonnes of shellfish produced/landed
Description

Figure 12 is line graph showing CFIA’s number of recalls issued per 10,000 metric tonnes of shellfish produced/landed.

In 2012-13 there were 0.9 recalls per 10,000 metric tonnes of shellfish produced/landed; in 2013-14 there were 0.4 recalls; in 2014-15 there was 1 recall; in 2015-16 there were 2.7 recalls; in 2016-17 there were 0.7 recalls; in 2017-18 there were 1.7 recalls; in 2018-19 there were 0.9 recalls; and in 2019-20 there were 0.7 recalls.

Source: CFIA.

Note: Program decision resulted in vibrio recalls being excluded starting in 2018-19, as vibrio is not covered by the scope of the CSSP.

Figure 13: Number of confirmed cases of shellfish-related consumer illness per 10,000 metric tonnes for domestic consumption (production levels minus exports)
Description

Figure 13 is a line graph showing the number of confirmed cases of shellfish-related consumer illness per 10,000 metric tonnes for domestic consumption (production levels minus exports).

In 2012-13 there were 14 confirmed cases of shellfish-related consumer illness per 10,000 metric tonnes for domestic consumption; in 2013-14 there were 20 confirmed cases; in 2014-15 there 10 confirmed cases; in 2015-16 there were 25 confirmed cases; in 2016-17 there were 9 confirmed cases; in 2017-18 there were 6 confirmed cases; in 2018-19 there were 2 confirmed cases; and in 2019-20 there were 7 confirmed cases.

Source: CFIA.

Note: 2016-17 and 2017-18 illness data is laboratory confirmed illness only and includes vibrio. Illnesses encompass shellfish consumed that was illegally harvested, as well as that harvested from areas in open status. Provincial reportable disease requirements limit the data.

Although it is understood that illnesses following the consumption of contaminated shellfish are under-reported, a review of several CFIA documents showed the number of confirmed cases of shellfish-related consumer illnesses are relatively low (Figure 13). This information is corroborated from interviews and program data, the latter of which shows that the number of confirmed cases (i.e., through an investigation) of shellfish-related consumer illness per 10,000 metric tonnes has decreased during the 2012-13 to 2020-21 period from 14 to zero.

There were 28 different shellfish-related food recalls from 2016-17 to 2020-21. Half of the recalls (fourteen) were related to waters in British Columbia. The shellfish species most associated was oysters, accounting for 86% of the recalls. Vibrio was the main causative agent (43%) of the recalls, followed by Salmonella (27%), Paralytic shellfish poisoning (17%), Norovirus (7%) and E. coli (6%).

Shellfish traceability

Federal regulations require that bivalve shellfish be tagged for commercial distribution so batches can be traced from harvester to consumer.

Increased attention was given to this issue in the Prime Minister’s 2019 mandate letters to the Minister of Health and the Minister of Fisheries, Oceans and the Canadian Coast Guard, in which the Ministers were specifically asked to develop a boat-to-plate traceability program to help Canadian fishers to better market their products.

Independent of the mandate letters, an initiative was put in place by the program in the Pacific region to address known traceability gaps.

Figure 14: Number of domestic mollusc recalls by region over the period 2016-17 to 2020-21
Description

Figure 14 contains a line graph depicting the number of domestic mollusc recalls by region over the period 2016-17 to 2020-21.

There were no recalls recorded in the CSSP Quebec region over the 5 years.

In 2016-17 there was 1 recall in the CSSP Pacific region and 4 recalls in the CSSP Atlantic region. In 2017-18 there were 4 recalls in the CSSP Pacific region and 8 recalls in the CSSP Atlantic region. In 2018-19 there were no recalls in the CSSP Pacific region and 5 recalls in the CSSP Atlantic region. In 2020-21 there was 1 recall in the CSSP Pacific region and 1 recall in the CSSP Atlantic region.

Figure 14 also includes two pie charts showing the shellfish species related to the recalls and the causative agents.

The shellfish species most associated with recalls was oysters, accounting for 86%; manila clams accounted for 7%, quahog for 4% and clams for 3%. Vibrio was the main causative agent of the recalls at 43%, followed by Salmonella (27%), Paralytic shellfish poisoning (17%), Norovirus (7%) and E. coli (6%).

Source: CFIA. (2021). Historical indicator data per province. CFIA. (2021). Vibrio was excluded starting in 2018-19 as risk mitigation measures for vibrio are the responsibility of “Safe Foods for Canadians” licence holders.

DFO’s CSSP compliance activities have increased.

DFO issues licenses for shellfish harvesting. Departmental C&P staff (i.e., fishery officers) patrol waters and beaches to monitor the compliance of commercial operators and the public in their harvest of shellfish. They enact and revoke prohibition orders to close and open harvest areas, respectively.

Over the last 10 years, the average number of hours that fishery officers spent on the CSSP as well as the average number of site checks has slowly been rising (Figures 15 & 16). This aligns with what we heard from DFO interviewees: there has been increased pressure to patrol and enforce compliance in more harvest areas, including sites that get closed for harvest to mitigate risk when they cannot be monitored by partners due to resource constraints.

The number of CSSP violations (Figure 17) has also been increasing in the Pacific and Atlantic regions, especially in the last three years. There have also been more violations per the number of site checks in the same time period (see Figure 18 for the non-compliance index). This data supports the rise in the intensity of the work that was expressed in interviews and the increased burden on C&P staff.

Figure 15: Number of hours Fishery Officers dedicated to CSSP
Description

Figure 15 shows the number of hours fishery officers dedicated to CSSP for the fiscal years 2010-11 to 2019-21. The CSSP Atlantic region dedicated the most hours, each year followed by the CSSP Pacific region followed by the CSSP Quebec region.

In 2010-11, fishery officers in the Atlantic region dedicated 10,847 hours to the CSSP; fishery officers in the Pacific region dedicated 4,820 hours and fishery officers in the Quebec region dedicated 1,285 hours.

In 2011-12, fishery officers in the Atlantic region dedicated 10,867 hours to the CSSP; fishery officers in the Pacific region dedicated 4,869 hours and fishery officers in the Quebec region dedicated 1,021 hours.

In 2012-13, fishery officers in the Atlantic region dedicated 12,649 hours to the CSSP; fishery officers in the Pacific region dedicated 4,801 hours and fishery officers in the Quebec region dedicated 898 hours.

In 2013-14, fishery officers in the Atlantic region dedicated 16,029 hours to the CSSP; fishery officers in the Pacific region dedicated 5,648 hours and fishery officers in the Quebec region dedicated 706 hours.

In 2014-15, fishery officers in the Atlantic region dedicated 14,447 hours to the CSSP; fishery officers in the Pacific region dedicated 3,838 hours and fishery officers in the Quebec region dedicated 1,040 hours.

In 2015-16, fishery officers in the Atlantic region dedicated 12,924 hours to the CSSP; fishery officers in the Pacific region dedicated 4,366 hours and fishery officers in the Quebec region dedicated 1,009 hours.

In 2016-17, fishery officers in the Atlantic region dedicated 14,160 hours to the CSSP; fishery officers in the Pacific region dedicated 4,787 hours and fishery officers in the Quebec region dedicated 1,298 hours.

In 2017-18, fishery officers in the Atlantic region dedicated 13,502 hours to the CSSP; fishery officers in the Pacific region dedicated 3,618 hours and fishery officers in the Quebec region dedicated 969 hours.

In 2018-19, fishery officers in the Atlantic region dedicated 14,009 hours to the CSSP; fishery officers in the Pacific region dedicated 7,161 hours and fishery officers in the Quebec region dedicated 700 hours.

In 2019-20, fishery officers in the Atlantic region dedicated 16,090 hours to the CSSP; fishery officers in the Pacific region dedicated 4,243 hours and fishery officers in the Quebec region dedicated 897 hours.

Figure 16: Number of site checks by Fishery Officers
Description

Figure 16 shows the number of site checks by fishery officers by fiscal years 2010-11 to 2019-20

In 2010-11, fishery officers in the Atlantic region made 12,172 site checks; fishery officers in the Pacific region made 4,433 site checks and fishery officers in the Quebec region made 877 site checks.

In 2011-12, fishery officers in the Atlantic region made 12,606 site checks; fishery officers in the Pacific region made 4,806 site checks and fishery officers in the Quebec region made 781 site checks.

In 2012-13, fishery officers in the Atlantic region made 16,140 site checks; fishery officers in the Pacific region made 4,428 site checks and fishery officers in the Quebec region made 563 site checks.

In 2013-14, fishery officers in the Atlantic region made 19,738 site checks; fishery officers in the Pacific region made 5,035 site checks and fishery officers in the Quebec region made 515 site checks.

In 2014-15, fishery officers in the Atlantic region made 19,556 site checks; fishery officers in the Pacific region made 2,721 site checks and fishery officers in the Quebec region made 1,199 site checks.

In 2015-16, fishery officers in the Atlantic region made 16,843 site checks; fishery officers in the Pacific region made 3,160 site checks and fishery officers in the Quebec region made 748 site checks.

In 2016-17, fishery officers in the Atlantic region made 19,017 site checks; fishery officers in the Pacific region made 3,125 site checks and fishery officers in the Quebec region made 1,120 site checks.

In 2017-18, fishery officers in the Atlantic region made 25,783 site checks; fishery officers in the Pacific region made 2,510 site checks and fishery officers in the Quebec region made 608 site checks.

In 2018-19, fishery officers in the Atlantic region made 18,123 site checks; fishery officers in the Pacific region made 4,992 site checks and fishery officers in the Quebec region made 183 site checks.

In 2019-20, fishery officers in the Atlantic region made 21,974 site checks; fishery officers in the Pacific region made 3,411 site checks and fishery officers in the Quebec region made 273 site checks.

Figure 17: Number of CSSP violations
Description

Figure 17 shows the number of CSSP violations for the fiscal years 2010-11 to 2019-20

In 2010-11, there were 147 CSSP violations in the CSSP Atlantic region, 368 in the CSSP Pacific region and 9 in the CSSP Quebec region.

In 2011-12, there were 151 CSSP violations in the CSSP Atlantic region, 577 in the CSSP Pacific region and 14 in the CSSP Quebec region.

In 2012-13, there were 199 CSSP violations in the CSSP Atlantic region, 501 in the CSSP Pacific region and 28 in the CSSP Quebec region.

In 2013-14 there were 181 CSSP violations in the CSSP Atlantic region, 473 in the CSSP Pacific region and 4 in the CSSP Quebec region.

In 2014-15, there were 175 CSSP violations in the CSSP Atlantic region, 338 in the CSSP Pacific region and 57 in the CSSP Quebec region.

In 2015-16, there were 95 CSSP violations in the CSSP Atlantic region, 220 in the CSSP Pacific region and 32 in the CSSP Quebec region.

In 2016-17, there were 206 CSSP violations in the CSSP Atlantic region, 436 in the CSSP Pacific region and 41 in the CSSP Quebec region.

In 2017-18, there were 157 CSSP violations in the CSSP Atlantic region, 282 in the CSSP Pacific region and 11 in the CSSP Quebec region.

In 2018-19, there were 190 CSSP violations in the CSSP Atlantic region, 621 in the CSSP Pacific region and 9 in the CSSP Quebec region.

In 2019-20, there were 310 CSSP violations in the CSSP Atlantic region, 394 in the CSSP Pacific region and 10 in the CSSP Quebec region.

Figure 18: Non-compliance index
Description

Figure 18 shows the non-compliance index for the fiscal years 2010-11 to 2019-20.

In 2010-11, it was 8.3 percent in the CSSP Pacific region, 1 percent in the CSSP Quebec region and 1.2 percent in the CSSP Atlantic region.

In 2011-12, it was 12 percent in the CSSP Pacific region, 1.8 percent in the CSSP Quebec region and 1.2 percent in the CSSP Atlantic region.

In 2012-13, it was 11.3 percent in the CSSP Pacific region, 5 percent in the CSSP Quebec region and 1.2 percent in the CSSP Atlantic region.

In 2013-14, it was 9.4 percent in the CSSP Pacific region, 0.8 percent in the CSSP Quebec region and 0.9 percent in the CSSP Atlantic region.

In 2014-15, it was 12.4 percent in the CSSP Pacific region, 4.8 percent in the CSSP Quebec region and 0.9 percent in the CSSP Atlantic region.

In 2015-16, it was 7 percent in the CSSP Pacific region, 4.3 percent in the CSSP Quebec region and 0.6 percent in the CSSP Atlantic region.

In 2016-17, it was 14 percent in the CSSP Pacific region, 3.7 percent in the CSSP Quebec region and 1.1 percent in the CSSP Atlantic region.

In 2017-18, it was 11.2 percent in the CSSP Pacific region, 1.8 percent in the CSSP Quebec region and 0.6 percent in the CSSP Atlantic region.

In 2018-19, it was 12.4 percent in the CSSP Pacific region, 4.9 percent in the CSSP Quebec region and 1 percent in the CSSP Atlantic region.

In 2019-20, it was 11.6 percent in the CSSP Pacific region, 3.7 percent in the CSSP Quebec region and 1.4 percent in the CSSP Atlantic region.

Source: DFO

3.4.2 Gaps in implementation

There are significant gaps in delivery, some of which present barriers for some stakeholders and partners.

Close to 80% of internal interviewees and at least ½ external interviewees perceived that the program does not currently provide equitable and inclusive access to shellfish harvesting sites for safe consumption.

While there are ad hoc efforts to address barriers, these are not mitigating issues in a comprehensive way.

Traditionally, remote coastal communities on Canada’s west coast have relied on the practice of harvesting shellfish in months that end with an ‘R’. These months have colder water temperatures, meaning they are likely to be safer for harvest, however as climate change warms global waters harmful algal blooms are becoming more commonplace, which could lead to greater concentrations of biotoxins and increased health risks for these communities when consuming shellfish.

To mitigate this risk in remote locations where the CSSP is not actively delivered, a few interviewees suggested extending the ‘Guardians’ program to better inform communities about how to consume shellfish safely.

3.4.3 Information for decision-making

There are some key sources of information that are lacking for operational decision-making and risk management.

41% of interviewees perceived that the necessary information was available in a timely manner to support decision-making for the program

36% of interviewees either provided a mixed response or said that the information is not available in a timely manner to support decision-making for the program

Note: The remaining interviewees did not give a categorical response to the interview question.

Limitations to growing area inventory data

While the program’s recent update of data on shellfish harvest areas across the country is an important step in providing the necessary information for prioritization of program delivery and monitoring activities, there are some aspects of the data and data collection processes that limit its usefulness. 

In conclusion, incomplete information makes it difficult to gather accurate data to support decision-making. Nevertheless, work is ongoing to improve the GAI and the quality of the information being used to support operational decisions.

Other Jurisdictions

While it is not possible to assess information available for decision-making in other jurisdictions in order to provide a direct comparison, it is clear from publicly available websites that in some cases there is more systematic collection of data related to the harvest of shellfish. Some examples include:

3.4.4 Availability of performance information

There are gaps in the information available to measure and report on program performance.

The evaluation team requested data to report on program activities and outputs and analyse trends. While enough data was available to provide an assessment of some program activities that are contributing to the achievement of intended results, reliable data was not available for all indicators and several limitations in the data were observed:

Changing approaches to performance measurement might be linked to some of the data issues:

A performance measurement regime is needed that identifies areas of both high performance and issues to be addressed.

Results for some performance indicators may be misleading. In some cases, targets are set annually, and achievement of results is based on the comparison of planned vs. actual work completed. This is true for example for the number of samples collected versus planned for water quality testing. Targets are set based on estimates derived from contract and internal capacity. Results may artificially inflate performance if targets are set only based on what is likely to be feasible in the year ahead and not what is needed to ensure program outcomes are attained.

3.4.5 Communication with stakeholders and partners

The SHELLI tool has improved internal processes to open and close harvest areas and to communicate externally but does have limitations.

The CSSP manual indicates that program partners have responsibilities to communicate externally about the status of harvest areas, for example by posting notices on beaches, conducting outreach, and sending automated notifications to commercial harvesters. The evaluation did not assess in detail the effectiveness of external communications, but it did examine the Shellfish Harvest Extents Latitude Longitude Information (SHELLI)Footnote 19 system implemented in March 2015 with two main purposes:

  1. To provide a publicly accessible, real-time map of openings and closures of Canadian shellfish harvesting areas

    The public side of SHELLI is an interactive map of the country. Users can zoom in on any area and colours inform them of its status (open or closed). A click on an area allows the user to view additional details, such as the reason for closure, the species included, the public notice, the exact geographic description and the dates of issuance and enforcement. Subscribers receive automatic notifications when status changes. Before the implementation of SHELLI, it regularly took two to three days to implement a closure. This can now happen in as little as an hour.

    44% of external interviewees thought SHELLI was working well for them, however quarter said it was not user friendly and a quarter said the information was not timely.

    Over half (56%) of internal interviewees perceived the data on SHELLI as confusing, and the application is not seen as user friendly. It was stated that the general public sometimes turn to other tools to make informed decisions, such as DFO regional webpages, email, provincial health institute maps (e.g., British Columbia Centre for Disease Control Shellfish Harvesting Status Map)Footnote 20 or external apps developed by private companies (e.g.; Can you dig it).Footnote 21

  2. To provide an interface for the three federal partners to improve the production of prohibition orders and their revocation

    A prohibition order (PO) is put in place by DFO to close an area for shellfish harvest. Internally, SHELLI offers a map where CFIA and ECCC can select the reason for the PO (e.g., sudden influx of sewage or rainfall runoff; unsafe biotoxin levels detected) from an organization specific list. They can then select in a few different ways (polygons, circles, shape already used in the past, etc.) to display the area on the map where they wish to change the access to all or some species. At this step, the system creates a numbered polygon on the map, as well as a prohibition order number.

    About 40% of internal interviewees mentioned that SHELLI is useful and has improved internal processes.

    However, SHELLI is the only place where all program POs are listed, and while it is not designed as a database, it is used as such by some program personnel. Unfortunately, it is not a reliable source for this purpose; regions enter data inconsistently, and classified areas do not line up with the boundaries of growing areas. This also means that SHELLI is not reliable as a reporting tool.

There are limitations to information shared with stakeholders and partners.

The CSSP has implemented some strategies to address inclusivity and accessibility, which include providing outreach and producing posters and signage in multiple languages as well as attempting to provide additional flexibility and accommodation to First Nations communities.

About Management of Contaminated Fisheries Regulations Licenses (MCFR)

DFO can issue a MCFR license whereby a commercial harvester can fish in a closed or contaminated area in possession of an approved decontamination plan. The plan outlines how they will reduce contamination levels in the harvested shellfish, through depuration or relay, to safe levels for consumption.

Depuration uses a controlled, aquatic environment (e.g., containment tanks) to reduce the level of microbiological contamination in live shellfish.

Relay involves the transfer of shellfish from marginally contaminated areas to approved areas for natural biological cleansing using the ambient environment.

Person digging shellfish from beach. Photo credit: ECCC

4.0 Conclusions and Recommendations

4.1 Conclusions

The CSSP is a long-standing program. Its food safety mandate has remained the same since 1925, and the program has consistently had a focus on commercial markets and maintaining export. However, the context within which the program operates is constantly evolving, and it continues to face increasing demands and pressures. At the same time, there is no evidence that resource levels have increased since $4M and 25.8 FTEs were added in 2000-01. The program consistently struggles to track its financial resources, however there is strong evidence that the program does not have the level of funding needed to meet current demands, let alone new ones. This issue affects the level of program delivery to some stakeholders and partner groups and increases potential risks.

There are several governance mechanisms in place for the program. Regional governance is working well, and operational roles and responsibilities are clear, distinct and well-understood. However, there is a lack of strategic leadership from senior management and timely guidance to regional staff. The information needed to measure and report on program performance and make decisions about integrated program delivery has limitations. Due to the horizontal nature of the issues raised in the evaluation, recommendations have been addressed to the CSSP ADM Steering committee (comprised of the Vice President, Policy and Programs, CFIA; the ADM, Aquatic Ecosystems, DFO; and the ADM, Science & Technology, ECCC) rather than a specific ADM or Vice President.

Many of the challenges and issues found by the evaluation are not new. They have been documented in previous reviews dating back to the last horizontal evaluation of the program in 2007. The program has made some efforts to resolve some of its long-standing problems; however, there has been limited substantive progress. Despite this, evidence shows the CSSP is achieving its two objectives in the areas where the program is being delivered. While there has been a decrease in some of its activities, prioritization of resources to higher-risk areas has allowed the program to continue to perform its role and provide reasonable assurance of safe shellfish for consumption despite significant delivery gaps.

4.2 Recommendations

Recommendation #1:

It is recommended that the CSSP ADM Steering committee develop, articulate and communicate to program staff renewed strategic guidance about the program’s priorities, scope and reach to address increasing demands and evolving changes in its operating context.

Rationale:

The CSSP has focused on the same objectives since its inception and is missing foundational guidance to direct staff on how to deliver the program in the current environment of increased pressures and demands and a changed operational context. There is a lack of clarity about who the program is intended to serve beyond existing commercial harvesters, and how prioritization should take place. The focus on commercial trade markets affects delivery to other stakeholders and partners, such as: recreational harvesters, Indigenous people harvesting for Food, Social and Ceremonial reasons and/or commercial businesses who do not receive the same level of program delivery or bear additional costs relating to opening new areas for shellfish harvest. This lack of strategic guidance and leadership is not new, having been raised in multiple program reviews including the 2007 horizontal evaluation of the program. Operational staff, who face these pressures on the ground, require more clarity and tools to address current gaps in meeting the needs of program stakeholders and partners.

Recommendation #2:

It is recommended that the CSSP ADM steering committee clarify which federal partner is the lead of the CSSP. Further, it is recommended that they review all levels of interdepartmental governance and establish mechanisms to support more effective decision-making, ensure that long-standing issues are resolved, and operational staff are given timely guidance and advice when needed.

Rationale:

While CFIA, DFO and ECCC have specific roles and responsibilities, their interdependence cannot be understated when it comes to delivering the CSSP. There is a lack of clarity about which federal partner is the lead on the CSSP, given discrepancies between internal documents, naming CFIA as having this role, and publicly available information. Regardless, the agency does not have the authority to direct its federal partners or impose decisions. Partners use consensus to make joint decisions, however, it is clear that mechanisms are needed to improve timely decision-making, resolve long-standing issues and move forward with unified direction that gives the integrated mandate of the CSSP the same importance as individual partners’ mandates.

The current interdepartmental governance committees that support collaborative work between partners do not provide timely support to regions when they are unable to resolve issues on their own. The National Interdepartmental Shellfish Committee (NISC) is designed to discuss issues and make recommendations to the DG Operations committee for final decisions. This arrangement does not provide responsive support to regions, who sometimes wait years before they receive guidance, or in the worst-case scenario do not receive direction at all. Changes to key governance documents (e.g., Terms of References, Memorandum of Understanding, etc.) could help address governance issues. Further, these tools contain inconsistencies and do not currently support issue resolution.

Recommendation #3:

It is recommended that the CSSP ADM Steering committee seek out opportunities to address resource gaps facing the CSSP to meet existing and increasing demands for program services and delivery. Solutions are required to address current risks related to CSSP resource management in order to ensure that health risks are minimized, the shellfish industry remains strong, and stakeholder and partner needs are served appropriately by the program.

Rationale:

The evaluation found that all three federal partners are at maximum capacity and that the program as a whole does not have the level of resourcing needed to respond to existing and increasing demands. This has necessitated prioritization of delivery primarily to high-risk areas and has created unintended impacts such as impeding market growth or the lack of monitoring in long-term closures. While continued re-prioritization to fit delivery within resource allocations is one option for the program, it has the potential to increase risks to shellfish consumers and is not seen as sustainable for program delivery. As demand for services continues to grow and the program considers options for expansion, more dedicated resources are needed to deliver the CSSP effectively without relying on other internal funding sources on an opportunistic basis.

Robust resource tracking mechanisms are also needed to accurately quantify the cost of delivering the CSSP, including to further understand resource gaps to meet existing and increasing demands from stakeholders and partners.

Recommendation #4:

It is recommended that the CSSP ADM Steering committee review the CSSP’s performance measures and develop an integrated performance profile with meaningful performance indicators and targets at the program level. Useful and accurate information on the achievement of results is needed to better support the management of the program. Ideally, program level performance indicators could be integrated into the broader results frameworks of the three partner organizations. CSSP performance data needs to be tracked, collected and reported consistently and in a timely manner across all three federal partners and all regions. Roles and responsibilities for collecting and storing the data should also be established.

Rationale:

As the CSSP proceeds with modernization, there is a need to reassess performance information needs and data collection and tracking mechanisms, with a focus on integrated program results. While the program does collect some useful performance data, there are some limitations related to reliability, inaccessibility, incompleteness and confusion about roles and responsibilities for data collection and storage. Further, while the absence of reported fatalities since 1987 is positive, and could be considered an indicator of program success, in reality, fatalities are the worst-case scenario, and their occurrence would be an indication of program failure. Better information is needed to track and demonstrate where CSSP is performing well and where it needs improvement.

An integrated performance profile with more meaningful indicators and targets would allow for a more nuanced understanding of the program’s ability to achieve its objectives.

5.0 Annexes

Annex A – Evaluation methodology

The evaluation was conducted using an evaluation framework, which included the questions summarized in section 1.1., as well as indicators. Data was collected through the following methods and evidence was triangulated to decrease potential deficiencies with any one method and to develop the overall findings.

Key Informant Interviews

In order to gather the views of CFIA, DFO and ECCC employees, and of external stakeholders and partners to delivery of the CSSP, the evaluation team conducted 21 internal scoping interviews (29 key informants) to help plan the evaluation and 77 internal and external interviews during the conduct phase. All three CSSP regions and national headquarters were represented.

Interviews during the conduct phase:

Limitations and mitigation:

International Benchmarking

The evaluation team completed a review of alternative design and delivery models in foreign programs related to shellfish sanitation - including those in the United States, United Kingdom, Australia, New-Zealand, Mexico, and Chile – in order to compare the CSSP to similar programs elsewhere. A literature review of published articles was conducted, as well as extensive review of publicly available Canadian and international reports, regulations, and other information on foreign programs.

Limitations and mitigation:

Financial/Cost analysis

The evaluation team completed an analysis of expenditures and internal costs associated with program delivery from data provided by CFIA, DFO and ECCC. Extensive discussions with subject matter experts provided additional input  and allowed for a thorough understanding of the program’s resources.

Limitations and mitigation:

Annex B includes a detailed description of the methodology and limitations for this line of evidence.

Data Analysis

Program statistics and performance data from the CFIA, DFO and ECCC were analyzed to inform the evaluation about activities (including trends) contributing to the performance of the program.

Limitations and mitigation:

Document / Legislative review

In order to understand the context and delivery of the CSSP in the three organizations, the evaluation team conducted a review of over 150 internal and publicly available documents from CFIA, DFO and ECCC and external sources (e.g., shellfish harvest industry)., Materials reviewed included, but were not limited to, previous reviews, internal governance documents, applicable legislative and regulatory documents, agreements, mandate and priority-setting documents, and in the case of external organizations, public websites.

Limitations and mitigation:

Process mapping

The evaluation team developed a process map to identify the steps and decision points in the program’s processes and better understand program complexities. A draft process map was created based on information gathered in the document review, and it was subsequently reviewed and validated by subject matter experts from CFIA, DFO and ECCC. Three group discussions (one in each CSSP region) with members from the three federal organizations took place after all other lines of evidence were complete and thus focused on areas of interest informed by the process mapping and identified during the evaluation. Overall, this line of evidence informed the evaluation team on the day-to-day operations of the program, explored complex processes, and allowed for an examination and better understanding of where processes are not working well or where the program faces challenges.

Limitations and mitigation:

Annex B – Costs analysis methodology

The costs analysis examined Canadian Food Inspection Agency (CFIA), Fisheries and Oceans Canada (DFO) and Environment and Climate Change Canada (ECCC) financial, human and materiel resources in support of the Canadian Shellfish Sanitation Program (CSSP) as follows:

Description

The diagram on this page illustrates the cost analysis methodology in four columns.

The heading on the first column is “Funding”. Funding amounts for CSSP, as approved by Cabinet in June 2000 under the Human Health component of the Program for Sustainable Aquaculture, were used to represent program funding for CFIA, DFO and ECCC. No other reliable sources of funding information were found for the CSSP.

The heading on the second column is “Step 1: Analysis of allocated resources and tracked usage per the systems”. At CFIA, results from a costing exercise undertaken by CFIA financial staff in December 2020 were used in lieu of CFIA financial system data for tracked usage. It included activities coded against specific task codes from the operational system (OPM), specific sample plan codes from the laboratory system (LSTS) and support salary costs from the Salary Forecasting Tool (SFT). A limitation of Step 1 at CFIA was that source data and a detailed methodology were not shared with the evaluation team, hence any assumptions or limitations related to that costing exercise are unknown.

At DFO, budgets and expenditures tracked in the Abacus financial system under CSSP project codes for the period 2016-17 to 2020-21 were requested from DFO financial staff. DFO CSSP project codes extracted from Abacus were: 90255 – CSSP; 96256 - CSSP Wastewater Treatment Module Project; and 96195 - Aquaculture Management for the CSSP. A limitation of Step 1 at DFO was that in some regions, CSSP expenditures were incomplete, as they were coded against CSSP project codes only up to the CSSP allocated budgets.
At ECCC, budgets and expenditures for the cost centers dedicated to the Shellfish Water Classification program (SWCP) from the SAP financial system over the period 2016-17 to 2020-21 were obtained and validated with four key ECCC program officials. The numbers are deemed to be an accurate representation of all current CSSP costs.

The heading on the third column is “Step 2: Estimation of current CSSP delivery costs.”  They are known at ECCC. For CFIA and DFO, the current costs for delivering the CSSP, including above and beyond what is officially allocated, were determined using a combination of activity-based and bottom-up costing techniques based on historical costs, knowledge and assumptions from 17 key subject matter experts (SMEs) within the CFIA and 22 key SMEs within DFO. Bottom-up refers to breaking down a program into components and estimating the costs of each component based on the best available information. Activity-based costing uses historical cost information to assign direct costs to the program as well as allocate an appropriate portion of indirect costs.

Fishery Officer hours as recorded in DFO’s Fishery Officer Enforcement Activity Tracking System (FEATS) were also obtained in order to validate C&P salary expenditure estimates.

The heading on the fourth column is “Step 3: Estimation of future resources required”. At the time of this analysis, there were many different options on the table for the future of the program, but no certainty or consensus about the way forward. As such, the evaluation team decided to not project costs over different scenarios.

After each step in the costing analysis methodology, results were carefully reviewed by the evaluation team and validated by SMEs involved in day-to-day CSSP activities. Clarifications were obtained from SMEs when data did not look consistent. Salary expenditures were validated against Treasury Board published rates of pay by classification. Justifications and rationales were provided in support of most estimates.

*DFO CSSP project codes extracted from Abacus were: 90255 – CSSP; 96256 - CSSP Wastewater Treatment Module Project; and 96195 - Aquaculture Management for the CSSP.

**Bottom-up refers to breaking down a program into components and estimating the costs of each component based on the best available information. Activity-based costing uses historical cost information to assign direct costs to the program as well as allocate an appropriate portion of indirect costs.

Annex C – Illnesses caused by consuming shellfish contaminated with biotoxins

While there are several illnesses that can be caused by eating contaminated shellfish, three illnesses can be caused by eating shellfish contaminated with biotoxins that are not destroyed by cooking: paralytic shellfish poisoning, amnesic shellfish poisoning and diarrhetic shellfish poisoning.

Paralytic shellfish poisoning (PSP) is an illness that may have serious and potentially fatal effects. It is caused by eating bivalve shellfish and other molluscan shellfish that have been contaminated by toxins produced by certain species of microscopic marine algae found in coastal waters.

Amnesic shellfish poisoning (ASP) is an illness caused by domoic acid, a naturally occurring acid which is produced by some marine algae. Domoic acid can accumulate in filter-feeding bivalve molluscan shellfish such as clams, mussels, scallops and oysters. ASP was unknown in Canada until November 1987, when an outbreak in Eastern Canada resulted in four deaths.

Diarrhetic shellfish poisoning (DSP) is an illness caused by toxins that are produced by certain microscopic plants and can bio-accumulate in the tissues of shellfish. DSP is often short-lived and non-life-threatening; however, for some people, especially young children, the elderly, pregnant women and those with weakened immune systems, DSP can be very serious.

Source: Marine biotoxins in bivalve shellfish: Paralytic shellfish poisoning, amnesic shellfish poisoning and diarrhetic shellfish poisoning

Annex D – CSSP classifications

Approved
The classification assigned to a shellfish harvest area as determined by the shellfish control authority* from which shellfish can be harvested for direct consumption.
Conditionally approved
The classification assigned to a shellfish harvest area which has been determined by the shellfish control authority to meet approved area criteria for a predictable period. The period is conditional upon meeting established requirements and/or performance standards specified in a conditional management plan.
Restricted
The classification assigned to a shellfish harvest area as determined by the shellfish control authority where harvesting shall be by licence under the Management of Contaminated Fisheries Regulations and the shellfish, following harvest, is subjected to a suitable and effective treatment process through relaying or depuration.
Conditionally restricted
The classification assigned to a shellfish harvest area which has been determined by the shellfish control authority to meet, at a minimum, the restricted classification criteria for a predictable period. The period is conditional upon meeting established requirements and/or performance standards specified in a conditional management plan.
Prohibited
The classification assigned to a shellfish harvest area as determined by the shellfish control authority where shellfish harvesting is not permitted.

Generally speaking, restricted, conditionally restricted and prohibited areas are classified as such due to sanitary survey or water quality results that document a persistent pollution source risk.

*Shellfish control authority - The departments or agencies of the Government of Canada that are signatories to the interdepartmental MOU between CFIA and DFO and ECCC concerning the CSSP or provincial shellfish leasing bodies

Source: Canadian Shellfish Sanitation Program manual

Annex E –The legislative mandates of the three federal partners

CFIA

The Canadian Food Inspection Agency has responsibilities under the Safe Food for Canadians Act (an Act respecting food commodities, including their inspection, their safety, their labelling and advertising, their import, export and interprovincial trade) to regulate grades and standards for food; quality management and control or safety programs, and preventive control plans; and the design, construction, hygiene, sanitation and maintenance of equipment and facilities; as well as the conveyance across provinces and import/export; and food traceability requirements. The Minister of Agriculture and Agri-Food also has the authority to register/issue licenses authorizing the conveyance across provinces, or import/export, as well as conducting activities in respect of food commodities. They also have the authority to issue certificates/documents setting out information deemed necessary to facilitate export.

DFO

Fisheries and Oceans Canada has responsibilities under the Fisheries Act and associated regulations for implementing measures to maintain fish stocks; issuing/authorizing leases and licenses for fishing; and making fisheries management orders when required in order to address a threat to the proper management and control of fisheries and the conservation and protection of fish. The Minister is required to provide notice of fisheries management orders. The Minister may authorize rivers or other waters to be set apart for natural or artificial propagation of fish and grant special licenses/leases for planting/forming oyster beds and for the cultivation and production of oysters. Regulations lay out season dates for each area, minimum measurements, harvest limits, and the tools that may be used.

ECCC

Environment and Climate Change Canada does not have any regulatory responsibilities under the CSSP specific to fisheries management or public health protection. However, the department has administrative responsibility for Section 36-42 of the Fisheries Act, which relates to its role in pollution prevention under the Act’s General Provisions and Regulations. ECCC maintains recognized expertise in evaluating pollution sources and assessing pollution control methods and mechanisms. Furthermore, the department has the mandate to monitor and report on environmental quality as per its responsibilities under Part 3 of the Canadian Environmental Protection Act.

Annex F – CSSP roles and responsibilities

The roles and responsibilities are defined in the Memorandum of understanding between the Canadian Food Inspection Agency (CFIA) and Fisheries and Oceans Canada (DFO) and Environment Canada (EC) concerning the Canadian Shellfish Sanitation Program ("CSSP").

Responsibilities of the CFIA

The CFIA shall be the lead agency in the administration of the CSSP with regard to: the handling, processing, import and export of shellfish; the marine biotoxin monitoring program; and any other microbiological monitoring program not described in section 13.1.4 – "Responsibilities of EC".

The CFIA shall be responsible for:

  1. Inspecting and issuing certificates of federal registration to plants that meet federal regulatory requirements and are engaged in the processing, holding and export of shellfish;
  2. Licensing fish importers and inspecting imported shellfish;
  3. Administering the marine biotoxin monitoring program and any other shellfish micro-biological monitoring program not described under EC's responsibilities in section 13.1.4;
  4. Recommending to DFO the closing of shellfish areas because of unacceptable marine biotoxin, microbiological and chemical levels in shellfish stock, and advising DFO when shellfish areas are acceptable for the harvesting of shellfish;
  5. Reviewing referrals from DFO for the issuing of licences for harvesting from closed areas, for relaying or depuration purposes;
  6. Maintaining records, data bases and other documents in support of marine biotoxin, microbiological and chemical closures, recommended closure actions, and administrative evaluations by internal and external auditors;
  7. Ensuring proper application of prescribed analytical and reporting procedures in CFIA laboratories and private laboratories approved in accordance with the CSSP Manual of Operations, including adequate quality assurance, performance standards and quality control of the laboratory-generated data;
  8. Ensuring proper application of prescribed sampling procedures by qualified parties, including adequate quality assurance and quality control of the collected samples;
  9. Supporting DFO in its notification activity related to section 13.1.3(e), and providing or making available to interested parties' information on program activities;
  10. Implementing CFIA elements of jointly developed Management Plans for "Conditionally Approved" areas; and
  11. Participating in the CSSP audit program, as well as in external audits by such bodies as Health Canada and the United States Food and Drug Administration.

Responsibilities of DFO

DFO shall be the lead agency in the administration of the CSSP with regard to the harvesting of shellfish and shall be responsible for:

  1. Opening and closing shellfish areas on the basis of:
    • classification recommendations from EC, based on the sanitary and bacteriological water quality of the shellfish areas, and agreed to by the regional Shellfish Area Classification Committees; and
    • recommendations from the CFIA on marine biotoxin levels, and microbiological and chemical levels in shellfish areas;
  2. Posting, patrolling and enforcing shellfish closures in accordance with the Fisheries Act;
  3. Controlling shellfish relaying operations and harvesting for depuration operations;
  4. Implementing DFO elements of jointly developed Management Plans for "Conditionally Approved" areas;
  5. Providing notification to the CFIA, EC, stakeholders and other interested parties, on locations, boundaries and timing of harvesting closures and openings;
  6. Maintaining records of the opening and closure of shellfish areas, as well as records of enforcement patrols, in support of reviews by external or internal auditors, and providing the CFIA and EC with annual patrol enforcement activity reports;
  7. Consulting with the CFIA and EC prior to the commencement of any new developmental or exploratory shellfish fisheries, and/or the issuance of any new licences or permits thereto; and
  8. Participating in the CSSP audit program, as well as in external audits by such bodies as Health Canada and the U.S. Food and Drug Administration

Responsibilities of ECCC

  1. ECCC shall be the lead agency in the administration of the CSSP with regard to recommending the appropriate classification of shellfish harvest waters based upon the sanitary and bacteriological water quality conditions of the area, and shall be responsible for:
  2. Conducting comprehensive sanitary and bacteriological water quality surveys of the shellfish areas in Canada, in accordance with the CSSP Manual of Operations criteria;
  3. From the surveys, determining the sources of point and non-point pollution, the degree of contamination and the extent of area contamination, and recommending the location of closure lines;
  4. Recommending to the regional Shellfish Area Classification Committees specific classifications of areas and their boundaries, on the basis of survey results and the classification definitions in the CSSP Manual of Operations;
  5. Maintaining records, data bases, sectoral maps, survey reports, central files and other documents in support of classification action and administrative reviews by internal and external auditors;
  6. Ensuring proper application of prescribed analytical and reporting procedures in EC laboratories, private laboratories approved in accordance with the CSSP Manual of Operations, and laboratories under contract to EC, including adequate quality assurance and quality control of the laboratory-generated data;
  7. Ensuring proper application of prescribed sampling procedures by qualified parties, including adequate quality assurance and quality control of the collected samples;
  8. Promoting pollution prevention, regulatory compliance, remediation and restoration of shellfish areas, together with federal/ provincial/ municipal agencies and other stakeholders;
  9. Supporting DFO in its notification activity pursuant to section 13.1.3(e), and providing or making available to interested parties information on program activities;
  10. Upon request, providing to DFO available information on water quality for areas proposed;
  11. Implementing EC elements of jointly developed Management Plans for "Conditionally Approved" areas; and
  12. Participating in the CSSP audit program, as well as in external audits by such bodies as Health Canada and the U.S. Food and Drug Administration.

Source: Memorandum of understanding between the Canadian Food Inspection Agency (CFIA) and Fisheries and Oceans Canada (DFO) and Environment Canada (EC) concerning the Canadian Shellfish Sanitation Program ("CSSP")

Annex G – More details on estimated current* CSSP delivery costs

43 staff were consulted for the estimates exercise:

ECCC: 4

CFIA: 17

DFO: 22

Estimated costs by category (million $)
Description

This annex shares more details on estimated current CSSP delivery costs. Subject matter experts were asked to estimate "current" costs. Given the influence of the pandemic, they used numbers which were representative of a normal year.

Forty-three program subject matter experts were consulted to estimate program costs: 4 people from ECCC, 17 from CFIA and 22 from DFO.

Estimated costs by category are presented in a table.

Current cost estimates for the CSSP program are 21.9 million dollars. ECCC is estimated to cost 6.5 million or 30% of the total cost, CFIA is estimated to cost 5.5 million dollars or 25% of the total estimated cost, and DFO’s cost is estimated to be 9.9 million dollars or 45% of the total.

The salary cost category totals 14.4 million dollars, which corresponds to 66% of the total cost estimates. The split by department for salary costs is 3.2 million dollars for ECCC, 3.6 million dollars for CFIA and 7.6 million dollars for DFO.

The Operating and maintenance (O&M) cost category totals 5.4 million dollars, which corresponds to 25% of the total cost estimates. The split by department for Operating and maintenance costs is 3.2 million dollars for ECCC, 1.1 million dollars for CFIA and 1.1 million dollars for DFO.

The Capital category totals 2.1 million dollars, which corresponds to 9% of the total cost estimates. The split by department for Capital costs is 0.1 million dollars for ECCC, 0.8 million dollars for CFIA and 1.2 million dollars for DFO.

Full-time Equivalent employees for the CSSP program are estimated at 165.4: 38.0 at ECCC, 43.7 at CFIA and 83.7 at DFO.

Operating & maintenance (O&M) details
Description

Operating and maintenance (O&M) costs are detailed in a bar graph with 6 line items:
Professional and Special Services costs are 2.9 million dollars and 53% of the Operating and maintenance (O&M) cost category. Utilities, Materials and Supplies costs are 1.0 million dollars and 19%, Travel costs are 0.5 million dollars and 9%, Repair and Maintenance costs are 0.4 million dollars and 8%, Students costs are 0.4 million dollars and 7% and finally, other costs are 0.2 million dollars and 3%.

Representation of estimated costs by CSSP region
Description

The CSSP Atlantic region represents the largest portion (46%) of the total estimated costs with total costs of 10.1 million dollars: 3.0 million dollars (13%) for ECCC, 1.9 million dollars (9%) for CFIA and 5.2 million dollars (24%) for DFO. This region includes 81.3 Full-time Equivalent employees: 17.0 at ECCC, 17.5 at CFIA and 46.8 at DFO.

The second largest CSSP region is the Pacific region representing 32% of the total estimated costs with costs of 7.0 million dollars: 1.9 million dollars (9%) for ECCC, 2.2 million dollars (10%) for CFIA and 2.9 million dollars (13%) for DFO. This region includes 57.3 Full-time Equivalent employees: 13.0 at ECCC, 19.0 at CFIA and 25.3 at DFO.

The CSSP Quebec region represents 17% of the total estimated costs with costs of 3.8 million dollars: 1.5 million dollars (6%) for ECCC, 1.1 million dollars (5%) for CFIA and 1.2 million dollars (6%) for DFO. This region includes 21.3 Full-time Equivalent employees: 7.0 at ECCC, 4.8 at CFIA and 9.5 at DFO.

Finally, the national headquarters in Ottawa represents 4% of the total estimated costs with costs of 1.0 million dollars: 0.1 million dollars (1%) for ECCC, 0.3 million dollars (1%) for CFIA and 0.6 million dollars (2%) for DFO. This region includes 5.5 Full-time Equivalent employees: 1.0 at ECCC, 2.4 at CFIA and 2.1 at DFO.

*Subject matter experts were asked to estimate "current" costs. Given the influence of the pandemic, they used numbers which were representative of a normal year.

Annex H – Management Action Plan (MAP)

Horizontal Evaluation of the Canadian Shellfish Sanitation Program(CSSP) (Project # 96744)
Performance Measurement and Evaluation Committee (PMEC) Date: June 9, 2022
MAP Completion Target Date: November 2024
Lead ADM/DC: CSSP ADM Steering Committee

Recommendation 1: Completion date: November 2023

Recommendation: It is recommended that the CSSP ADM Steering committee develop, articulate and communicate to program staff renewed strategic guidance about the program’s priorities, scope and reach to address increasing demands and evolving changes in its operating context.

Rationale: The CSSP has focused on the same objectives since its inception and is missing foundational guidance to direct staff on how to deliver the program in the current environment of increased pressures and demands and a changed operational context. There is a lack of clarity about who the program is intended to serve beyond existing commercial harvesters, and how prioritization should take place. The focus on commercial trade markets affects delivery to other stakeholders and partners, such as: recreational harvesters, Indigenous people harvesting for Food, Social and Ceremonial reasons and/or commercial businesses who do not receive the same level of program delivery or bear additional costs relating to opening new areas for shellfish harvest. This lack of strategic guidance and leadership is not new, having been raised in multiple program reviews including the 2007 horizontal evaluation of the program. Operational staff, who face these pressures on the ground, require more clarity and tools to address current gaps in meeting the needs of program stakeholders and partners.

Management Response

It is agreed that increasing program demands and evolving operational demands requires an updated strategic approach for CSSP partners and stakeholders.

Government of Canada controls for shellfish sanitation have existed for nearly a hundred years. Throughout the program’s evolution, the CSSP partners have been unified in the goal of protecting consumers at home and abroad from unsafe shellfish.  While the CSSP partners believe that design and delivery of a science-based domestic program enables trade, the program also contributes to the safe harvest of shellfish for Food Social and Ceremonial purposes as well as Recreational uses. CSSP partners recognize the benefits of transparent policies and communication.

This recommendation aligns with the on-going review of program delivery priorities and approaches and provides additional context and information for partners to consider. This work will enable a shared understanding of priorities and goals so that we can determine and communicate how best to continue to provide food safety protection for harvesters, support industry and address program expansion requests.

Link to larger program or departmental results (if applicable)

Fisheries and Oceans Canada:
2020-2021 Departmental Results Framework
Result 1.1: Canadian Fisheries are sustainably managed
Result 1.2: Canadian aquaculture is sustainably managed

Canadian Food Inspection Agency:
Program Result 9: Risks are managed

Environment and Climate Change Canada:
2021-22 Departmental Results Framework
Result: Canadians have clean water

MAP Results Statement
Result to be achieved in response to the recommendation
MAP Milestones
Critical accomplishments to ensure achievement of result for PMEC’s approval
Completion Date
Month, Year
1. Renewed strategic guidance on CSSP priorities, scope and reach. 1.1 Analysis of program demands and pressures to update priority, scope and reach of program objectives. March 2023
1.2 Validation of updated CSSP objectives by ADM Committee. June 2023
1.3 Provide operational staff in all departments with new strategic guidance on CSSP priorities, scope and reach. September 2023
1.4 Provide stakeholders with new strategic guidance on CSSP priorities, scope and reach. November 2023

Recommendation 2: Completion date: November 2024

Recommendation: It is recommended that the CSSP ADM steering committee clarify which federal partner is the lead of the CSSP. Further, it is recommended that they review all levels of interdepartmental governance and establish mechanisms to support more effective decision-making, ensure that long-standing issues are resolved, and operational staff are given timely guidance and advice when needed.

Rationale: While CFIA, DFO and ECCC have specific roles and responsibilities, their interdependence cannot be understated when it comes to delivering the CSSP. There is a lack of clarity about which federal partner is the lead on the CSSP, given discrepancies between internal documents, naming CFIA as having this role, and publicly available information. Regardless, the agency does not have the authority to direct its federal partners or impose decisions. Partners use consensus to make joint decisions, however, it is clear that mechanisms are needed to improve timely decision-making, resolve long-standing issues and move forward with unified direction that gives the integrated mandate of the CSSP the same importance as individual partners’ mandates.

The current interdepartmental governance committees that support collaborative work between partners do not provide timely support to regions when they are unable to resolve issues on their own. The National Interdepartmental Shellfish Committee (NISC) is designed to discuss issues and make recommendations to the DG Operations committee for final decisions. This arrangement does not provide responsive support to regions, who sometimes wait years before they receive guidance, or in the worst-case scenario do not receive direction at all. Changes to key governance documents (e.g., Terms of References, Memorandum of Understanding, etc.) could help address governance issues. Further, these tools contain inconsistencies and do not currently support issue resolution.

Management Response

It is agreed to review the CSSP governance, both at the national and regional levels. The CSSP partners are committed to delivering a cohesive program that reflects both the mandates of the partner departments/agency, as well as the ultimate objective of the CSSP.

The interdependence required for effective decision-making and delivery of the program will be a key consideration in the governance review. Clear governance structures will provide mechanisms for support, timely decision-making and issue resolution, which can then be communicated to partners and stakeholders.

Link to larger program or departmental results (if applicable)

Fisheries and Oceans Canada:
2020-2021 Departmental Results Framework
Result 1.1: Canadian Fisheries are sustainably managed
Result 1.2: Canadian aquaculture is sustainably managed

Canadian Food Inspection Agency:
Program Result 9: Risks are managed

Environment and Climate Change Canada:
2021-22 Departmental Results Framework
Result: Canadians have clean water

MAP Results Statement
Result to be achieved in response to the recommendation
MAP Milestones
Critical accomplishments to ensure achievement of result for PMEC’s approval
Completion Date
Month, Year
2. Stronger, integrated CSSP leadership that improves decision-making processes to allow for timely direction and guidance to operational staff. 2.1 Analyze existing governance structures, as well as TOR and MOU, to identify gaps, explore decision making powers, and agree upon a schedule to regularly review these governance structures. June 2023
2.2 Present proposed improvements to governance and decision-making processes to ADMs for endorsement. November 2023
2.3 CSSP Secretariat circulates revised governance structure within all departments. November 2024

Recommendation 3: Completion date: March 2024

Recommendation: It is recommended that the CSSP ADM Steering committee seek out opportunities to address resource gaps facing the CSSP to meet existing and increasing demands for program services and delivery. Solutions are required to address current risks related to CSSP resource management in order to ensure that health risks are minimized, the shellfish industry remains strong, and stakeholder and partner needs are served appropriately by the program.

Rationale: The evaluation found that all three federal partners are at maximum capacity and that the program as a whole does not have the level of resourcing needed to respond to existing and increasing demands. This has necessitated prioritization of delivery primarily to high-risk areas and has created unintended impacts such as impeding market growth or the lack of monitoring in long-term closures. While continued re-prioritization to fit delivery within resource allocations is one option for the program, it has the potential to increase risks to shellfish consumers and is not seen as sustainable for program delivery. As demand for services continues to grow and the program considers options for expansion, more dedicated resources are needed to deliver the CSSP effectively without relying on other internal funding sources on an opportunistic basis.

Robust resource tracking mechanisms are also needed to accurately quantify the cost of delivering the CSSP, including to further understand resource gaps to meet existing and increasing demands from stakeholders and partners.

Management Response

It is agreed that the CSSP needs a solid foundation for funding to address resource gaps, thus enabling respective partner activities and existing and future program delivery. An improved understanding of CSSP expenditures, such as through use of a common financial code would provide information to support resourcing conversations.

Link to larger program or departmental results (if applicable)

Fisheries and Oceans Canada:
2020-2021 Departmental Results Framework
Result 1.1: Canadian Fisheries are sustainably managed
Result 1.2: Canadian aquaculture is sustainably managed

Canadian Food Inspection Agency:
Program Result 9: Risks are managed

Environment and Climate Change Canada:
2021-22 Departmental Results Framework
Result: Canadians have clean water

MAP Results Statement
Result to be achieved in response to the recommendation
MAP Milestones
Critical accomplishments to ensure achievement of result for PMEC’s approval
Completion Date
Month, Year
3. Resource gaps are identified and addressed either on a risk management basis or through the provision of additional resources. 3.1 CSSP partners conduct analysis of CSSP funding options (including cost recovery and cost sharing) and propose options that address the identified resource gaps and increasing demands for program services and delivery. March 2023
3.2 Develop guidance to ensure the program delivery is prioritized consistently across all partner organizations. December 2023
3.3 Determine if a common code is possible between all departments for tracking expenditures and apply them to the extent possible at CFIA and DFO. March 2024

Recommendation 4: Completion date: June 2024

Recommendation: It is recommended that the CSSP ADM Steering committee review the CSSP’s performance measures and develop an integrated performance profile with meaningful performance indicators and targets at the program level. Useful and accurate information on the achievement of results is needed to better support the management of the program. Ideally, program level performance indicators could be integrated into the broader results frameworks of the three partner organizations. CSSP performance data needs to be tracked, collected and reported consistently and in a timely manner across all three federal partners and all regions. Roles and responsibilities for collecting and storing the data should also be established.

Rationale: As the CSSP proceeds with modernization, there is a need to reassess performance information needs and data collection and tracking mechanisms, with a focus on integrated program results. While the program does collect some useful performance data, there are some limitations related to reliability, inaccessibility, incompleteness and confusion about roles and responsibilities for data collection and storage. Further, while the absence of reported fatalities since 1987 is positive, and could be considered an indicator of program success, in reality, fatalities are the worst-case scenario, and their occurrence would be an indication of program failure. Better information is needed to track and demonstrate where CSSP is performing well and where it needs improvement.

An integrated performance profile with more meaningful indicators and targets would allow for a more nuanced understanding of the program’s ability to achieve its objectives.

Management Response

It is agreed that a renewed performance framework, with meaningful indicators and targets, and data management practices, will improve our ability to reliably and accurately report on the program. Each of the CSSP partners has its respective performance approaches under the GOC policy on results; however, none of these link clearly to the CSSP. The CSSP Performance Measurement Strategy needs to be reviewed with this performance lens.

Clear and specific measures and targets will enable improved analysis of relevant data, thus supporting continuous improvement. Up to date Performance information and processes for compiling this information more efficiently and effectively, will enable the program to improve how we assess our overall performance, as well as demonstrate achievement of outcomes and goals to partners and stakeholders.

Link to larger program or departmental results (if applicable)

Fisheries and Oceans Canada:
2020-2021 Departmental Results Framework
Result 1.1: Canadian Fisheries are sustainably managed
Result 1.2: Canadian aquaculture is sustainably managed

Canadian Food Inspection Agency:
Program Result 9: Risks are managed

Environment and Climate Change Canada:
2021-22 Departmental Results Framework
Result: Canadians have clean water

MAP Results Statement
Result to be achieved in response to the recommendation
MAP Milestones
Critical accomplishments to ensure achievement of result for PMEC’s approval
Completion Date
Month, Year
4. An integrated performance measurement framework, with meaningful indicators and targets, that reports to Canadians and supports the continued improvement of program management and delivery. 4.1 Partners review and update the performance strategies, logic models and performance measures, in collaboration with their respective heads of Performance Measurement. December 2023
4.2 Establish and communicate a process for reporting to CSSP ADMs on yearly basis in order to monitor performance and continuously improve the program. June 2024
Date modified: