Metrics report for milestone 1.3 of the National Action Plan on Open Government 2022–2024 – Making climate change science more open and accessible

Metrics report for milestone 1.3 – making climate change science more open and accessible
Theme 1 of the National Action Plan on Open Government 2022–2024 “Climate Change and Sustainable Growth”
Environment and Climate Change Canada
Reporting year 2023

National Action Plan on Open Government 2022-2024

Theme 1: Climate change and sustainable growth

The National Action Plan on Open Government 2022–2024 (NAP) commits to making the Government of Canada more transparent and accountable, while also giving Canadians the chance to take part in how government makes decisions.

This document provides an update (reporting year 2023) on progress of Science-Based Departments and Agencies (SBDAs) in implementing Open Science, in fulfillment of Milestone 1.3 of the NAP – “Making climate change science more open and accessible” – which requires:

1.3.1 – New metric to be designed [completed] and included in yearly reports to assess open access of climate change publications by science-based departments and agencies, using data from an abstract and citation database.

1.3.2 – Yearly reports on progress against existing metrics that measure how science-based departments and agencies implement open science, with a focus on open access metrics and diverse types of open access, to be released in the open.

This annual progress report for 2023 provides an overview of the advancements made in fulfilling Milestone 1.3, including updates on the metric introduced in 1.3.1, initially reported in the 2022 progress report. Additionally, it addresses the requirements of 1.3.2, focusing on progress against existing open access metrics. For this report, open access is defined as free and unrestricted online access to research publications and data (see Annex 1 for descriptions of open access status for scientific publications).

This report covers results for the following SBDAs:

Caveat: Due to operational considerations, bibliometric data from previous years (1998–2020) were obtained from Web of Science, while bibliometric data for years 2021 and 2022 were obtained from Scopus. Variations in bibliometric data between the two databases can arise from differences in database coverage, indexing policies, update frequency, citation counting methods, data cleaning procedures, the presence of errors and inconsistencies, etc. Due to these differences, the data presented in this, and previous reports should be regarded as an approximation. Please see Annex 2 for additional details on methodology and Annex 3 for keywords used to identify climate change-related publications.

Results

1.3.1 – Update on the metric designed and included in yearly reports to assess open access of climate change science publications using data from an abstract and citation database.

Metric: total consolidated Annual Number and Percentage of Climate Change Science Publications by Open Access Status, for All SBDAs, for the Period of 1998 to 2022 (See Annexes 2 and 3 for methodology). Environment and Climate Change Canada (ECCC) first developed and reported on this metric in 2022. Table 1a and Table 1b report on the metric by year while Table 2a and Table 2b consolidate the years and report on the metric by SBDA.

Table 1a: Annual number of climate change publications for all SBDAs from 1998 to 2022 (Numbera)
Year Gold Green Hybrid Bronze Sub-total OA Closed NAb NoDOI Total
1998 - 1 1 12 14 51 19 3 87
1999 - 4 - 25 29 45 19 8 101
2000 - 4 5 26 35 62 14 10 121
2001 - 7 1 19 27 74 15 7 123
2002 1 10 4 19 34 80 13 30 157
2003 - 9 2 26 37 93 13 10 153
2004 1 10 2 25 38 93 8 6 145
2005 1 13 7 33 54 99 - 4 157
2006 5 25 10 33 73 114 - 8 195
2007 4 10 6 46 66 133 - 7 206
2008 11 15 14 43 83 131 - 4 218
2009 12 22 13 39 86 138 - 7 231
2010 18 20 21 50 109 145 - 7 261
2011 32 27 20 58 137 170 1 3 311
2012 29 38 20 51 138 193 - 6 337
2013 43 32 32 61 168 173 - 2 343
2014 53 36 35 42 166 175 1 2 344
2015 47 33 51 46 177 184 - 1 362
2016 75 31 60 44 210 149 1 2 362
2017 88 38 44 44 214 157 - 1 372
2018 166 53 81 49 349 145 3 1 498
2019 160 36 73 32 301 188 1 - 490
2020 172 34 78 27 311 185 3 4 503
2021 431 100 197 81 809 391  - 25 1,225
2022 376 108 214 70 768 358  - 22 1,148
1998–2022 1,725 716 991 1,001 4,433 3,726 111 180 8,450

a Some publications are assigned more than one category of open access (e.g., Gold/Green, Bronze/Green) by bibliometric databases. However, for the purposes of this analysis, publications are counted only once according to the “most open” status of the publication (e.g., Gold/Green papers were rolled into the Gold category).

b “NA” includes publications for which there was a digital object identifier (DOI) for the publication; however, the DOI did not match to a document in the Unpaywall database. The Unpaywall database is integrated with bibliometric databases and is used to determine open access status. The “NA” column applies only to the 1998–2020 period, as items with no results from Unpaywall for 2021 and 2022 were manually checked to determine open access status.

Table 1b: Annual number of climate change publications for all SBDAs from 1998 to 2022 (Percentagea)
Year Gold Green Hybrid Bronze Sub-total OA Closed NAb NoDOI Total
1998 - 1.1% 1.1% 13.8% 16.1% 58.6% 21.8% 3.4% 100.0%
1999 - 4.0% - 24.8% 28.7% 44.6% 18.8% 7.9% 100.0%
2000 - 3.3% 4.1% 21.5% 28.9% 51.2% 11.6% 8.3% 100.0%
2001 - 5.7% 0.8% 15.4% 22.0% 60.2% 12.2% 5.7% 100.0%
2002 0.6% 6.4% 2.5% 12.1% 21.7% 51.0% 8.3% 19.1% 100.0%
2003 - 5.9% 1.3% 17.0% 24.2% 60.8% 8.5% 6.5% 100.0%
2004 0.7% 6.9% 1.4% 17.2% 26.2% 64.1% 5.5% 4.1% 100.0%
2005 0.6% 8.3% 4.5% 21.0% 34.4% 63.1% - 2.5% 100.0%
2006 2.6% 12.8% 5.1% 16.9% 37.4% 58.5% - 4.1% 100.0%
2007 1.9% 4.9% 2.9% 22.3% 32.0% 64.6% - 3.4% 100.0%
2008 5.0% 6.9% 6.4% 19.7% 38.1% 60.1% - 1.8% 100.0%
2009 5.2% 9.5% 5.6% 16.9% 37.2% 59.7% - 3.0% 100.0%
2010 6.9% 7.7% 8.0% 19.2% 41.8% 55.6% - 2.7% 100.0%
2011 10.3% 8.7% 6.4% 18.6% 44.1% 54.7% 0.3% 1.0% 100.0%
2012 8.6% 11.3% 5.9% 15.1% 40.9% 57.3% - 1.8% 100.0%
2013 12.5% 9.3% 9.3% 17.8% 49.0% 50.4% - 0.6% 100.0%
2014 15.4% 10.5% 10.2% 12.2% 48.3% 50.9% 0.3% 0.6% 100.0%
2015 13.0% 9.1% 14.1% 12.7% 48.9% 50.8% - 0.3% 100.0%
2016 20.7% 8.6% 16.6% 12.2% 58.0% 41.2% 0.3% 0.6% 100.0%
2017 23.7% 10.2% 11.8% 11.8% 57.5% 42.2% 0.0% 0.3% 100.0%
2018 33.3% 10.6% 16.3% 9.8% 70.1% 29.1% 0.6% 0.2% 100.0%
2019 32.7% 7.3% 14.9% 6.5% 61.4% 38.4% 0.2% 0.0% 100.0%
2020 34.2% 6.8% 15.5% 5.4% 61.8% 36.8% 0.6% 0.8% 100.0%
2021 35.2% 8.2% 16.1% 6.6% 66.0% 31.9% 0.0% 2.0% 100.0%
2022 32.8% 9.4% 18.6% 6.1% 66.9% 31.2% 0.0% 1.9% 100.0%
1998–2022 20.4% 8.5% 11.7% 11.8% 52.5% 44.1% 1.3% 2.1% 100.0%

a Some publications are assigned more than one category of open access (e.g., Gold/Green, Bronze/Green) by bibliometric databases. However, for the purposes of this analysis, publications are counted only once according to the “most open” status of the publication (e.g., Gold/Green papers were rolled into the Gold category).

b “NA” includes publications for which there was a digital object identifier (DOI) for the publication; however, the DOI did not match to a document in the Unpaywall database. The Unpaywall database is integrated with bibliometric databases and is used to determine open access status. The “NA” column applies only to the 1998–2020 period, as items with no results from Unpaywall for 2021 and 2022 were manually checked to determine open access status.

Table 2a: Number of SBDA climate change publications by Department and Agency and Open Access status from 1998 to 2022 (Numbera)
Department and agency Gold Green Hybrid Bronze Sub-total OA Closed NAb NoDOI Total
All SBDAs 1,818 756 1,036 1,067 4,677 3,883 112 188 8,860
Agriculture and Agri-Food Canada 152 63 109 107 431 482 6 11 930
Atomic Energy of Canada Limited 2 1 - 2 5 6 - - 11
Canadian Food Inspection Agency 8 1 3 2 14 8 - 1 23
Canadian Space Agency 5 - 4 - 9 13 - 1 23
Defence Research and Development Canada/National Defence 1 0 6 1 8 18 - 2 28
Environment and Climate Change Canada 736 292 458 413 1,899 1,199 64 63 3,225
Fisheries and Oceans Canada 310 130 187 254 881 731 23 34 1,669
Health Canada 62 11 38 12 123 34 - 3 160
Innovation, Science and Economic Development Canada 6 2 - - 8 1 - 1 10
National Research Council Canada 101 41 16 30 188 182 - 14 384
Natural Resources Canada 351 195 174 229 949 1,141 19 56 2,165
Parks Canada 27 9 17 6 59 35 - 2 96
Polar Knowledge 12 4 6 1 23 2 - - 25
Public Health Agency of Canada 44 7 15 10 76 25 - - 101
Statistics Canada - 3 - 3 3 - - 6
Transport Canada 1 - - - 1 3 - - 4

a Some publications are assigned more than one category of open access (e.g., Gold/Green, Bronze/Green) by bibliometric databases. However, for the purposes of this analysis, publications are counted only once according to the “most open” status of the publication (e.g., Gold/Green papers were rolled into the Gold category).

b “NA” includes publications for which there was a digital object identifier (DOI) for the publication; however, the DOI did not match to a document in the Unpaywall database. The Unpaywall database is integrated with bibliometric databases and is used to determine open access status. The “NA” column applies only to the 1998–2020 period, as items with no results from Unpaywall for 2021 and 2022 were manually checked to determine open access status.

Table 2b: Percentage of SBDA climate change publications by Department and Agency and Open Access status from 1998 to 2022 (Percentagea)
Department and agency Gold Green Hybrid Bronze Sub-total OA Closed NAb NoDOI Total
All SBDAs 20.5% 8.5% 11.7% 12.0% 52.8% 43.8% 1.3% 2.1% 100.0%
Agriculture and Agri-Food Canada 16.3% 6.8% 11.7% 11.5% 46.3% 51.8% 0.6% 1.2% 100.0%
Atomic Energy of Canada Limited 18.2% 9.1% - 18.2% 45.5% 54.5% - - 100.0%
Canadian Food Inspection Agency 34.8% 4.3% 13.0% 8.7% 60.9% 34.8% - 4.3% 100.0%
Canadian Space Agency 21.7% - 17.4% - 39.1% 56.5% - 4.3% 100.0%
Defence Research and Development Canada/National Defence 3.6% - 21.4% 3.6% 28.6% 64.3% - 7.1% 100.0%
Environment and Climate Change Canada 22.8% 9.1% 14.2% 12.8% 58.9% 37.2% 2.0% 2.0% 100.0%
Fisheries and Oceans Canada 18.6% 7.8% 11.2% 15.2% 52.8% 43.8% 1.4% 2.0% 100.0%
Health Canada 38.8% 6.9% 23.8% 7.5% 76.9% 21.3% - 1.9% 100.0%
Innovation, Science and Economic Development Canada 60.0% 20.0% - - 80.0% 10.0% - 10.0% 100.0%
National Research Council Canada 26.3% 10.7% 4.2% 7.8% 49.0% 47.4% - 3.6% 100.0%
Natural Resources Canada 16.2% 9.0% 8.0% 10.6% 43.8% 52.7% 0.9% 2.6% 100.0%
Parks Canada 28.1% 9.4% 17.7% 6.3% 61.5% 36.5% - 2.1% 100.0%
Polar Knowledge 48.0% 16.0% 24.0% 4.0% 92.0% 8.0% - - 100.0%
Public Health Agency of Canada 43.6% 6.9% 14.9% 9.9% 75.2% 24.8% - - 100.0%
Statistics Canada - - 50.0% - 50.0% 50.0% - - 100.0%
Transport Canada 25.0% - - - 25.0% 75.0% - - 100.0%

a Some publications are assigned more than one category of open access (e.g., Gold/Green, Bronze/Green) by bibliometric databases. However, for the purposes of this analysis, publications are counted only once according to the “most open” status of the publication (e.g., Gold/Green papers were rolled into the Gold category).

b “NA” includes publications for which there was a digital object identifier (DOI) for the publication; however, the DOI did not match to a document in the Unpaywall database. The Unpaywall database is integrated with bibliometric databases and is used to determine open access status. The “NA” column applies only to the 1998–2020 period, as items with no results from Unpaywall for 2021 and 2022 were manually checked to determine open access status.

1.3.2 – Yearly reports on progress against existing metrics that measure how science-based departments and agencies implement open science, with a focus on open access metrics and diverse types of open access, to be released in the open

Metric: total consolidated Annual Number and Percentage of SBDA Publications by Open Access Status, for the Period of 1998 to 2022. This metric measures how SBDAs implement Open Science. Canada reported on this metric in 2019, 2020, and 2022. Table 3a and Table 3b report on the metric by year while Table 4a and Table 4b consolidate the years and report on the metric by SBDA.

a Some publications are assigned more than one category of open access (e.g., Gold/Green, Bronze/Green) by bibliometric databases. However, for the purposes of this analysis, publications are counted only once according to the “most open” status of the publication (e.g., Gold/Green papers were rolled into the Gold category).

b “NA” includes publications for which there was a digital object identifier (DOI) for the publication; however, the DOI did not match to a document in the Unpaywall database. The Unpaywall database is integrated with bibliometric databases and is used to determine open access status. The “NA” column applies only to the 1998–2020 period, as items with no results from Unpaywall for 2021 and 2022 were manually checked to determine open access status.

Table 3a: Annual number of SBDA publications by open access status from 1998 to 2022 (Numbera)
Year Gold Green Hybrid Bronze Sub-total OA Closed NAb NoDOI Total
1998 12 123 45 313 493 2,196 141 572 3,402
1999 24 125 33 359 541 1,994 130 551 3,216
2000 21 167 54 369 611 2,161 137 468 3,377
2001 23 172 56 366 617 2,128 84 447 3,276
2002 34 189 51 428 702 1,842 64 840 3,448
2003 42 224 64 505 835 2,298 44 519 3,696
2004 52 282 78 494 906 2,467 32 441 3,846
2005 62 344 79 490 975 2,611 15 360 3,961
2006 95 406 76 507 1,084 2,727 6 283 4,100
2007 132 385 96 571 1,184 2,654 1 259 4,098
2008 180 459 110 544 1,293 2,866 1 281 4,441
2009 226 516 112 577 1,431 2,864 2 206 4,503
2010 312 718 134 611 1,775 2,531 9 193 4,508
2011 370 693 142 592 1,797 2,743 6 178 4,724
2012 431 521 184 604 1,740 2,847 9 173 4,769
2013 546 436 214 540 1,736 2,664 10 144 4,554
2014 497 418 262 486 1,663 2,529 7 102 4,301
2015 580 407 306 514 1,807 2,280 3 75 4,165
2016 737 423 351 552 2,063 2,033 6 108 4,210
2017 807 505 304 457 2,073 1,962 12 79 4,126
2018 1,022 498 433 441 2,394 1,880 19 80 4,373
2019 1,106 395 495 341 2,337 1,939 36 79 4,391
2020 1,270 351 564 223 2,408 2,042 40 41 4,531
2021 1,883 534 841 599 3,857 2,478 - 213 6,548
2022 1,872 517 965 323 3,677 2,337 - 174 6,188
1998–2022 12,336 9,808 6,049 11,806 39,999 59,073 814 6,866 106,752
Table 3b: Annual number of SBDA publications by open access status from 1998 to 2022 (Percentagea)
Year Gold Green Hybrid Bronze Sub-total OA Closed NAb NoDOI Total
1998 0.4% 3.6% 1.3% 9.2% 14.5% 64.6% 4.1% 16.8% 100.0%
1999 0.7% 3.9% 1.0% 11.2% 16.8% 62.0% 4.0% 17.1% 100.0%
2000 0.6% 4.9% 1.6% 10.9% 18.1% 64.0% 4.1% 13.9% 100.0%
2001 0.7% 5.3% 1.7% 11.2% 18.8% 65.0% 2.6% 13.6% 100.0%
2002 1.0% 5.5% 1.5% 12.4% 20.4% 53.4% 1.9% 24.4% 100.0%
2003 1.1% 6.1% 1.7% 13.7% 22.6% 62.2% 1.2% 14.0% 100.0%
2004 1.4% 7.3% 2.0% 12.8% 23.6% 64.1% 0.8% 11.5% 100.0%
2005 1.6% 8.7% 2.0% 12.4% 24.6% 65.9% 0.4% 9.1% 100.0%
2006 2.3% 9.9% 1.9% 12.4% 26.4% 66.5% 0.1% 6.9% 100.0%
2007 3.2% 9.4% 2.3% 13.9% 28.9% 64.8% 0.0% 6.3% 100.0%
2008 4.1% 10.3% 2.5% 12.2% 29.1% 64.5% 0.0% 6.3% 100.0%
2009 5.0% 11.5% 2.5% 12.8% 31.8% 63.6% 0.0% 4.6% 100.0%
2010 6.9% 15.9% 3.0% 13.6% 39.4% 56.1% 0.2% 4.3% 100.0%
2011 7.8% 14.7% 3.0% 12.5% 38.0% 58.1% 0.1% 3.8% 100.0%
2012 9.0% 10.9% 3.9% 12.7% 36.5% 59.7% 0.2% 3.6% 100.0%
2013 12.0% 9.6% 4.7% 11.9% 38.1% 58.5% 0.2% 3.2% 100.0%
2014 11.6% 9.7% 6.1% 11.3% 38.7% 58.8% 0.2% 2.4% 100.0%
2015 13.9% 9.8% 7.3% 12.3% 43.4% 54.7% 0.1% 1.8% 100.0%
2016 17.5% 10.0% 8.3% 13.1% 49.0% 48.3% 0.1% 2.6% 100.0%
2017 19.6% 12.2% 7.4% 11.1% 50.2% 47.6% 0.3% 1.9% 100.0%
2018 23.4% 11.4% 9.9% 10.1% 54.7% 43.0% 0.4% 1.8% 100.0%
2019 25.2% 9.0% 11.3% 7.8% 53.2% 44.2% 0.8% 1.8% 100.0%
2020 28.0% 7.7% 12.4% 4.9% 53.1% 45.1% 0.9% 0.9% 100.0%
2021 28.8% 8.2% 12.8% 9.1% 58.9% 37.8% 0.0% 3.3% 100.0%
2022 30.3% 8.4% 15.6% 5.2% 59.4% 37.8% 0.0% 2.8% 100.0%
1998–2022 9.1% 9.3% 4.5% 11.6% 34.5% 57.7% 0.9% 6.9% 100.0%

a Some publications are assigned more than one category of open access (e.g., Gold/Green, Bronze/Green) by bibliometric databases. However, for the purposes of this analysis, publications are counted only once according to the “most open” status of the publication (e.g., Gold/Green papers were rolled into the Gold category).

b “NA” includes publications for which there was a digital object identifier (DOI) for the publication; however, the DOI did not match to a document in the Unpaywall database. The Unpaywall database is integrated with bibliometric databases and is used to determine open access status. The “NA” column applies only to the 1998–2020 period, as items with no results from Unpaywall for 2021 and 2022 were manually checked to determine open access status.

Table 4a: Number of SBDA publications broken down by Department and Agency and Open Access status from 1998 to 2022 (Numbera)
Department and agency Gold Green Hybrid Bronze Sub-total OA Closed NAb NoDOI Total
ALL SBDAs 14,160 10,378 6,641 13,129 44,308 63,181 858 7,563 115,910
Agriculture and Agri-Food Canada 2,976 845 1,414 3,377 8,612 14,095 79 2,028 24,814
Atomic Energy of Canada Limited 46 86 36 41 209 1,035 4 97 1,345
Canadian Food Inspection Agency 389 106 138 245 878 1,023 6 302 2,209
Canadian Space Agency 36 43 22 54 155 384 4 38 581
Defence Research and Development Canada/National Defence 273 217 91 215 796 2,440 30 316 3,582
Environment and Climate Change Canada 2,103 896 1,255 1,454 5,708 8,440 237 712 15,097
Fisheries and Oceans Canada 1,318 616 730 1,515 4,179 6,126 104 446 10,855
Health Canada 1,874 613 884 1,550 4,921 4,000 51 784 9,756
Innovation, Science and Economic Development Canada 59 49 3 43 154 772 10 45 981
National Research Council Canada 1,832 5,544 820 2,332 10,528 13,122 184 1,286 25,120
Natural Resources Canada 1,467 842 730 1,342 4,381 9,579 88 910 14,958
Parks Canada 111 35 47 51 244 339 2 23 608
Polar Knowledge 32 11 8 3 54 12 - - 66
Public Health Agency of Canada 1,494 337 371 812 3,014 1,238 15 245 4,512
Statistics Canada 146 135 86 92 459 510 43 311 1,323
Transport Canada 4 3 6 3 16 66 1 20 103

a Some publications are assigned more than one category of open access (e.g., Gold/Green, Bronze/Green) by bibliometric databases. However, for the purposes of this analysis, publications are counted only once according to the “most open” status of the publication (e.g., Gold/Green papers were rolled into the Gold category).

b “NA” includes publications for which there was a digital object identifier (DOI) for the publication; however, the DOI did not match to a document in the Unpaywall database. The Unpaywall database is integrated with bibliometric databases and is used to determine open access status. The “NA” column applies only to the 1998–2020 period, as items with no results from Unpaywall for 2021 and 2022 were manually checked to determine open access status.

Table 4b: Percentage of SBDA publications broken down by Department and Agency and Open Access status from 1998 to 2022 (Percentagea)
Department and agency Gold Green Hybrid Bronze Sub-total OA Closed NAb NoDOI Total
ALL SBDAs 12.2% 9.0% 5.7% 11.3% 38.2% 54.5% 0.7% 6.5% 100.0%
Agriculture and Agri-Food Canada 12.0% 3.4% 5.7% 13.6% 34.7% 56.8% 0.3% 8.2% 100.0%
Atomic Energy of Canada Limited 3.4% 6.4% 2.7% 3.0% 15.5% 77.0% 0.3% 7.2% 100.0%
Canadian Food Inspection Agency 17.6% 4.8% 6.2% 11.1% 39.7% 46.3% 0.3% 13.7% 100.0%
Canadian Space Agency 6.2% 7.4% 3.8% 9.3% 26.7% 66.1% 0.7% 6.5% 100.0%
Defence Research and Development Canada/National Defence 7.6% 6.1% 2.5% 6.0% 22.2% 68.1% 0.8% 8.8% 100.0%
Environment and Climate Change Canada 13.9% 5.9% 8.3% 9.6% 37.8% 55.9% 1.6% 4.7% 100.0%
Fisheries and Oceans Canada 12.1% 5.7% 6.7% 14.0% 38.5% 56.4% 1.0% 4.1% 100.0%
Health Canada 19.2% 6.3% 9.1% 15.9% 50.4% 41.0% 0.5% 8.0% 100.0%
Innovation, Science and Economic Development Canada 6.0% 5.0% 0.3% 4.4% 15.7% 78.7% 1.0% 4.6% 100.0%
National Research Council Canada 7.3% 22.1% 3.3% 9.3% 41.9% 52.2% 0.7% 5.1% 100.0%
Natural Resources Canada 9.8% 5.6% 4.9% 9.0% 29.3% 64.0% 0.6% 6.1% 100.0%
Parks Canada 18.3% 5.8% 7.7% 8.4% 40.1% 55.8% 0.3% 3.8% 100.0%
Polar Knowledge 48.5% 16.7% 12.1% 4.5% 81.8% 18.2% 0.0% 0.0% 100.0%
Public Health Agency of Canada 33.1% 7.5% 8.2% 18.0% 66.8% 27.4% 0.3% 5.4% 100.0%
Statistics Canada 11.0% 10.2% 6.5% 7.0% 34.7% 38.5% 3.3% 23.5% 100.0%
Transport Canada 3.9% 2.9% 5.8% 2.9% 15.5% 64.1% 1.0% 19.4% 100.0%

a Some publications are assigned more than one category of open access (e.g., Gold/Green, Bronze/Green) by bibliometric databases. However, for the purposes of this analysis, publications are counted only once according to the “most open” status of the publication (e.g., Gold/Green papers were rolled into the Gold category).

b “NA” includes publications for which there was a digital object identifier (DOI) for the publication; however, the DOI did not match to a document in the Unpaywall database. The Unpaywall database is integrated with bibliometric databases and is used to determine open access status. The “NA” column applies only to the 1998–2020 period, as items with no results from Unpaywall for 2021 and 2022 were manually checked to determine open access status.

Annex 1: Description of open access status for scientific publications

Annex 1: Description of open access status for scientific publications
Open access status Description
Gold Available on the publisher's website in a journal where all articles are open access.
Green Available in an Open Access repository, including preprints servers.
Hybrid Available on the publisher's website under an open licence in a journal where not all articles are open access.
Bronze Available on the publisher's website without an open licence in a journal where not all articles are Open Access.
Closed Not available in Open Access
No DOI No Digital Object Identifier (DOI) included and is designated as a closed publication.

Annex 2: Methodology of retrieving bibliometric data

Bibliometric data

The bibliometric data for 2021 and 2022 presented in this analysis was drawn from the Elsevier Scopus database. As of 2023, Scopus included indexed content from over 7000 publishers, including 26,000+ serials and 292,000+ books from all fields of knowledge (see Scopus Content Coverage Guide, March 2023) (PDF). Scopus does not include all documents likely to have been published by researchers, since some works are disseminated through other scientific media not indexed by Scopus (e.g., specialized journals, national journals, grey literature, and conference proceedings not published in journals). Some SBDAs publish many grey literature reports, such as Environment and Climate Change Canada’s Canadian Wildlife Service Migratory Birds Regulatory Report series and documents produced by the Canadian Science Advisory Secretariat at Fisheries and Oceans Canada. As a result, the data presented here are an approximation of open access to SBDA’s scientific output. Scopus does, however, index the share of researchers’ scientific output that is the most visible for Canadian and worldwide scientific communities, and is therefore most likely to be cited. In addition, we have taken a “full counting” approach, meaning that each publication produced by an entity (e.g., government department,  research institution, etc. ) is counted once for that entity, regardless of the number of co-authors involved from the entity. For example, if a publication was authored by two ECCC employees, one NRCan employee and one Health Canada employee, each department would be counted as having one publication. The Scopus database includes several types of documents, such as articles, reviews, books, book chapters, conference papers, letters, data papers, editorials, erratum, and short surveys. All document types were included in this analysis.

The data for 1998-2020 provided in previous progress reports on open science (ECCC, 2019, 2020, 2022) were drawn from Clarivate’s Web of Science. In 2020, the Web of Science platform included three databases (the Science Citation Index Expanded™, the Social Sciences Citation Index™ and the Arts & Humanities Citation Index™) that covered, in 2020, more than 13,000 journals from all fields of knowledge (ECCC, 2023). A comparative study of the two databases found that Scopus covered 99.11% of the journals indexed in the Web of Science and included 66.07% more unique journals than Web of Science (Singh et al., 2021). Consequently, it is likely that a search that used Scopus but covered the same period would result in more publications.

For the 1998–2020 period, some publication records included a digital object identifier (DOI) that did not match to a document in the Unpaywall database. The Unpaywall database is integrated with bibliometric databases and is used to determine open access status. Those publication records are listed in the “NA” column in the tables. Items with no results from Unpaywall for 2021 and 2022 were manually checked to determine open access status.

References

ECCC (Environment and Climate Change Canada). (2019). Federal progress in implementing open science: 2019 annual report.

ECCC. The 2020 annual report on the federal progress in implementing open science and its benefits.

ECCC. Metrics Report for Milestone 1.3 – Making climate change science more open and accessible. Reporting year 2022.

Singh, V.K., Singh, P., Karmakar, M., Leta, J., & Mayr, P. (2021). The journal coverage of Web of Science, Scopus and Dimensions: A comparative analysis. Scientometrics 126, 5113–5142.

Annex 3: Keywords used in the retrieval strategy for the climate change scientific publications metric (Tables 1a, 1b, 2a and 2b)

Research on climate change, to a great extent, is a multidisciplinary field which cannot be delimited by the traditional disciplinary classifications used in the bibliometric database. For reporting year 2022, the OST, within the Université du Québec à Montréal (UQAM), created a retrieval strategy with keyword queries and selected keywords from a list of the most frequent keywords extracted from 30,014 bibliographic records of papers cited in the third and fourth reports of the three working groups under the Intergovernmental Panel on Climate Change (IPCC). These keywords were used once again by ECCC Library Services as part of its bibliometric data retrieval strategy for reporting year 2023. 

Climate change keywords
Model parameters Atmosphere Climate Earth and space sciences Ocean

Air-Temperature Variation

Atmospheric model

Atmospheric Parameterization

Climate Change Scenario

Climate Model

Climate Modelling

Climate Simulation

Climatic Modelling

Climatic Simulation

Cyclone Activity

Dynamic Global Vegetation Model

Extreme Rainfall

Extreme Weather

Flood Risk

GCM Simulation

General-Circulation Model

Heatwave

Intra-Seasonal Oscillation

Kyoto Protocol

Ocean Model

Ocean Modelling

Ocean Simulation

Ocean-Atmosphere General Circulation Model

Ocean-Atmosphere Model

Potential Evapotranspiration

Precipitation Event

Precipitation Variability

Seasonality" and "Climate

Simulated Climate

Storm Surge

Surface Air-Temperature

Temperature Trend

Aerosol Effect

Aerosol Emission

African Monsoon

Antarctic Oscillation

Anthropogenic Aerosol

Anthropogenic Carbon

Anthropogenic Emission

Anthropogenic Sulfate

Arctic Oscillation

Asian Monsoon

Asian Summer Monsoon

Atmosphere Dynamics

Atmospheric Aerosol

Atmospheric Carbon Dioxide

Atmospheric Circulation

Atmospheric Circulation Pattern

Atmospheric CO2

Atmospheric Methane

Black Carbon

Carbon Budget

Carbon Cycle

Carbon Sequestration

Carbon Sink

Carbon Storage

Carbonaceous Aerosol

Carbon Dioxide Capture

Carbon Dioxide Emission

CH4 Emission

CO2 Emission

El-Nino

Extratropical Circulation

GHG Emission

Greenhouse Effect

Greenhouse Gases

Greenhouse Warming

La Nina

Madden-Julian Oscillation

Methane Emission

North Atlantic Oscillation

Stratospheric Circulation

Sulphate Aerosol

Tropospheric Aerosol

Tropospheric Methane

Annular Mode

Anthropogenic Climate

Climate Change

Climate Dynamics

Climate Extreme

Climate Feedback

Climate Forcing

Climate Forecast

Climate Governance

Climate Impact

Climate Interannual Variability

Climate Interdecadal Variability

Climate Oscillation

Climate Policy

Climate Response

Climate Sensitivity

Climate Simulation

Climate Trend

Climate Variability

Climate Variation

Climate Warming

Climatic Change

Climatic Impact

Climatic Oscillation

Climatic Response

Climatic System

Climatic Trend

Climatic Variability

Climatology

Cost of Climate

Effect of Climate

Future Climate

Global Warming

Long-Term Climate

Potential Climate

Regional Warming

Transient Climate

Warming Potential

Winter Climate

Lagrangian Model

AMOCa

Drought

ENSOb

Albedo

Antarctic Melting

Atlantic Circulation

Atlantic Thermohaline Circulation

Coastal Erosion

Coastal Management

Coastal Vulnerability

Coral Mortality

Deep Convection

East Greenland Current

Equilibrium Line Altitude

Greenland Ice

Greenland Ice Sheet

Greenland Melting

Ice Core

Ice Shelf

Ice Sheet

North Atlantic Circulation

North Atlantic Deep-Water

North Atlantic Drift

North Atlantic Ocean

Ocean Carbon

Ocean Circulation

Ocean Heat

Pacific Circulation

Permafrost

Polar Ice

Sea Ice Extent

Sea-Ice Cover

Sea-Ice Cover Duration

Sea-Level Change

Sea-Level Rise

Sea-Surface Salinity

Sea-Surface Temperature

SST Anomaly

Thermohaline Circulation

Tropical Convection

Upper Ocean

a Atlantic meridional overturning circulation (AMOC)

b El Niño-Southern Oscillation (ENSO)

Page details

Date modified: