Volume 34 · Number 1 · February 2014
Chronic Diseases and Injuries in Canada
Validation of a deprivation index for public health: a complex exercise illustrated by the Quebec index
R. Pampalon, PhD; D. Hamel, MSc; P. Gamache, BSc; A. Simpson, MSc; M. D. Philibert, PhD
https://doi.org/10.24095/hpcdp.34.1.03
This article has been peer reviewed.
Author references:
Institut national de santé publique du Québec, Québec, Quebec, Canada
Correspondence: Robert Pampalon, Institut national de santé publique du Québec, 945 Wolfe Avenue, Quebec City, QC G1V 5B3; Tel.: 418-650-5115 ext. 5719; Fax: 418-654-3136; Email: robert.pampalon@inspq.qc.ca
Abstract
Introduction: Despite the widespread use of deprivation indices in public health, they are rarely explicitly or extensively validated, owing to the complex nature of the exercise.
Methods: Based on the proposals of British researchers, we sought to validate Quebec's material and social deprivation index using criteria of validity (content, criterion and construct validity), reliability and responsiveness, as well as other properties relevant to public health (comprehensibility, objectivity and practicality).
Results: We reviewed the international literature on deprivation indices, as well as publications and uses of the Quebec index, to which we added factual data.
Conclusion: Based on the review, it appears that the Quebec index responds favourably to the proposed validation criteria and properties. However, additional validations are required to better identify the contextual factors associated with the index.
Keywords: deprivation, social inequalities in health, index, validity, reliability, Quebec
Introduction
Deprivation and other area-based socioeconomic indices are used extensively in public health in a number of countriesEndnote 1,Endnote 2,Endnote 3,Endnote 4,Endnote 5,Endnote 6,Endnote 7,Endnote 8,Endnote 9,Endnote 10,Endnote 11,Endnote 12,Endnote 13,Endnote 14,Endnote 15,Endnote 16,Endnote 17,Endnote 18 including Canada.Endnote 19,Endnote 20,Endnote 21,Endnote 22,Endnote 23 Despite their widespread use, they have seldom been explicitly validated, except in a few mainly British studies.Endnote 7,Endnote 24,Endnote 25,Endnote 26,Endnote 27 Validating a deprivation index means verifying whether it adequately reflects the reality being measured. Validation is a complex exercise because the index must respond to a number of criteria and have certain properties that are useful in its field of application (in this case, public health).
The purpose of this study is to subject Quebec's material and social deprivation indexEndnote 23 to these validation criteria and properties. The Quebec index was developed at the end of the 1990s and has since been used in Quebec and Canada in various contexts. In this paper, we first describe the index and then present the validation criteria and properties, first with reference to the international literature, then to the Quebec index. Finally, we discuss the nature of the Quebec index and make proposals for additional validations.
Quebec material and social deprivation index
The Quebec deprivation index was designed to illustrate social inequalities in health and in the use of health services. Its objectives are primarily exploratory and descriptive in nature. It applies to the entire Quebec population, by place of residence.
The design and creation of the index is based on Peter Townsend's ideas on deprivation and the international literature on social determinants of health. The index has two dimensions, material deprivation and social deprivation. The index is also geographical: it is based on the smallest standardized Canadian census unit, composed of one or more blocks of neighbouring houses with a population of 400 to 700 persons. This unit is the enumeration area (EA) for the 1991 and 1996 censuses and the dissemination area (DA) for the 2001 and 2006 censuses.Endnote 28
The Quebec deprivation index is made up of six socioeconomic indicators by EA or DA: the proportion of people 15 years and older with no high school diploma or certificate; the employment:population ratio of people aged 15 years and older; the average income of people aged 15 years and older; the proportion of people aged 15 years and older living alone; the proportion of people aged 15 years and older who are either separated, divorced or widowed; and the proportion of single-parent families. All but the last are adjusted according to the age and sex of the Quebec population.
We extracted two components from these indicators using principal component analysis (PCA): the material component, which is associated with employment, education and income, and the social component, which is associated with marital status, living alone and single-parent families. For each component, the PCA produces a factor score by EA or DA, indicating its relative level of deprivation. Depending on this score, Quebec EAs or DAs are grouped into quintiles (population groups of 20%) from the most privileged (quintile 1, Q1) to the least (quintile 5, Q5). Thus, it is possible to follow variations in deprivation for each dimension separately (Q1 to Q5) and for both dimensions simultaneously (Q1Q1 to Q5Q5).
The validation of deprivation indices
Validation of deprivation indices, including the Quebec material and social deprivation index, is based on proposals in the literatureEndnote 7,Endnote 24,Endnote 25,Endnote 26,Endnote 27 and, more specifically, on work focused on the surveillance and measurement of deprivation and social inequalities in health.Endnote 24 After reviewing the deprivation indices used in the UnitedEndnote 24 Kingdom, Carr-Hill and Chalmers-Dixon suggested using three criteria to evaluate this type of index (validity, reliability and responsiveness) and also suggested considering other properties useful for health policies. While recognizing that the scientific community identify other criteria and properties,Endnote 29 we used the definition proposed by Carr-Hill and Chalmers-Dixon.Endnote 24
We used three approaches to measure the validity of the deprivation indices. These three approaches are usually referred to as content validity, criterion validity and construct validity.
Content validity
Content validity refers to the agreement between the general concept of deprivation, its main dimensions and the indicators selected to illustrate them:Endnote 24 Are the dimensions and indicators appropriate? Do they represent all the facets of deprivation that the index is attempting to reflect?
The conceptual foundations of the Quebec material and social deprivation index are mainly based on the proposals set forth by Peter Townsend,Endnote 30 for whom deprivation is a ''state of observable and demonstrable disadvantage, relative to the local community or the wider society or nation to which an individual, family or group belongs.'' The author distinguished between two forms of deprivation: material and social. The first, material deprivation, refers to the lack of the normal goods and amenities of modern living in various areas, such as food, housing, the environment and work. The second, social deprivation, which according to Townsend, is more difficult to define, refers to the fragility of social ties. This fragility may occur within the family unit or it may extend to close relationships, friends, confidants, neighbours and others who provide emotional and material support (social support). It can also reflect the difficulties associated with integration and participation in social relationships and other common activities within the local community, such as recreational or educational activities.
This brief definition of deprivation forms the basis for a number of deprivation indices.Endnote 7,Endnote 9,Endnote 20,Endnote 25,Endnote 26,Endnote 31,Endnote 32,Endnote 33 The authors of these indices highlighted the relative character of deprivation, its subjective and objective aspects, and its material and social dimensions. The analysis of deprivation can, however, involve more than two dimensions or different fieldsEndnote 13 and overlap with other concepts, such as poverty, disadvantage, socio-economic status or position,Endnote 1,Endnote 6,Endnote 10,Endnote 15,Endnote 16,Endnote 26 marginalization,Endnote 22 or social isolation or fragmentation.Endnote 34,Endnote 35 In all cases, the concepts beneath these area-based deprivation indices and other socio-economic indicators remain underdeveloped.Endnote 25,Endnote 26,Endnote 27
The area-based scale is, however, a fundamental element of deprivation indicators that distinguishes them from indicators related to individuals, even though they often serve as a substitute or proxy for each other and are sometimes compared.Endnote 1,Endnote 5,Endnote 11,Endnote 16,Endnote 26,Endnote 27 An area-based indicator reflects a specific realityEndnote 6,Endnote 13,Endnote 36 that varies according to the scale considered.Endnote 36,Endnote 37
Criterion validity
Criterion validity is used to verify whether the variations in a deprivation index correlate highly with those of an external measurement of deprivation.Endnote 24 Criterion validity is not used extensively because it is commonly accepted that there is no gold or reference standard for deprivation. Nevertheless, certain practices are similar. For example, some authors have compared the area-based variations of different deprivation indices with one anotherEndnote 25,Endnote 27,Endnote 37 or with those of measurements involving individuals, even though they are different realities.Endnote 1,Endnote 16,Endnote 26 Moreover, certain authors have compared the area-based variations of a new index to indices already in use, such as Townsend's.Endnote 6,Endnote 7,Endnote 15,Endnote 16
Because there is no standard or reference measure for deprivation, we preferred to discuss the Quebec index in terms of convergence validity, as will be discussed later.
Construct validity
Construct validity of a deprivation index in the health sector can take on a number of forms.Endnote 24,Endnote 29 Above all, it aims to determine whether the construction is consistent with the concept of deprivation. Construct validity is also expressed through consistent relationships between the index and otherof deprivation,measurementson relatedthe oneto thehand,conceptand various health measures and the use of health services, on the other. These forms of validity will be more specifically addressed through convergence validity and predictive validity, respectively.
To operationalize his vision of deprivation, Townsend reviewed various indicators used in Great Britain, some from administrative bases and others from health surveys,Endnote 30 and proposed a material deprivation index combining four indicators.Endnote 24 Other authors added a social dimension by creating a separate social deprivation index,Endnote 26 or social isolation index,Endnote 34 combining a number of indicators, all from censuses.
To construct the Quebec index, we took into consideration these indicators and also conducted a literature review on the social environment and social inequalities in health.Endnote 34,Endnote 38,Endnote 39,Endnote 40,Endnote 41 We then selected our indicators on the basis of theoretical and practical criteria: affinity with one of the two forms of deprivation, known link with health, availability at a fine geographical scale in the censusEndnote 28 and a limited number of indicators in the composition of the index (parsimony) to simplify comprehension. We selected six indicators through this process.
The integration of these indicators in the form of an index was not the subject of any explicit hypothesis. The intention was to let the ''natural'' area-based variations of the indicators express themselves without a priori grouping. For this, we used principal component analysis (PCA), an exploratory synthesis method widely used in the creation of geographically based indices,Endnote 3,Endnote 6,Endnote 7,Endnote 13,Endnote 16,Endnote 18,Endnote 20,Endnote 22,Endnote 32,Endnote 33 while recognizing the relevance of using groups of expertsEndnote 8,Endnote 19 or equally weighted sumsEndnote 5,Endnote 25,Endnote 27 for the integration of indicators related to certain indices.
The PCA revealed the presence of two components. In the 2006 census, the first component reflected the variations in education, employment and personal incomeEndnote 42 (see Table 1). The second component reflected the variations in the proportion of individuals who were living alone, separated, divorced, widowed or living in single-parent families. These results are similar to Townsend's proposals concerning the two dimensions (material and social) of deprivation. However, they differ in terms of education, which according to Townsend, is associated with social deprivation. Moreover, these two components do not appear to be very explicit with respect to the forms of deprivation.
TABLE 1
Indicators and components of the index of material and social deprivation, Quebec, 2006
Indicator |
Component |
Material |
Social |
|
No high school diploma or certificateTable 1 - Footnote a |
-0.85 |
+0.04 |
Employment:population ratioTable 1 - Footnote a |
+0.75 |
-0.18 |
Average personal incomeTable 1 - Footnote a |
+0.83 |
-0.28 |
Living aloneTable 1 - Footnote a |
-0.12 |
+0.82 |
Separated, divorced or widowedTable 1 - Footnote a |
-0.12 |
+0.85 |
Single-parent families |
-0.21 |
+0.68 |
Explained variance, % |
34 |
33 |
Cumulated variance, % |
34 |
67 |
Work connecting the two dimensions of the Quebec index with other indicators from censuses by EA or DA makes it possible to clarify these dimensions.Endnote 43,Endnote 44 For example, social deprivation is closely associated with residential mobility (frequent moves) and the proportion of renters, two indicators used in the construction of social fragmentation and isolation indices.Endnote 34,Endnote 35 The fact remains that the census is a limited source of data for reporting on the fragility of social networks.
Convergence validity
It is therefore necessary to compare the index to external measures (not from censuses) that reflect deprivation and its various dimensions. We conducted three exercises of this kind.
We first compared the spatial variations in the deprivation index to those in the proportion of children living with families receiving last-resort financial assistance from the Government of Quebec (see Table 2). Such assistance is given to families whose liquid assets (cash, etc.) are less than a particular amount that corresponds to the size and needs of the family. It is the only source of income the family has to meet its basic needs (e.g. housing and food). Two-thirds of the families receiving this assistance are single-parent families.Endnote 45 Therefore, we expected material and social deprivation to increase with the proportion of children living with families receiving this assistance, which is the case according to the statistics provided by Quebec's Department of Employment and Social Solidarity.Endnote 45
TABLE 2
Percentage of children living in families receiving last-resort financial assistance, by quintileTable 2 - Footnote a of material and social deprivation, Quebec, 2001
|
|
Social deprivation |
Q1 |
Q2 |
Q3 |
Q4 |
Q5 |
Total material deprivation |
Material deprivation |
Q1 |
0.6 |
1.1 |
2.1 |
3.9 |
8.2 |
2.7 |
Q2 |
1.6 |
2.9 |
4.2 |
7.6 |
13.5 |
5.2 |
Q3 |
2.7 |
4.0 |
6.4 |
10.7 |
20.0 |
7.7 |
Q4 |
4.3 |
5.6 |
9.2 |
15.5 |
26.0 |
11.3 |
Q5 |
8.4 |
11.0 |
16.6 |
23.3 |
38.1 |
18.8 |
Total social deprivation |
3.6 |
4.9 |
7.2 |
12.3 |
22.7 |
9.2 |
The other two exercises made it possible to better define the social dimension of the deprivation index.
One linked the variations in the Quebec index with those observed in an in-depth study of three areas in the Quebec City region.Endnote 46,Endnote 47,Endnote 48 Two of the areas had different health reports. The material deprivation index was similar in these areas, whereas the social deprivation index differed significantly. A telephone survey of 600 respondents in each area collected data on health and perceptions of the local environment. The use of a social cohesion index,Endnote 49 addressing the appeal of the local environment and sense of neighbourhood and community, produced coherent results with those obtained from the social deprivation indices. Where social deprivation was high, social cohesion was low, and vice versa. Qualitative interviews with residents revealed that being born in the area and having family members in the area were cohesive factors.
The last exercise was based on an analysis of a number of cycles of the Canadian Community Health SurveyEndnote 50 and explored the links between certain social support measures at the individual levelEndnote 51 and the social deprivation index in urban Quebec.Endnote 52 The exercise revealed that an increase in social deprivation went hand in hand with a decrease in three social support measures, that is, affection, positive social interactions, and emotional or informational support. These associations are independent from the age, gender, lifestyle, education and household income of the survey respondents.
In summary, not only do the indicators used in the construction of the social dimension of the index reflect family structure and marital status, the dimension also captures a broader reality. At the individual level, this reflects the fragility of social support for single-parent families and those who are living alone or who are separated, widowed or divorced. At the local scale, it reflects residential instability (very frequent movesEndnote 34,Endnote 35), which does not foster the establishment of roots, neighbourhood ties, or the development or knowledge of and access to local resources and assistance networks, which some associate with social cohesion and social capital.Endnote 53
Predictive validity
As we have seen, the primary objective of a deprivation index is to identify social inequalities in health and, therefore, the associations between deprivation and health.Endnote 24 These associations must be plausible, corroborate observations made in the literature, or be supported by credible explanations or hypotheses.
Predictive validity is by far the most widely used approach to demonstrate the quality of a deprivation index.Endnote 24 It is seen as ''proof'' of its performance. For example, links have been made with overall mortality,Endnote 10,Endnote 12,Endnote 14,Endnote 27 premature mortality (0–64 years),Endnote 4,Endnote 18 cause of death,Endnote 3,Endnote 18 the incidence of cancerEndnote 10 (including lung cancerEndnote 14), long-term disability,Endnote 25,Endnote 26,Endnote 27 perceived health,Endnote 1,Endnote 37 smoking and nutrition,Endnote 5 low birth-weight, immunization status and lead poisoning among children,Endnote 11,Endnote 14 sexually transmitted infections, tuberculosis and violence,Endnote 54 myocardial infarction,Endnote 7 hospitalization,Endnote 14,Endnote 27 and use of medicalEndnote 8 and psychiatric services.Endnote 16 Moreover, the strength of the relationship between deprivation and health varies according to the size of the basic spatial unit of the index. The smaller the spatial unit, the stronger the relationship.Endnote 1,Endnote 10,Endnote 11,Endnote 26,Endnote 54
The Quebec deprivation index accounts for various health and social situations. It is linked to global health indicators, namely, life expectancy and health expectancy at birth and different agesEndnote 23,Endnote 44,Endnote 55,Endnote 56 and mortality, including overall mortality, mortality by medical cause (e.g. cancer, circulatory disease, trauma and stroke), mortality related to lifestyle (e.g. smoking), premature death (less than 75 years), death among young people (18 years or less) and survival.Endnote 23,Endnote 55,Endnote 56,Endnote 57,Endnote 58,Endnote 59,Endnote 60,Endnote 61,Endnote 62,Endnote 63,Endnote 64,Endnote 65,Endnote 66,Endnote 67,Endnote 68,Endnote 69 For example, an increase in the rate of premature deaths was observed both in the early 1990s and the mid-2000s as a function of material and social deprivation (Figure 1). The same is true for other indicators, such as disability,Endnote 56,Endnote 64,Endnote 70,Endnote 71,Endnote 72 the incidence or prevalence of diabetes and high blood pressure,Endnote 72,Endnote 73,Endnote 74 self-reported health,Endnote 70 and protective and risk factors for health: flu vaccination, premature birth or low birth weight, smoking and exposure to secondhand smoke, obesity, food insecurity and physical inactivity.Endnote 23,Endnote 61,Endnote 70,Endnote 75,Endnote 76,Endnote 77,Endnote 78 Social issues, such as teenage pregnancy and cases of abuse, neglect and behavioural problems among young people, are also associated with deprivation.Endnote 23,Endnote 44,Endnote 61
FIGURE 1
Premature mortality rate by quintileEndnote a of material and social deprivation, Quebec, 1989–1993 and 2004–2008
[Click to enlarge]
[FIGURE 1, Text Equivalent]
Chronic Diseases and Injuries in Canada - Volume 34, no. 1, December 2013
FIGURE 1
Premature mortality rate by quintile of material and social deprivation, Quebec, 1989–1993 and 2004–2008
An increase in the rate of premature deaths was observed both in the early 1990s and the mid-2000s as a function of material and social deprivation. Moreover, the premature mortality ratio between groups at the extreme ends of deprivation increased from 1.8 in 1989–1993 to 2.4 in 2004–2008.
Source: 1991 and 2006 censuses; Quebec death records, 1989–1993 and 2004–2008.
Note: Death rates are adjusted by age, gender, geographical area and other form of deprivation.
Endnote a From Q1, the most privileged quintile, to Q5, the least privileged quintile.
Such relationships were also observed in use of health services. An increase in visits to general practitioners was noted with increased deprivation, but an opposing trend was sometimes found for certain medical specialties.Endnote 44,Endnote 61 This opposing trend was also true for certain free services available for young people aged under 18 years (eye exams) and under 10 years (dental appointments) (Figure 2). However, the use of local community service centres (CLSCs), as well as hospitalization, day surgery and stays in long-term care facilities increased with material and social deprivation.Endnote 44,Endnote 61,Endnote 70,Endnote 79 A recent example is the rate of hospitalization following influenza A(H1N1) infection (Figure 3).
FIGURE 2
Percentage of young people aged less than 10 years who have visited a dentist and of young people aged less than 18 years who have had an eye exam, by quintileEndnote a of material and social deprivation, Quebec, 2000–2002
[Click to enlarge]
[FIGURE 2, Text Equivalent]
Chronic Diseases and Injuries in Canada - Volume 34, no. 1, December 2013
FIGURE 2
Percentage of young people aged less than 10 years who have visited a dentist and of young people aged less than 18 years who have had an eye exam, by quintile of material and social deprivation, Quebec, 2000–2002
An increase in visits to general practitioners was noted with increased deprivation, but an opposing trend was sometimes found for certain medical specialties. This opposing trend was also true for certain free services available for young people aged under 18 years (eye exams) and under 10 years (dental appointments).
Source: Calculations by the Institut national de santé publique du Québec based on data provided by the Régie de l'assurance maladie du Québec.
Endnote a From Q1, the most privileged quintile, to Q5, the least privileged quintile.
FIGURE 3
Relative risk of hospitalization following an A(H1N1) infection by quintileEndnote a of material and social deprivation, Quebec, April–December 2009
[Click to enlarge]
[FIGURE 3, Text Equivalent]
Chronic Diseases and Injuries in Canada - Volume 34, no. 1, December 2013
FIGURE 3
Relative risk of hospitalization following an A(H1N1) infection by quintile of material and social deprivation, Quebec, April–December 2009
The use of local community service centres (CLSCs), as well as hospitalization, day surgery and stays in long term care facilities increased with material and social deprivation. A recent example is the rate of hospitalization following influenza A(H1N1) infection.
Source: A(H1N1) surveillance record, MED-ÉCHO hospitalization records, Ministère de la santé et des services sociaux du Québec.
Note: The relative risk is adjusted by age, gender, geographical area and other form of deprivation.
Endnote a From Q1, the most privileged quintile, to Q5, the least privileged quintile.
In summary, the Quebec deprivation index accounts for significant inequalities in health, even though their magnitude may vary depending on the theme under consideration. The two forms of deprivation (material and social) usually act independently.Endnote 23,Endnote 44,Endnote 56,Endnote 57,Endnote 58,Endnote 59,Endnote 60,Endnote 61,Endnote 63,Endnote 64,Endnote 65,Endnote 66,Endnote 67,Endnote 68,Endnote 69,Endnote 71,Endnote 72,Endnote 73,Endnote 74,Endnote 75,Endnote 76,Endnote 78,Endnote 79
Reliability
The reliability of a measurement tool is defined as its ability to produce the same result under the same circumstances.Endnote 24 For deprivation indices, this ability can be expressed through strong correlations between the indicators that form the index. These correlations are often tested using Cronbach's alpha. Some authors refer to an index's internal consistency.Endnote 6,Endnote 7,Endnote 26 This internal consistency, however, is not relevant when the index has more than one dimension.Endnote 24 The reliability of a deprivation index can also be expressed through correlation structure stability in time and space. The goal is to verify whether the correlation structure remains, regardless of the period and environment being considered.
The reliability of the Quebec deprivation index can be seen from the perspective of internal coherence for each dimension of deprivation. As seen in Table 1, close correlations exist between the indicators that make up each of the two dimensions (material and social) of the index. This fundamental structure of the index can be seen throughout Quebec and CanadaEndnote 42,Endnote 68 at various levels: regional, census metropolitan areas, cities of varying sizes and rural environments. It is also present for each census year between 1991 and 2006. Although the correlations between the indicators may vary slightly according to the location and period considered, the two-dimensional structure of the Quebec index is maintained.Endnote 42 This fundamental structure seems to be permanent, an essential quality for monitoring the social inequalities in health in time and space.
Responsiveness
Responsiveness reflects the ability of a measurement tool to detect differences or changes according to the location, time and individual characteristics.Endnote 24 Variations in the deprivation index are observable at the national, regional and local levels, through the use of maps, for example.Endnote 2,Endnote 7,Endnote 8,Endnote 26,Endnote 37 They are also observable in relation to various health characteristics. The relationships vary according to the age and gender of the population,Endnote 3,Endnote 4,Endnote 18,Endnote 27 with adults (aged 25–64 years) usually showing the highest inequalities in health. The inequalities change over the years (reducing or increasing) or with the areaEndnote 3,Endnote 4,Endnote 11,Endnote 16 and fluctuate according to the health issue under study (e.g. cause of death).Endnote 10,Endnote 16,Endnote 27
The Quebec deprivation index was used to create an interactive atlasEndnote 44,Endnote 80 that shows wide variations in deprivation at the provincial level and at a smaller level, in both urban and rural environments. These variations in the Quebec index are also associated with inequalities in health that relate to gender and age, with adults having the highest mortality ratios between groups at the extreme ends of material and social deprivation (Figure 4). Moreover, as is the case elsewhere,Endnote 18,Endnote 81,Endnote 82,Endnote 83,Endnote 84 the Quebec index has identified an increase in relative health differences in Quebec. According to the data presented (Figure 1), the premature mortality ratio between groups at the extreme ends of deprivation increased from 1.8 in 1989–1993 to 2.4 in 2004–2008. The Quebec index identified health inequalities of varying magnitude according to geographical area and fluctuating over time.Endnote 62,Endnote 64,Endnote 66 Thus, inequalities are growing throughout Quebec, except in the Montreal area, where they are actually bigger than in the rest of the province. Such health differences have also been demonstrated elsewhere in Canada.Endnote 63,Endnote 67,Endnote 68
FIGURE 4
Ratio of death rates between extreme quintiles of material and social deprivation (Q5Q5/Q1Q1) by age group, Quebec, 2000–2004
[Click to enlarge]
[FIGURE 4, Text Equivalent]
Chronic Diseases and Injuries in Canada - Volume 34, no. 1, December 2013
FIGURE 4
Ratio of death rates between extreme quintiles of material and social deprivation (Q5Q5/Q1Q1) by age group, Quebec, 2000–2004
Variations in the Quebec index are also associated with inequalities in health that relate to gender and age, with adults having the highest mortality ratios between groups at the extreme ends of material and social deprivation.
Source: Institut national de santé publique du Québec, 2008; www.inspq.qc.ca/Santescope/element.asp?NoEle=740
Other properties
In the context of the development of public health policies or programs, deprivation indices must respond to requirements beyond those that are purely technical or statistical.Endnote 24 This is the case for the comprehensibility of the index for an audience made up of decision makers and stakeholders in the field. The index must be easy to understand, appeal to common sense and be conducive to reasonable, unambiguous explanations. Thus, the contribution of the indicators to the index must be precise, clear and, if possible, quantified. The index must also be objective (cannot be manipulated) and be applicable to every part of the area being considered, at the national, regional and local levels. Finally, the index must respond to practical requirements. It must be possible to update it regularly, using the same method, and be manageable in terms of time and cost; it should also be possible to introduce it into health databases.
As we have seen, the Quebec deprivation index remains a simple measure, made up of two components and six indicators that are well known as being connected to health. Its structure is clear, and the weighting of the indicators in the index reflects their correlation with the components (Table 1). Its use demonstrates its comprehensibility for an audience made up of stakeholders and decision makers in the health and social service sectors in Quebec. Local variations in the index corroborated the perception of CLSC stakeholders,Endnote 79,Endnote 85 and, at a provincial level, these variations were used to develop departmental policiesEndnote 61 and to allocate health resources among regions.Endnote 86 A recent compilation indicates that most of Quebec's regional health and social services agencies use the deprivation index to identify variations in their areas and the connections with various health and social issues.Endnote 87
Although groups of experts were not involved in the design or initial construction of the deprivation index, many health experts (stakeholders and managers) at all geographical levels have since commented on, used and adapted the index to their needs and work contexts, contributing to its validation and evolution. For example, a local version of the index and an interpretation grid of the inequalities in the use of services were developed jointly with local CLSC stakeholders.Endnote 79,Endnote 85 The grid compares the variations in the index and the knowledge of stakeholders regarding their organization directions and practices (e.g. target clientele, service access criteria), resources available locally (e.g. medical clinics, self-help groups and associations) and hard-to-reach populations (e.g. the homeless or individuals with mental health issues).
Finally, the relevance of the Quebec index depends on its availability over time and space. We have seen that the index exists for 1991, 1996, 2001 and 2006, and that it covers all of Quebec (and Canada) in different versions: national, regional and local. There are supporting products (e.g. interactive maps, population tables, index assignment programs), which are all free and available online.Endnote 80,Endnote 88 Tables and figures illustrating the health inequalities in Quebec using the deprivation index are regularly produced and posted online.Endnote 89
Conclusion
Despite the widespread use of deprivation indices, there have been few formal validation exercises. On the basis of the validation criteria proposed by Carr-Hill and Chalmers-Dixon,Endnote 24 it can be concluded that the Quebec material and social deprivation index responds favourably to various requirements for validity, reliability, responsiveness and use in public health.
However, there are limitations related to the geographical nature of the index. The index characterizes the socio-economic attributes of all residents of small areas. Although it is often used as a substitute for measurements related to individuals, the index is a measurement linked to an area. Studies, some of which are from Quebec and Canada,Endnote 56,Endnote 64,Endnote 67,Endnote 90 show that the magnitude of health inequalities is underestimated through geographical measurement, especially in small cities and rural environments. They also reveal that health inequalities are associated with both types of measurements (those related to area and those related to individuals), independently, which signifies that they result from both geographical and individual realities.Endnote 56,Endnote 64,Endnote 67,Endnote 91,Endnote 92,Endnote 93,Endnote 94,Endnote 95,Endnote 96,Endnote 97
A better understanding of these geographical realities is therefore necessary to identify all the content and construct elements associated with a deprivation index. To achieve this, a research strategy at the local level combining theories, concepts, methods and indicators is necessary.Endnote 98,Endnote 99,Endnote 100,Endnote 101 Reference frameworks on ''contextual'' factors associated with health must be used.Endnote 53,Endnote 98,Endnote 102,Endnote 103 The social dimension of the index would particularly benefit from being associated with concepts and measurements of social cohesion and capital as well as their components (e.g. values, social support, informal social control and community participation). The material dimension would benefit from being associated with various fields, such as the physical environment (e.g. water and air), the built environment (e.g. housing and access to services), and public (e.g. schools, green space and public transportation) and private (e.g. food stores) infrastructure. This roadmap should be followed for future validation exercises of the Quebec index.
Finally, it should be noted that this index was designed to illustrate the existence of social health inequalities and that its purposes are exploratory and descriptive. The index is not an explanatory framework for these inequalities. For example, it does not consider dimensions related to health, such as immigration or Aboriginal status, even though these dimensions can be accounted for.Endnote 63,Endnote 66 Rather, the Quebec index constitutes more of a marker of social and health inequalities and, as a result, is a relevant starting point toward more in-depth studies and increased understanding of these inequalities.
References