Validation and psychometric properties of the community assessment inventory in Iranian persons who use drug

Abstract

Objective

Social support is a key factor in the treatment and rehabilitation process of persons who use drug (PWUD). This highlights the need for a valid and reliable tool for assessing social support. The cultural and psychometric properties of community assessment inventory (CAI) in PWUDs under methadone therapy were examined in Iran in 2019.

Methods

The study was carried out as a validation and methodological study. At first, the original tool was translated into Farsi using forward-backward method. After ensuring face validity and content validity, construct reliability of the tool was supported using explorative and confirmatory factor analysis (EFA & CFA) using a sample group of 392 participants. The participants were selected through convenient-quota sampling from 24 drug clinics. Reliability of the questionnaire was supported using Pearson correlation coefficient and internal consistency based on Cronbach’s alpha.

Results

To determine content validity of the tool, CVI and CVR of it were obtained, which were on average equal to 0.79 and 0.59 respectively. The EFA supported correlation of the 37itmes of the tool (KMO = 0.975, Chi-square = 15,051.6, P_value=0.0001). The main indices of the model, based on CFA were higher than 0.9, which support goodness of fit of the model (χ2/DF = 2.98, CFI = 0.91, NFI, TLI = 0.905 GF = 0.92, REMSEA = 0.07, R2 = 0.99). Reliability of the tool based on internal consistency (Cronbach’s alpha) for the subscales were in 0.8–0.95 interval and equal to 0.85 for the whole tool.

Conclusion

As the results showed, CAI had acceptable indices for Iranian PWUDs under methadone therapy. The tool can be used for assessing social support level in the study population. It is a reliable and valid tool for studies in pertinent fields.

Introduction

Drug use disorders is a chronic, continues, and frequent behavior that creates physical and mental dependence in the individual [1]. In general, according to available statistics, 0.9% of the world’s population suffers from drug use disorders. Drug use disorders, that do not include alcohol, have troubled between 0.4 and 3.5% of the world population and 2% of Iranian population [2].

A persons who use drug (PWUD) tends to have major psychosocial needs that require a comprehensive and organized care to ensure treatment and prevent relapse [3]. Family and social supports in every aspect throughout the treatment and rehabilitation process can be a key factor to prevent relapse [4]. Researches have shown that challenges like undesirable social-economic condition [3, 5], poor family support [6], inadequate perceived social support [4], inter-personal conflicts, stigmatization and discrimination are normally experienced by PWUD care-seekers under treatment [4, 7].

Social support is a situation in which a person considers themself a member of a group or community that is well understood by individuals and supported from various physical, psychological, emotional, social and financial aspects [4]. Social supports attenuate stress, improve self-efficacy [8] and self-esteem, improve social, mental, and physical condition of the individual, and improve performance [9]. Perceived social support can create positive changes in the life of care-seekers and improve their social interactions [8, 9]. Such interactions boost one’s self-esteem and self-efficacy and make them more persistent to continue the rehabilitation process [10]. Social support can be an important factor in continuing treatment as well as preventing relapse in PWUD_s [7]. Social support can help them in the difficult process of rehabilitation by creating a sense of empathy and acceptance [11].

There are general tools to measure social support, which are used for PWUD_s as well [4, 7, 12]. The Community Assessment Inventory (CAI) is a social support assessment tool designed by Brown et al. (2004) for PWUDs. The tool is specifically used to measure social support in these care-seekers. It contains 37 statements and four subscales namely household, family, friends, and community [13]. Given the statements used in the tool and the fact that it is specifically designed for PWUD, CAI can be a good tool for PWUDs in Iran.

Taking into account the importance of assessing social support in PWUDs and absence of a specially designed, reliable, and normalized tool for this population, the present study is an attempt to examine validity and psychometric characteristics of the tool for Iranian PWUDs under methadone therapy.

Methods

Setting

The study was carried out as a validation and methodological study [14]. Cultural and psychometric characteristics of CAI in Iranian PWUDs under methadone therapy were examined. The study was conducted between September 2018 and July 2019 in Kermanshah – west of Iran.

Participants

To determine face validity of the tool, it was provided to 20 PWUD_s in Kermanshah-based drug clinics. With regard to content validity, the tool was provided to 12 faculty board members and researchers. In addition, for explorative factor analysis (EFA) and confirmatory factor analysis (CFA), the tool was provided to 400 PWUDs under methadone therapy [13] from 24 Kermanshah-based drug clinics. The participants were selected through convenient-quota sampling. The demographics of participants are listed in Table 1 (seven questionnaires were omitted for being not completely filled out).

Table 1 Demographic characteristics of the study participants

Inclusion criteria were drug use disorder for at least one year, under methadone therapy for at least six months, desire to participate, not using synthetic drugs, and no physical and mental disease (medical file). Questionnaires that were not fully completed (less than 80% answered) were omitted.

Community assessment inventory (CAI)

The CAI was designed in 2004 by Brown et al. and developed for PWUD_s. The questionnaire measures support in four fields of household (six items), family (10 items), friends (eight items), and community (13 items). The questionnaire contains 37 items designed based on Likert’s four-point scale (1 = completely disagree, 2 = disagree, 3 = agree, 4 = completely agree). The higher the score, the higher the performance in any of the sub-scales [10].

Cultural validation

After securing required permission for the designer of the tool, it was translated based on Wild et al.’s [15] ten steps following the translation and cultural comparability guideline. The ten steps are as follows:

• Communicating with the designer and securing the required permissions.

• Forward translation; two independent competent translators translated the tool from English into Farsi at the same time.

• The two translations were examined and compared and one version was extracted.

• Backward translation; the Farsi version was translated into English by two other independent and competent translators. They were asked to translate the meaning rather than word-by-work translation while remaining loyal to the origin.

• The researchers and experts examined the two translations and one version was extracted.

• The English translation was sent to the designer for feedbacks. Based on the feedbacks and considering the designer’s opinion, the original version of the tool was translated into Farsi.

• To ensure qualitative face validity, the tool was provided to 20 drug users under methadone therapy with minimum education level of high school. As to qualitative content validity, the tool was provided to 20 researcher and experts for their opinions (12 returned).

• The opinions were examined and implemented. None of the statements were removed at this stage.

• The tool was revised in terms of Farsi grammar and writing style by the research team.

• The final Farsi version was obtained.

After ensuring content validity through qualitative method, content validity through quantitative method was conducted as a supplementary method. To this end, CVR and CVI were computed (Table 2).

Table 2 The ratio and index of content validity and T-value of the tool items

Construct validity was determined using EFA in SPSS (v. 25) and CFA was obtained in Lisrel (v. 8). Reliability of the scale was obtained through internal consistency method. Twenty PWUDs under methadone therapy filled the tool twice with two weeks internal. Afterwards, the obtained scores were compared using intra-class correlation. Cronbach’s alpha was used to determine internal consistency of the tool based on the subscales.

Results

Before performing EFA, adequacy of sampling test was conducted to ensure that the sample size is large enough. The KMO test was obtained equal to 0.97 and confirmed the adequacy of the sample size for EFA. The Bartlett’s test of sphericity was equal to 15.51.6, which confirmed the adequacy of correlation between the scale items for factor analysis (p-value < 0.001). Given that H0 is not supported, a significant relationship between the variables is supported. Therefore, the presumptions of CFA were met and it was conducted on the answers by the subjects to the 37 statements of the scale. Varimax perpendicular rotation and principle component (PC) analysis were used. None of the statements were removed (Fig. 1).

Fig. 1

Scree plot of the extracted elements of the questionnaire

Construct validity – Confirmatory Factor Analysis

The mean score of statements ranged from 2.8 to five and the t-value ranged from 1.01–5.01. Skewness and Kurtosis were also at (− 2, 2) range. Therefore, normal distribution of the data is supported. In addition, the statements were at a desirable range given the factor load of each statement (p < 0.001), mean score, and t-value of the statements (Table 2).

Figure 2 illustrates CFA model of the variable under study in standard mode and without coefficients. Since t-values in all cases are higher than |1.96| and the factor load is higher than 0.3 (Table 2), none of the statements were omitted. Based on the goodness of fit indices in CFA model, the goodness of fit of model with the collected data was supported (Table 3) (Fig. 2).

Fig. 2

Four factor model of CVI in Iranian PWUDs

Table 3 Fit Indicators Confirmatory Factor Analysis Persian Version of CAI

With R2 = 0.99, 99% of variation of the dependent variable (total score of CAI) can be attributed to the independent variable (37 statements). In other words, 99% of changes in depended variable is caused by the independent variable.

With the support of normality of data in CAI items for PWUDs under methadone therapy, Pearson’s correlation test showed a direct and significant correlation at 99% confidence level (Table 4). In addition, there was is a direct and significant relationship between CAI subscales and total score of the tool (Table 5).

Table 4 Pearson correlation of items of CVI in Iranian PWUD

Table 5 The internal reliability of CVI and dimensions among the subjects

To examine internal reliability of CAI, Cronbach’s alpha was computed for the whole tool equal to 0.85. Based on the results, the Farsi version of CAI had an acceptable internal consistency and the coefficient for the subscales of CAI ranged from 0.80 to 0.95 (Table 6).

Table 6 The correlation coefficient of CVI and dimensions with others in Iranian PWUD

Discussion

The CAI was translated and validated for PWUDs under methadone therapy in Iran. One feature of the study is that along with using the care-seekers’ opinions about face validity, the experts were also consulted about content validity. Through this, clarity and understandability of the statements were determined. Brown et al. (2004) examined face and content validity using the same method [13].

Construct validity of CAI in the subjects was measured using EFA and CFA. Halamova et al. (2018) followed the same approach [16] and Canty-Mitchel et al. (2000) used CFA to measure construct validity [17]. Clearly, factor analysis methods are commonly used for this purpose.

Factor analysis results supported all the 37 items and goodness of fit indices all were higher than 0.9, which supported goodness of fit of the tool (χ2/DF = 2.98, CFI = 0.91, NFI, TLI = 0.905 GF = 0.92, REMSEA = 0.07, R2 = 0.99). Halamova et al.(2018) also reported that goodness fit indices were above 0.9 (CFI = 0.98, NFI, TLI = 0.984 REMSEA = 0.045) and supported goodness of fit of the tool [16].

Pearson correlation coefficient also supported a significant and direct correlation of CAI subscales with each other and the total score of the tool. Brown et al. (2004) reported a direct and significant correlation between the subscales and the total score of the tool [13]. Canty-Mitchel et al. also reported similar results [17]. To elaborate on the findings, along with validating psychometric characteristics of the tool, consistent with other studies, our results also supported internal consistency of the scale.

As the results showed, the Farsi version of CAI has an acceptable internal consistency for PWUDs in Iran. Reliability of the subscales, based on Cronbach’s alpha was at 0.8–0.95 range. Therefore, the subscales are reliable. Khuong et al.(2018) also reported that Cronbach’s alpha of the tool was less than 0.81 [18]. A similar study by Priede et al. reported Cronbach’s alpha more than 0.7 [19]. Although, the number of subjects in these studies is different, the similar values of Cronbach’s alpha support the findings of the present study.

Data gathering was done using the questionnaire; therefore, it was not possible to examine subjective data. This, however, is a common feature of descriptive and tool validation works. Overcrowded clinics, boredom, muscles and joints pains, and lack of enough time to answer the items of the tool were some of the limitations of the study. These limitations prevented giving accurate answers to the questions in some of the subjects. To solve this problem, the author tried to explain the study design and its necessity and remove ambiguities if any.

Conclusion

As the results showed, CAI had acceptable indices for Iranian PWUDs under methadone therapy. The tool can be used for assessing social support level in the study population. It is a reliable and valid tool for studies in pertinent fields. In general, CAI was a standard and acceptable tool for PWUD_s (Natural and industrial drugs) in Iran and future studies can use the tool.