Medical Express

ISSN (print): 2318-8111

ISSN (online): 2358-0429

Issue: 6.0 - 8 Articles

Back to summary

x

How to cite


 

King1 ALS, Pádua MK, Guedes E, Gonçalves LL, Guimarães FL, Santos HK, et al. Validation of a Scale to evaluate Pathological Digital Game Dependence. MEDICALEXPRESS 2019;6(0): http://www.dx.doi.org/10.5935/MedicalExpress.2019.mo.005

 

ORIGINAL ARTICLE http://www.dx.doi.org/10.5935/MedicalExpress.2019.mo.005

Validation of a Scale to evaluate Pathological Digital Game Dependence

Anna Lucia Spear King1; Mariana King Pádua1; Eduardo Guedes1; Lucio Lage Gonçalves1; Flávia Leite Guimarães1; Hugo Kegler dos Santos2; Douglas Rodrigues2; Antonio Egidio Nardi1

1. Universidade Federal do Rio de Janeiro (UFRJ), Instituto de Psiquiatria (IPUB), Delete – Conscious Use of Technologies, Rio de Janeiro, RJ, Brasil
2. Universidade Federal Fluminense (UFF), Instituto de Matemática e Estatística Departamento de Estatística, Rio de Janeiro, RJ, Brasil

E-mail: annaluciaking@gmail.com

Received in August 21 2018.
First Review in November 6 2018.
Accepted in February 26 2019.

Abstract

BACKGROUND INFORMATION: Digital game or video game disorders have been recently (June 2018) included in ICD-11 (International Classification of Diseases) by the World Health Organization (WHO). The disorder can occur with or without an internet connection.
OBJECTIVE: Validation of a scale to evaluate the dependence of pathological digital game (PDGD).
METHOD: Validation of the PDGD was performed in 5 phases: (1) initial scale construction with 20 questions, (2) expert assessment, (3) application to 200 volunteers, (4) statistical analysis and production of results using statistical programs, (5) elaboration of the final validated scale.
RESULTS: We used the R statistical program Version 3.4.2 and the “dplyr” package to present the descriptive statistics, the hypotheses tests of differences of means and the factorial analysis. The last step was to calculate Cronbach’s alpha, in order to measure the internal consistency of the questionnaire. The value found was 0.955, which is very good.
CONCLUSIONS: This research allowed us to construct a final version of the PDGD suitable for the clinical contexts and usable in research on the dependence of digital games. This scale may contribute to future studies, conscious use of technologies, reduction of physical and emotional damage and improvement of the quality of life.

Keywords: Digital game; video-game; game disorder, gaming behavior.

 

INTRODUCTION

In June 2018, the World Health Organization (WHO) introduced “disorders for digital games or video games”1 into the International Statistical Classification of Diseases (ICD-11). The disorder refers to the pathological use of digital games or video games, which can occur with or without internet connection.

Pathological Gaming was already part of the previous WHO International Classification (ICD-10)2 in the Personality Disorders and Adult Behavior section, which did not refer to digital games.3 The inclusion of digital games in this recently published ICD-11 creates the immediate need for a scale to meet an already existing and escalating demand. No such scale exists.

This pioneer instrument will be instrumental in providing professional care and guidance to people(mainly young people) who have become pathologically dependent of video games.

We are living a new reality, with young people being excluded, isolated from society, from families and being marginalized for secluding themselves for many hours of exclusive devotion to digital games.3 In this manner people dependent on digital games follow a similar path of stigmatization and social marginalization of other addicts (e.g. drugs and alcohol). This isolation, as well as the usual neglect with physical care (nutrition and hygiene) are some of the issues that become common in these players. In addition, there are additional problems, including difficulties with sleep, obesity, distraction, emotional losses4 (depression, anxiety) and physical damage5 (spinal injuries, arthritis, vision) that may be associated with abusive use of digital games .

The theme has turned into a serious global problem and one which grows continually. Although video games can strengthen some skills such as attention, concentration, and reaction time,6 they do not contribute to learning, maintaining focus, and understanding what one is reading.

We have thus decided to create and validate a scale to evaluate the dependence of pathological digital gaming. To the best of our knowledge this is the first specific instrument in the identification of this type of disorder and in the orientation of its treatment.

 

MATERIALS AND METHODS

To produce and validate any such scale, content must be aligned with the its subject and objectives. Hair et al7 point out that no scale should be administered before being evaluated in terms of accuracy and coherence. Experts in the field must develop a scale to be tested on volunteers and the results must be statistically analyzed for validity. The number of specialists who should participate in scale validation is a debatable point, which is left at the discretion and accessibility of the researcher: more specialists generate more disagreement, whereas a smaller number (e.g., less than 3) comes with a risk of 100% agreement.

The production, validation and testing of PDGD was carried out in 5 phases.

1. Construction of an initial questionnaire; six specialists trained in the area of digital dependence were given the task and produced 20 questions.

2. The questions were evaluated by a second group of six similarly trained specialists, who analyzed the questionnaire, focusing on presentation, clarity, relevance and understanding. Thus, a preliminary validation was provided.

3. Application of the scale to 200 volunteers, divided into two groups: a MAIN Group included 100 participants with apparent abuse of digital games; a CONTROL Group of 100 participants with no apparent abuse use of digital games. For separation into the Main or Control groups, volunteers were previously submitted to the Internet Addiction Test (IAT) scale.8 Volunteers with IAT scores ≥ 50 and admitting to playing digital games for at least 2 hours/day were assigned to the Main group; the Control Group included IAT scores < 50 who denied playing digital games daily or frequently.

4. Statistical analyzes were performed through the R statistical program, version 3.4.2.9 for the orthogonal model. The method used was Principal Components based on Spearman’s correlation matrix. For data analysis we used the “dplyr” ,10 “psy” .11 “paran” 12 packages into R.

5. Preparation of the validated final version.

The 200 volunteers participating in the research were asked to insert values opposite each question, as follows: Never/Rarely (0 points); Often (1 point), Always (2 points). The final sum of the results obtained ranked responders as follows: Up to eight points without disturbances - 9 to 18 points (mild dependence) - 19 to 28 points (moderate dependence) - 29 to 38 points (severe dependence). Orientations referring to each range of points was offered.

Sample. Volunteers included in PDGD were (i) patients seen at our facility with complaints and symptoms of digital game dependence. (ii) accompanying persons (iii) students, employees and any others who agreed to participate, who were randomly recruited through posters at the institution, verbal communication from person to person and on social networks.

Inclusion Criteria. Participants should be aged 17 to 65 years and fulfilling conditions for inclusion in either of the two groups.

Exclusion Criteria. illiterate candidates and persons with some kind of mental impairment that would prevent them from using digital games.

 

RESULTS

Descriptive Statistics. Table 1 shows the results of the descriptive statistics of the sample, divided into Main and Control groups. For each characteristic we present the absolute number and the proportion within its group. Demographic data were collected for statistical purposes and not considered in the expert evaluation

 

 

Scores for the original 20-question scale. The mean ± standard deviation score for the Control group was 2.55 ± 3.92, while the corresponding value for the Main group was 7.05 ± 10.3 The t-test of means between the two groups produced a p-value < 0.001 (t-statistic = 3.940). This indicates a significantly higher level of damage in the Main group vs. the Control group and ratifies, prima facie, the characteristics of the groups, namely dependence in the main group vs. little or no dependence in the control group.

Factor analysis. The first test performed was the Bartlett sphericity test to determine if the variables are correlated with each other. In this test, the null hypothesis is that the correlation matrix, based on Spearman’s correlation matrix is equal to the identity matrix. For the data set, we found a statistic equal to 3046.163 and a p-value <0.001, implying that the covariance matrix is not equal to identity.

The next criterion used to check the adequacy of a factor analysis was the Kaiser-Meyer-Olkin (KMO) criterion. Its value was equal to 0.921; values above 0.8 are considered appropriate.7 Table 2 displays the Measurement of Sampling Adequacy (MSA) indices for each of the variables.

 

 

Both the Bartlett test and the KMO criterion allowed us to proceed to the factor analysis for the questionnaire.

The factor analysis to determine the number of relevant factors included 3 criteria: Factor Load, Screeplot and Parallel Analysis. Table 3 shows the factor loads, estimated by the method of the principal components:

 

 

Factor loads whose cumulative proportion exceed 0.9 should be used.7 However, for the data set, we would have to use 11 factors, which in practice would not solve the problem of data reduction. We moved to the Screeplot criterion of the correlation matrix, where we must eliminate the factors related to Eigenvalues > 1. Figure 1 presents this criterion:

 


Figure 1. Screeplot. The components with variances greater than 1 (above the red line) are the relevant components.

 

By this criterion, we must use 3 factors, and in this case, the commonalities of the variables are presented in table 4. Because Question #13 (How often do you perceive pains in the body due to staying during long periods of playing?) had a commonality less than 0.5 it was excluded.

 

 

The third criterion used to find the number of factors was the Parallel Analysis. By this criterion, the number of factors found was equal to 1, which does not allow for an adequate estimation of the Factor loads.

Therefore, after the three analyzes, we selected the Screeplot result, which points to commonalities for 3 factors and to the withdrawal of only one item from the questionnaire.

The last step of the study was to calculate Cronbach’s alpha,7 in order to measure the internal consistency of the questionnaire. The value found was 0.955, which is very good, ensuring the internal consistency of the instrument.7

 

DISCUSSION

Although the pathological use of games predates the Digital Age, its steep increase came with the birth and growth of computer technologies and of the Internet.

Globalization and the continuous increase in the number of digital players has turned digital gaming into a social fact.14,15,16 A final validated scale was constructed, with the purpose of being used in clinical practice which fully met what was proposed, namely the evaluation of dependence to the pathological digital game.

Therefore, it has become essential to assess its breadth and impact on people’s lives. It is necessary to have a scale validated in a structured manner that can provide elements directed to a specific evaluation that meets the needs of health professionals who must develop strategies for the treatment and care for digital players.

King et al.13 reported that there is a commitment in personal, social, academic and professional life in people with abusive use and/or dependent on digital gaming in their daily lives.

The inclusion of volunteers in the Main and Control groups through the unspecific Internet Addiction Test was useful, because it led to a successful differentiation between the groups through the original 20-question scale: the Main Group scored 7.05, nearly triple and significantly different from the Control Group, at 2.55. This established the main group’s dependent vs. the control group’s non-dependent profiles.

The Factor analysis was performed as a consequence of (i) the satisfactory results of the Bartlett sphericity test which presented low p-value <0.001, indicating a correlation between the variables; (ii) the adequacy of the Kaiser-Meyer-Olkin (KMO) criterion analysis, which was higher than 0.9 in 14 items, higher than 0.8 in 6 items.

In terms of the factor loads, 3 criteria were chosen: the Factor Loads criterion found 11 factors, an high number for 20 questions. The Screeplot criterion indicated 3 factors and the withdrawal of only one question from the scale, namely “How often do you notice body aches because of staying for long periods of time?” The criterion of Parallel Analysis pointed to only 1 factor. We chose the Screeplot Criterion with 3 factors and the withdrawal of the single question, leading to a scale with 19 questions. It is also important to highlight the excellent Cronbach Alpha7 result, with a value of 0.955, which ratifies the internal consistency of the scale, corroborating the previous evaluations, within the objective of this project.

Regarding the limitations of the study, there were no previous similar instruments to aid us as a model. This finding did not compromise the results, but required greater care in the elaboration, validation and application of the scale. We understand that further studies on the effects of digital games on individuals may enhance eventual future instruments.

 

CONCLUSION

The results obtained provided a validated final version for the scale to evaluate the dependence of pathologic digital gaming with 19 questions appropriate to clinical and research contexts in terms of clarity, accuracy and reliability. Statistical results showed that the final version of the scale presented questions in mutual alignment, qualifying it as a positive instrument to measure dependence to pathological digital gaming. The version displayed in the appendix can be confidently used as a pathological digital game dependence scale whenever necessary, in clinical scenarios, as well as to perform specific research on this subject.

We recommend that the study be replicated in a larger sample and representative of the target population.

 

AUTHOR CONTRIBUTION:

ALS King - planned, reviewed the literature, applied the scales and worked on the database.

MK Padua - applied the scales.

E Guedes - applied the scales.

LL Gonçalves - analyzed statistically.

FL Guimarães - applied the scales and worked in the database.

H K Santos - analyzed statistically.

D Rodrigues - analyzed statistically.

AE Nardi - guided the research.

All authors participated in the writing of this article

 

CONFLICT OF INTEREST

Authors declare no conflict of interest regarding this project.

 

ACKNOWLEDGEMENTS

This work was supported by: Carlos Chagas Filho Foundation for Research Support of the State of Rio de Janeiro (FAPERJ); Institute of Psychiatry (IPUB) of the Federal University of Rio de Janeiro (UFRJ); Delete - Conscious Use of Technologies.

 

REFERENCES:

1. Cia AH. Las adicciones no relacionadas a sustancias (DSM-5, APA, 2013): un primer paso hacia la inclusión de las Adicciones Conductuales en las clasificaciones categoriales vigentes. Rev Neuropsiquiatr 2013;76 (4):210-7. DOI:10.20453/RNP.V76I4.1169

2. Abreu CN, Spritzer DT, Góes DS, Karam RG. Dependência de Internet e de Jogos Eletrônicos: uma Revisão. Rev Bras Psiquiatr. 2018;30(2):156-67.

3. Chandler HM. Manual de Produção de Jogos Digitais. Editora Bookman. 2a Edição, 2009.

4. Associação Americana de Psiquiatria DSM-IV-TR. Manual Diagnóstico e Estatístico de Transtornos mentais. 5a edição, Artes Médicas, Porto Alegre, 2000.

5. King ALS, Pádua MK, Guedes E, Nardi AE. Ergonomia Digital. Porto Alegre: EducaBooks, 2018.

6. Goleman, Daniel. Foco: a atenção e seu papel fundamental para o sucesso. Tradução Cassia Zanon, 1ª ed. Rio de janeiro: Objetiva, 2014.

7. Hair JE, Babin B Money AH, Sanouel P. Fundamentos de métodos de pesquisa em administração. Tradução: Lene Belon Ribeiro. Porto Alegre: Bookman, 2005.

8. IAT -The Center for Internet Addiction Recovery, Copyright 2009-2010 by The Center for Internet Addiction; Web Site Designed by Next Sunrise Studios, Bradford PA.

9. R Core Team. (2017) REdaS: A language and environment for statistical computing. R Foundation for Statistical Computing. Vienna, Austria: Version 3.4.2.

10. Wickham H, François R, Henry L, Müller K (2017). dplyr: A Grammar of Data Manipulation. R package version 0.7.4. https://CRAN.R-project.org/package=dplyr

11. Falissard B (2012). psy: Various procedures used in psychometry. R package version 1.1. https://CRAN.R-project.org/package=psy

12. Dinno A (2012). paran: Horn’s Test of Principal Components/Factors. R package version 1.5.1. https://CRAN.R-project.org/package=paran

13. King ALS, Nardi AE, Cardoso A (Organizadores). Nomofobia-Dependência do computador, internet, redes sociais? Dependência do telefone celular? O impacto das novas tecnologias interferindo no comportamento humano. Editora Atheneu, Rio de Janeiro, 2014.

14. Guedes E, Nardi AE, Guimarães FMC, Machado S, King ALS. Social networking, a new online addiction: a review of Facebook and other addiction disorders. MedicalExpress. 2016;3(1):M160101. DOI:10.5935/Medicalexpress.2016.01.01

15. Gonçalves LL. Dependência Digital: tecnologias transformando pessoas, relacionamentos e organizações. Barra Livros, RJ, 2017.

16. King ALS, Pádua MK, Guedes E, Nardi AE. Ergonomia Digital. Porto Alegre: EducaBooks, 2018.