Indonesian adaptation and validation of the Social Media Competence Scale for College Students (SMC-CS): A confirmatory factor analysis approach
DOI:
https://doi.org/10.26486/psikologi.v27i2.4689Keywords:
College students, confirmatory factor analysis, cross-cultural adaptation, social media competence scale.Abstract
The rapid integration of social media into students’ academic, social, and personal lives underscores the need for valid and reliable instruments to assess social media competence. Understanding this competence is crucial, as social media is not only a communication tool but also a source of information, a space for self-expression, and a domain for identity formation. This study aimed to adapt and validate the Social Media Competence Scale for College Students (SMC-CS) into Bahasa Indonesia. The adaptation process followed standardized cross-cultural procedures, including translation, expert review for content validity, conceptual alignment, and pilot testing. A total of 728 university students aged 17–25 years from various Indonesian institutions participated in this study. Data analysis was conducted using Confirmatory Factor Analysis (CFA) with the MLM estimator to address multivariate non-normality. The Indonesian version of the SMC-CS demonstrated a four-factor structure—Technical Usability, Content Interpretation, Content Generation, and Affective Regulation—with strong reliability (CR > 0.83) and acceptable convergent validity (AVE ≥ 0.47). These findings provide evidence that the adapted instrument is both valid and reliable for assessing college students’ social media competence in the Indonesian context.
Keywords:
College students, confirmatory factor analysis, cross-cultural adaptation, social media competence scale.
References
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012
Akbar, M., & Kusnandar, K. (2024). Social media literacy among rural people in Indonesia: Empirical findings from a nationwide survey. Information Development. https://doi.org/10.1177/02666669241302053
Al-Sumait, F., Helsper, E. J., & Rahali, M. (2024). Adapting global methodologies to digital inequalities research in a multicultural Arab environment. Convergence, 30(3), 1105–1119. https://doi.org/10.1177/13548565231174594
Alber, J. M., Bernhardt, J. M., Stellefson, M., Weiler, R. M., Anderson-Lewis, C., Miller, M. D., & MacInnes, J. (2015). Designing and testing an inventory for measuring social media competency of certified health education specialists. Journal of Medical Internet Research, 17(9), e4943. https://doi.org/10.2196/jmir.4943
Balhara, Y. P. S., Mahapatra, A., Sharma, P., & Bhargava, R. (2018). Problematic internet use among students in South-East Asia: Current state of evidence. Indian Journal of Public Health, 62(3), 197–210. https://doi.org/10.4103/ijph.IJPH_288_17
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186–3191. https://doi.org/10.1097/00007632-200012150-00014
Bettis, A. H., Burke, T. A., Nesi, J., & Liu, R. T. (2022). Digital technologies for emotion-regulation assessment and intervention: A conceptual review. Clinical Psychological Science, 10(1), 3–26. https://doi.org/10.1177/21677026211011982
Bozkurt, A., & Tu, C.-H. (2016). Digital identity formation: Socially being real and present on digital networks. Educational Media International, 53(3), 153–167. https://doi.org/10.1080/09523987.2016.1236885
Briceño, E. M., Arce Rentería, M., Gross, A. L., Jones, R. N., Gonzalez, C., Wong, R., Weir, D. R., Langa, K. M., & Manly, J. J. (2023). A cultural neuropsychological approach to harmonization of cognitive data across culturally and linguistically diverse older adult populations. Neuropsychology, 37(3), 247–257. https://doi.org/10.1037/neu0000816
Brown, G. T. L., Harris, L. R., O’Quin, C., & Lane, K. E. (2017). Using multi-group confirmatory factor analysis to evaluate cross-cultural research: Identifying and understanding non-invariance. International Journal of Research & Method in Education, 40(1), 66–90. https://doi.org/10.1080/1743727X.2015.1070823
Byrne, B. M. (2016). Adaptation of assessment scales in cross-national research: Issues, guidelines, and caveats. International Perspectives in Psychology, 5(1), 51–65. https://doi.org/10.1037/ipp0000042
Çapik, C., Gözüm, S., & Aksayan, S. (2018). Intercultural scale adaptation stages, language and culture adaptation: updated guideline. Florence Nightingale Journal of Nursing-Florence Nightingale Hemsirelik Dergisi, 26(3), 199–210. https://doi.org/10.26650/fnjn397481
Chae, D., Kang, K., Benkert, R., & Doorenbos, A. Z. (2018). Evaluation of the psychometric properties of the Korean version of the Cultural Competence Assessment. Japan Journal of Nursing Science, 15(1), 56–66. https://doi.org/10.1111/jjns.12169
Choi, D., & Lim, S. (2016). Effects of social and technology overload on psychological well-being in young South Korean adults: The mediatory role of social network service addiction. Computers in Human Behavior, 61, 245–254. https://doi.org/10.1016/j.chb.2016.03.032
Clark, L. A., & Watson, D. (2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412–1427. https://doi.org/10.1037/pas0000626
Cruchinho, P., López-Franco, M. D., Capelas, M. L., Almeida, S., Bennett, P. M., Miranda da Silva, M., Teixeira, G., Nunes, E., Lucas, P., & Gaspar, F. (2024). Translation, cross-cultural adaptation, and validation of measurement instruments: A practical guideline for novice researchers. Journal of Multidisciplinary Healthcare, 2701–2728. https://doi.org/10.2147/JMDH.S419714
Dewi, Z. L., Halim, M. S., & Derksen, J. (2018). Emotional intelligence competences of three different ethnic groups in Indonesia. Asian Ethnicity, 19(1), 36–58. https://doi.org/10.1080/14631369.2017.1310615
Döveling, K., Harju, A. A., & Sommer, D. (2018). From mediatized emotion to digital affect cultures: New technologies and global flows of emotion. Social Media+ Society, 4(1), 1–11. https://doi.org/10.1177/2056305117743141
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
Gómez-Lugo, M., Espada, J. P., Morales, A., Marchal-Bertrand, L., Soler, F., & Vallejo-Medina, P. (2016). Adaptation, validation, reliability and factorial equivalence of the Rosenberg Self-Esteem Scale in Colombian and Spanish population. The Spanish Journal of Psychology, 19, E66. https://doi.org/10.1017/sjp.2016.67
Hair Jr, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021). Partial least squares structural equation modeling (PLS-SEM) using R: A workbook. Springer Nature. https://doi.org/10.1007/978-3-030-80519-7
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Hutabarat, F. (2023). Navigating diversity: Exploring religious pluralism and social harmony in Indonesian society. European Journal of Theology and Philosophy, 3(6), 6–13. https://doi.org/10.24018/theology.2023.3.6.125
Huwaida, L. A., Yusuf, A., Satria, A. N., Darmawan, M. A., Ammar, M. F., Yanuar, M. W., Hidayanto, A. N., & Yaiprasert, C. (2024). Generation Z and Indonesian Social Commerce: Unraveling key drivers of their shopping decisions. Journal of Open Innovation: Technology, Market, and Complexity, 10(2), 100256. https://doi.org/10.1016/j.joitmc.2024.100256
Indah, R. N., Toyyibah, T., Budhiningrum, A. S., & Afifi, N. (2022). The research competence, critical thinking skills and digital literacy of Indonesian EFL students. Journal of Language Teaching and Research, 13(2), 315–324. https://doi.org/10.17507/jltr.1302.11
Jankowski, P. J. (2019). A construct validation argument for the Intercultural Development Inventory. Measurement and Evaluation in Counseling and Development, 52(2), 75–89. https://doi.org/10.1080/07481756.2018.1497428
Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44(3), 486–507. https://doi.org/10.1177/0049124114543236
Kline, R. B. (2023). Principles and practice of structural equation modeling. Guilford publications.
Lai, K., & Green, S. B. (2016). The problem with having two watches: Assessment of fit when RMSEA and CFI disagree. Multivariate Behavioral Research, 51(2–3), 220–239. https://doi.org/10.1080/00273171.2015.1134306
Marsh, H. W., Guo, J., Dicke, T., Parker, P. D., & Craven, R. G. (2020). Confirmatory factor analysis (CFA), exploratory structural equation modeling (ESEM), and set-ESEM: Optimal balance between goodness of fit and parsimony. Multivariate Behavioral Research, 55(1), 102–119. https://doi.org/10.1080/00273171.2019.1602503
Masur, P. K., DiFranzo, D., & Bazarova, N. N. (2021). Behavioral contagion on social media: Effects of social norms, design interventions, and critical media literacy on self-disclosure. Plos One, 16(7), e0254670. https://doi.org/10.1371/journal.pone.0254670
Polanco-Levicán, K., & Salvo-Garrido, S. (2022). Understanding social media literacy: A systematic review of the concept and its competences. International Journal of Environmental Research and Public Health, 19(14), 8807. https://doi.org/10.3390/ijerph19148807
Pramukti, I., Nurmala, I., Nadhiroh, S. R., Tung, S. E. H., Gan, W. Y., Siaw, Y.-L., Yang, Y.-N., Griffiths, M. D., Lin, C.-Y., & Pakpour, A. H. (2023). Problematic use of internet among Indonesia university students: Psychometric evaluation of Bergen social media addiction scale and internet gaming disorder scale-short form. Psychiatry Investigation, 20(12), 1103–1111. https://doi.org/10.30773/pi.2022.0304
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
Reynolds, R. (2016). Defining, designing for, and measuring “Social Constructivist Digital Literacy” development in learners: A proposed framework. Educational Technology Research and Development, 64(4), 735–762. https://doi.org/10.1007/s11423-015-9423-4
Savalei, V. (2018). On the computation of the RMSEA and CFI from the mean-and-variance corrected test statistic with nonnormal data in SEM. Multivariate Behavioral Research, 53(3), 419–429. https://doi.org/10.1080/00273171.2018.1455142
Savalei, V., Brace, J. C., & Fouladi, R. T. (2023). We need to change how we compute RMSEA for nested model comparisons in structural equation modeling. Psychological Methods, 29(3), 480–493. https://doi.org/https://doi.org/10.1037/met0000537
Sharma, S., & Sharma, M. (2022). Social media competence: An assessment of male and female users in India. In Rajagopal & R. Behl (Eds.), Managing Disruptions in Business: Causes, Conflicts, and Control (pp. 103–119). Springer. https://doi.org/10.1007/978-3-030-79709-6_5
Shi, D., Lee, T., & Maydeu-Olivares, A. (2019). Understanding the model size effect on SEM fit indices. Educational and Psychological Measurement, 79(2), 310–334. https://doi.org/10.1177/0013164418783530
Spante, M., Hashemi, S. S., Lundin, M., & Algers, A. (2018). Digital competence and digital literacy in higher education research: Systematic review of concept use. Cogent Education, 5(1), 1519143. https://doi.org/10.1080/2331186X.2018.1519143
Sujarwoto, Saputri, R. A. M., & Yumarni, T. (2023). Social media addiction and mental health among university students during the COVID-19 pandemic in Indonesia. International Journal of Mental Health and Addiction, 21(1), 96–110. https://doi.org/10.1007/s11469-021-00582-3
Taherdoost, H. (2019). What is the best response scale for survey and questionnaire design; review of different lengths of rating scale/attitude scale/Likert scale. International Journal of Academic Research in Management (IJARM), 8(1), 1–10.
Tzafilkou, K., Perifanou, M., & Economides, A. A. (2022). Development and validation of students’ digital competence scale (SDiCoS). International Journal of Educational Technology in Higher Education, 19(1), 30. https://doi.org/10.1186/s41239-022-00330-0
Van Laar, E., Van Deursen, A. J. A. M., Van Dijk, J. A. G. M., & De Haan, J. (2017). The relation between 21st-century skills and digital skills: A systematic literature review. Computers in Human Behavior, 72, 577–588. https://doi.org/10.1016/j.chb.2017.03.010
Walsh, G., Schaarschmidt, M., & Von Kortzfleisch, H. (2016). Employees’ company reputation-related social media competence: Scale development and validation. Journal of Interactive Marketing, 36(1), 46–59. https://doi.org/10.1016/j.intmar.2016.05.001
Wei, Z. (2024). Navigating digital learning landscapes: Unveiling the interplay between learning behaviors, digital literacy, and educational outcomes. Journal of the Knowledge Economy, 15(3), 10516–10546. https://doi.org/10.1007/s13132-023-01522-3
Widaman, K. F., & Helm, J. L. (2023). Exploratory factor analysis and confirmatory factor analysis. In H. Cooper, M. N. Coutanche, L. M. McMullen, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology: Data analysis and research publication (2nd ed., pp. 379–410). American Psychological Association. https://doi.org/https://doi.org/10.1037/0000320-017
Xia, Y., & Yang, Y. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51(1), 409–428. https://doi.org/10.3758/s13428-018-1055-2
Ximénez, C., Maydeu-Olivares, A., Shi, D., & Revuelta, J. (2022). Assessing cutoff values of SEM fit indices: Advantages of the unbiased SRMR index and its cutoff criterion based on communality. Structural Equation Modeling: A Multidisciplinary Journal, 29(3), 368–380. https://doi.org/10.1080/10705511.2021.1992596
Zhu, S., Hao Yang, H., Xu, S., & MacLeod, J. (2020). Understanding social media competence in higher education: Development and validation of an instrument. Journal of Educational Computing Research, 57(8), 1935–1955. https://doi.org/10.1177/0735633118820631
Zou, W., Drake, A. P., Masur, P. K., Whitlock, J., & Bazarova, N. N. (2024). Examining learners’ engagement patterns and knowledge outcome in an experiential learning intervention for youth’s social media literacy. Computers & Education, 216, 105046. https://doi.org/10.1016/j.compedu.2024.105046
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Fadhil Maliky Islah, Julaibib
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
In line with the license, authors and users (readers, etc.) are allowed to share and adapt the material. In addition, the material must be given appropriate credit, provided with a link to the license, and indicated if changes were made. If authors remix, transform or build upon the material, authors must distribute their contributions under the same license as the original.
