Article published In: The Mental Lexicon
Vol. 14:3 (2019) ► pp.415–423
Methodological and analytic considerations
Quantifying subjective data using online Q-methodology software
Published online: 13 May 2020
https://doi.org/10.1075/ml.20002.lut
https://doi.org/10.1075/ml.20002.lut
Abstract
The Q-Sort methodology has been used to study participants’ subjective views on various topics (Brown, S. (1996). Q Methodology and Qualitative Research. Qualitative Health Research, 61, 561–567. ). The task has historically been completed by manually sorting cards into
categories that force responses into a normal distribution (Brown, S. (1996). Q Methodology and Qualitative Research. Qualitative Health Research, 61, 561–567. ). Data
collection using this method is time consuming and manual data entry is prone to human error. We describe here QMethod Software –
a computerized web-based application that allows participants to sort and record their responses online. This online application
eliminates the need for researchers to attend the study sessions and to manually enter data. QMethod Software described here is
currently being used in both applied and cognitive psychology studies, including a clinical study that evaluates participants’
perception of behaviours seen as most characteristic or most uncharacteristic of psychological aggression or coercive control in
situations of intimate partner violence. In a health psychology study, it is being used to examine people’s perceptions of food
allergy, and in a psycholinguistics lab it was used to evaluate the affective valence, abstractness, and semantic richness ratings
of words. We will show here that the data obtained from one of these psycholinguistic studies (abstractness/concreteness)
correlates highly with existing measures (Brysbaert, M., Warriner, A., & Kuperman, V. (2014). Concreteness ratings for 40 thousand generally known English word lemmas. Behavior Research Methods, 461, 904–911. )
thus demonstrating that the Q-sort methodology and this particular implementation, the QMethod Software app, reproduces more
typical evaluations/assessments in the psycholinguistics literature.
Keywords: Q-Method, software, online, psycholinguistics, concreteness, ratings, psychology
Article outline
- Traditional Q-Methodology
- The app for that
- Psycholinguistic values using Q-Method
- Method
- Results
- Discussion
References
References (17)
Ahmed, S., Bryant, L., Tizro, Z., & Shickle, D. (2012). Interpretations of informed choice in antenatal screening: A cross-cultural, Q-methodology study. Social Science & Medicine, 74(7), 997–1004.
Alberts, K., & Ankenmann, B. (2001). Simulating Pearson’s and Spearman’s Correlations in Q-Sorts Using Excel. Social Science Computer Review, 191, 221–226.
Barker, J. (2008). Q-methodology: An alternative approach to research in nurse education. Nurse Education Today, 281, 917–925.
Block, J. (1961). The Q-sort method in personality assessment and psychiatric research. Springfield, IL: Charles C Thomas.
(2008). The Q-sort in character appraisal: Encoding subjective impressions of persons quantitatively. Washington, DC, US: American Psychological Association.
Brysbaert, M., Warriner, A., & Kuperman, V. (2014). Concreteness ratings for 40 thousand generally known English word lemmas. Behavior Research Methods, 461, 904–911.
Davies, Mark. (2010–). The Corpus of Historical American English: 400 million words, 1810–2009. Retrieved from [URL]
Freberg, K., Lutfallah, S., Saling, K., & Freberg, L. (2019). What Makes an Influencer Influential? Using the California Q-sort to Predict Social Media Influence. Manuscript in preparation.
Ghandour, B., Madison Donner, Zoe Ross-Nash, Maryn Hayward, Madalyn Pinto, & Tara DeAngelis. (2018). Perfectionism in past and present anorexia nervosa. North American Journal of Psychology, 20(3), 671–690.
Goodrich, M. (2016). Exploring School Counselors’ Motivations to Work with Lgbtqqi Students in Schools: A Q Methodology Study. Professional School Counseling, 2016, 21(1a).
Ho, G. W. K. (2017). Examining perceptions and attitudes: A review of Likert-type scales versus Q-methodology. Western Journal of Nursing Research, 39(5), 674–689.
Marmolejo-Ramos, F., Correa, J. C., Sakarkar, G., Ngo, G., Ruiz-Fernández, S., Butcher, N., & Yamada, Y. (2017). Placing joy, surprise and sadness in space: A cross-linguistic study. Psychological Research, 81(4), 750–763.
Serfass, D., & Sherman, R. (2013). A methodological note on ordered Q-Sort ratings. Journal Of Research In Personality, 47(6), 853–858.
Snefjella, B., Généreux, M., & Kuperman, V. (2018). Historical evolution of concrete and abstract language revisited. Behavior Research Methods.
Cited by (88)
Cited by 88 other publications
Andersson, Johnn, Hans Hellsmark & Elizaveta Johansson
Alderson, Sarah, Chand Muthoo, Hannah Rossington, Phil Quirke, Damian Tolan, Philip Quirke, Eva Morris, Nicholas West, Paul Finan, Daniel Swinson, Alice Dewdney, Damian Tolan, Simon Howell, James Turvill, Sarah Alderson, Susan Richman, Amy Downing, John Taylor, Rebecca Birch, Hannah Rossington, Emily Connearn, Mariam Wagnese, Gemma Hemmings, Rebecca Miller, Kate Bartholomew & Emma Jackson
AlKhateeb, Hadeel Abdelkarim H. M.
Barclay, Ella Grace
Behringer, Julia
Bonar, Gary, Yvette Slaughter, Anne Keary & Tanya Davies
Buckwell, Andrew, Syezlin Hasan, Alana Knight, Christopher Fleming, Jeremy Harte & James C.R. Smart
Chang, Joy W., Kelcie Brophy, Kerry A. Ryan, Joel H. Rubenstein, Evan S. Dellon, Lauren P. Wallner, Hyungjin Myra Kim & and Raymond De Vries
Easter, Tara S., Anna R. Santo, Abigail H. Sage, Neil H. Carter, Kai M. A. Chan & Jason I. Ransom
Emad Osman Omer, Mohammed & Youmen Chaaban
Govender, Maheshwaran, Meenakshi Poti, Thanne Walawwe Gedera Fathima Mafaz Nijamdeen, Kodikara Arachchilage Sunanda Kodikara, Farid Dahdouh-Guebas & Jean Hugé
Haugen, Juliana Figueira & Jon Olaf Olaussen
Hsu, Hua-I, Chih-Chi Liu, Chun-Yu Kuo, Job van Exel, Hsueh-Chih Chen & Stephanie Fu Yang
Lammers, Romée, Sikke R. Jansma, Bernard P. Veldkamp, Matthias de Visser & Jordy F. Gosselt
Lee, Kyung Eun, Hae Youn Min & Jinmoo Heo
Luu, Betty, Susan Collings, Sarah Ciftci & Meredith McLaine
Lybaert, Chloé, Shauny Seynhaeve & Pauline Verhelst
2025. Teachers’ attitudes towards sociolinguistic variation in Dutch L2 education in Flanders. In Variation in Language Acquisition [Trends in Language Acquisition Research, 34], ► pp. 197 ff.
Ober, Carina, Carolin Canessa, Fabian Frick & Johannes Sauer
Shaw, Anne
Sinclair, Karen
Soriano Longarón, Sara, Lennart Johansson, Imke Christiaans, Erwin Birnie, Marielle van Gijn, Adelita V. Ranchor & Mirjam Plantinga
Stanyon, Maham, Yayoi Shikama, Jo Horsburgh, Ravi Parekh, Gautham Benoy, Sayaka Oikawa, Megumi Yasuda, Zoe Moula & Koji Otani
Suryani, Amalia, Eko Agus Prasetio, Niek Moonen & Jelena Popovic
Visser, Anja, Annelieke Damen, Carmen Schuhmann, X. J. S. (Sujin) Rosie, Hanneke Muthert, Erik Olsman, Marjo van Zundert & Gaby Jacobs
Vollhardt, Johanna Ray, Helin Ünal, Zsolt P. Szabó, Hu Young Jeong, J. Christopher Cohrs & Danielle Black
Watson, Kaitlyn E., Theresa J. Schindel, Sherly Meilianti, Ross T. Tsuyuki & Yazid N. Al Hamarneh
Yaros, Jennifer, Mirjam Oude Egbrink, Benedikt Langenberg, Silvia Evers & Aggie Paulus
Aboagye, Prince Dacosta & Ayyoob Sharifi
Apine, Elina & Tim Stojanovic
Becker, Emily
Bennett, C. Verity, Louisa M. Roberts, Phil Smith, Melissa Meindl, Philip Pallmann, Fiona Lugg-Widger, Elizabeth-Ann Schroeder, Linda Adara, Kim Munnery, Lena Meister, Sharon Ayayo, Sarah Rawlinson, Donald Forrester, Stavros Petrou, James White & David Westlake
Blay, Basilia E. & Alma S. Espartinez
Brugger, Fritz & Joschka J. Proksik
Claassen, Casper Hendrik, Eric Bidet, Junki Kim & Yeanhee Choi
Dirsehan, Taşkın
Espartinez, Alma S.
Garbellini, Simon, Angela Dew, Christine Imms, Simon Darcy, Keith McVilly & Gisselle Gallego
Gorjanc, Sašo, Timothy A. Stojanovic & Charles R. Warren
Hulme, Moira, Carrie Adamson & Dominic Griffiths
Jugert, Philipp, Anna-Maria Mayer, Katharina Eckstein, Saskia Langer, Leif Mönter, Philipp König, Whitney Agunyego, Franco Bastias & J. Christopher Cohrs
Meulenbroeks, Isabelle, Magdalena Z. Raban, Karla Seaman, Kathleen Rolfe, Crisostomo Mercardo, Kristiana Ludlow, Nasir Wabe & Johanna Westbrook
Moore, James G, Gregory W Hartley, Raine Osborne, Kendra L Harrington & Mary Jane Rapport
Piroli, Erika, Donato Salvatore La Mela Veca, Jay Mistry & Yiannis Kountouris
Rogers, Beth A., Laura A. Killam, Robin D. Lockhart, Kelly Foltz-Ramos, Marian Luctkar-Flude, Suzanne H. Campbell, Jane Tyerman, Melissa Ehmke & Ashley E. Franklin
Slaughter, Yvette, Renata Aliani, Gary Bonar & Anne Keary
Stanberry, Joanna, David F. Murphy & Janis Bragan Balda
Swanepoel, Azette, Corlia Janse van Vuuren, Shoba Nayar & Claudia Hilton
van den Hoed, Monique W., Ramon Daniëls, Audrey Beaulen, Jan P. H. Hamers, Job van Exel & Ramona Backhaus
Wilfong, Matthew, Debasmita Patra, Mitchell Pavao-Zuckerman & Paul T. Leisnham
Zhou, Qiqi, Bei Wang & Igor Mayer
Broussard, Ashlynn, Farid Dahdouh-Guebas & Jean Hugé
Friess, Dennis & Nina Katharina Herff
Gantt‐Howrey, Alexandra & Gülşah Kemer
Green, Abbey, Gerry Chan & Rita Orji
Kratzer, Simon, Markus Westner & Susanne Strahringer
Low, Robinson R., Darby P. Swayne, Caitlin L. Magel, Jessie Israel & Phillip S. Levin
Lundberg, Adrian & Martin Stigmar
Lyngdorf, Niels Erik Ruan, Xiangyun Du & Adrian Lundberg
Maczka, Krzysztof, Aleksandra Lis-Plesińska & Katarzyna Iwińska
Maczka, Krzysztof, Piotr Matczak, Marcin Mielewczyk, Patrycja Przewoźna, Adam Inglot, Piotr Wężyk, Karolina Zięba-Kulawik & Paweł Hawryło
Mantzalas, Jane, Amanda L. Richdale, Cheryl Dissanayake & Yu-Wei Ryan Chen
Nicholas, Sean Olivia, Shiloh Groot & Niki Harré
Parfitt, Anne & Stuart Read
Wiarda, Martijn, Tom B.J. Coenen & Neelke Doorn
Andersen, Christopher R., Justin Presseau, Victoria Saigle, Emily Fitzgerald, Madeline Lamanna, Phil Talbot, Anthony Delaney & Shane W. English
Burak, Durmuş & Ahmet Simsar
Calaguas, Noriel P.
Du, Xiangyun, Aida Guerra, Bente Nørgaard, Youmen Chaaban, Adrian Lundberg & Niels Erik Ruan Lyngdorf
Du, Xiangyun, Adrian Lundberg, Mohamed A. Ayari, Khalid K. Naji & Alaa Hawari
Heath, Abigail & Matthew Cotton
Herrick, Nicole, Tala Al-Rousan, Carla Rodriguez, Ji Hae Lee, Anne Marie Valente, Jordan Stone, Gladys Ramos, Bendelyn Asante-Boateng, Howaida El-Said, Maria Moceri-Casas & Laith Alshawabkeh
Johnson, Malcolm S., Vanessa M. Adams, Jason Byrne & Rebecca M. B. Harris
Leong, Rachel, Camille Lebarbenchon, Jingru Zhang & Joanna L. Coleman
Martins, Ana Carolina Tardin, Luciana Pereira Freire Martins, Renata Velozo Timbó, Natanael Victor Furtunato Bezerra, Ada Amalia Ayala Urdapilleta, Florival Martins Passos Filho & Ciro Martins Gomes
Migchelbrink, Koen & Steven Van de Walle
Nelson, Laura K., Molly Bogeberg, Alison Cullen, Laura E. Koehn, Astrea Strawn & Phillip S. Levin
Seynhaeve, Shauny, B. Deygers & E. Simon
Van den Branden, Laura, Natacha Van de Craen, Luka Van Leugenhaege, Eveline Mestdagh, Olaf Timmermans, Bart Van Rompaey & Yvonne J Kuipers
Wang, Edward, Tala Al-Rousan, Wali Mansour, Diego Oliva, Nicole Herrick, Birju Desai & Laith Alshawabkeh
Wilson, Carly J., Lindsey E. Eberman, Ansley S. Redinger, Elizabeth R. Neil, Zachary K. Winkelmann & Chris Connaboy
Zhao, Chen & Sophia Jowett
Alanazi, Ahmed S., Heather Wharrad, Fiona Moffatt, Michael Taylor & Muhammad Ladan
Du, Xiangyun & Adrian Lundberg
Dussart, Pascal, Lise A. van Oortmerssen & Bé Albronda
Medina-Cortes, DiMaris
Wu, Peng & Yanyan Wang
Azizah, Fahma Fiqhiyyah Nur, Hiroe Ishihara, Aiora Zabala, Yutaro Sakai, Gede Suantika & Nobuyuki Yagi
This list is based on CrossRef data as of 27 november 2025. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
