A Delphi Technique in Confirming the Evaluation Model of the Stories Containing Moral Dilemmas based on Emotional Scales

مطالعات زبان و ترجمه

Article 7, Volume 54, Issue 1, April 2021, Pages 157-184   

Document Type: Research Article

DOI: 10.22067/lts.v54i1.60254

Authors

Vida Dehnad^{* 1}; Azar Hosseini Fatemi¹; Behzad Ghonsooly²

¹Department of English, Ferdowsi University of Mashhad, Mashhad, Iran

²Department of English, Ferdowsi University of Mashhad, Mashhad, Iran

Abstract

In line with new findings in the interdisciplinary fields of philosophy and psychology of emotions and cognition, the use of emotional scales in assessing readers’ reactions to the texts containing moral dilemmas has attracted the attention of researchers. Likewise, this study, using the Delphi technique and the opinions of experts tried to predict the emotional-cognitive reactions of two groups of deontic and consequentialist readers to the texts containing moral dilemmas. For this purpose, a mixed-methods research was chosen and a three-phase Delphi technique was used for collecting the data, i.e., experts’ opinions. The expert group consisted of nine university English teachers and psychologists fluent in English. First, the experts were provided with six strategic questions to be able to comment. After coding and converting the qualitative data into quantitative data and preparing a concept map, first, the percentage of the pairwise agreement between the raters was calculated, and then, the formulas of Krippendorff’s alpha and Fleiss Kappa were used to determine the reliability of the 72 pairs of decisions. Accordingly, the acceptable values ​​of 0.76, 0.72, and 0.71 were obtained for the mentioned formulas. Based on the results of the two stages of the Delphi technique, a 9-point Likert scale questionnaire was developed and re-assessed by the experts. After rating the questionnaire items by the experts, the intra-class correlation coefficient with the two-way random effect model was used. A significant value of 0.872 was obtained from this calculation, which confirmed the congruence of experts’ opinions about the probable behaviors of the two groups of readers in reaction to the texts containing ethical dilemmas. This should be noted that the collection of experts’ opinions and the evaluation of the reliability of the opinions, in three consecutive rounds, took about four months.

Keywords

Emotions; Dilemmas; Delphi Technique; Experts

References

سجّادی، س. (1391). قرآن و ارزش اخلاقی عواطف و احساسات. پژوهش‌های قرآنی، 4(68)، 43-24.

میرزایی، ط.، و فراهانی، م.، و حسنی، ج. (1393). بررسی رابطۀ عواطف و وجدان با قضاوت اخلاقی. فصلنامۀ روانشناسی شناختی، 2(2)، 36-28.

نجاتی، م. ( 1381) . قرآن و روان‌شناسی، ترجمۀ عبّاس عرب. چاپ پنجم، مشهد: بنیاد پژوهش‌های اسلامی.

Akins, R. B., Tolson, H., & Cole, B. R. (2005). Stability of response characteristics of a Delphi panel: Application of bootstrap data expansion. BMC Medical Research Methodology, 5, 37.

Bagnoli, C. (2011). Introduction. In Morality and the emotions (p. 11). Oxford, England: Oxford University Press.

Basu, A., Phipps, S., Long, R., Essegbey, G., & Basu, N. (2015). Identification of response options to artisanal and small-scale gold mining (ASGM) in Ghana via the Delphi process. International Journal of Environmental Research and Public Health, 12(9),11345-11363.

Blasi, A. (2005). Moral character: A psychological approach. In D. K. Lapsley & F. C. Power (Eds.), Character psychology and character education (pp. 67–100). Notre Dame, IN: University of Notre Dame Press.

Boulkedid, R., Abdoul, H., Loustau, M., Sibony, O., & Alberti, C. (2011). Using and reporting the Delphi method for selecting healthcare quality indicators: A systematic review. PLoS ONE, 6(6), 1-9.

Carletta, J. (1998). Interpreting reliability results. Informatics Server. https://homepages.inf.ed.ac.uk/jeanc/maptask-coding-html/node23.html

Chapman, H. A. and Anderson, A. K. (2013). Things rank and gross in nature: A review and synthesis of moral disgust. Psychological Bulletin 139(2), 300–32.

Cherry, K. (2020). How the halo effect influences the way we perceive attractive people. Verywell Mind. https://www.verywellmind.com/what-is-the-halo-effect-2795906

Choe, S. Y., & Min, K. H. (2011). Who makes utilitarian judgments? The influences of emotions on utilitarian judgments. Judgment and Decision Making, 6(7), 580–592.

Colby, A., & Damon, W. (1992). Some do care: Contemporary lives of moral commitment. New York, NY: The Free Press.

Davis, L. C. (2016, February 5).  Do emotions and morality mix? The Atlantic. https://www.theatlantic.com/science/archive/2016/02/how-do-emotions-sway-moral-thinking/460014/

Eubank, B. H., Mohtadi, N. G., Lafave, M. R., Wiley, J. P., Bois, A. J., Boorman, R. S., & Sheps, D. M. (2016). Using the modified Delphi method to establish clinical consensus for the diagnosis and treatment of patients with rotator cuff pathology. BMC Medical Research Methodology, 16(1),  https://doi.org/10.1186/s12874-016-0165-8.

Glenn, A. L., Koleva, S., Iyer, R., Graham, J., & Ditto, P. H. (2010). Moral identity in psychopathy. Judgment and Decision making, 5(7), 497–505.

Greene, J. D. (2009). Dual-process morality and the personal/impersonal distinction: A reply to McGuire, Langdon, Coltheart, and Mackenzie. Journal of Experimental Social Psychology, 45(3), 581-584. 

Greene, J. D., Morelli, S. A., Lowenberg, K., Nystrom, L. E., & Cohen, J. D. (2008). Cognitive   load selectively interferes with utilitarian moral judgment. Cognition, 107(3), 1144-1154.

Green, R. (2014). The Delphi technique in educational research. SAGE Open, 4(2), 1-8. 

Habibi, A., & Sarafrazi, A. (2014). Delphi technique theoretical framework in qualitative. International Journal of Engineering Science, 3(4), 8-13.

Hedlund-de Witt, N. (2013). Integral research center. Coding. https://www.academia.edu/9864164/Coding_An_Overview_and_Guide_to_Qualitative_Data_Analysis_for_Integral_Researchers.

Horslen, B. C., & Carpenter, M. G. (2011). Arousal, valence and their relative effects on postural control. Experimental Brain Research, 215(1), 27-34.

Hsu, C. C., & Sandford, B. (2007). Minimizing non-response in the Delphi process: How to respond to non-response. Practical Assessment, Research & Evaluation, 12, 1-6.

Isen, A. M. (2001). An influence of positive affect on decision making in complex situations:   Theoretical issues with practical implications. Journal of Consumer Psychology, 11(2), 75-85.

Ivan, C. (2015). On disgust and moral judgments: A review. Journal of European Psychology Students, 6(1), 25-36.

Jacobs A. M. (2015). Neurocognitive poetics: Methods and models for investigating the neuronal and cognitive-affective bases of literature reception. Frontiers in Human Neuroscience, 9, 186.

Karen, A. (2012). What is an ethical dilemma? Social Worker.com. https://www.socialworker.com/feature-articles/ethics-articles/What_Is_an_Ethical_Dilemma%3F/

Kleingeld, P. (2014). Debunking confabulation: Emotions and the significance of empirical   psychology for Kantian ethics. In Alix Cohen (Ed.), Kant on Emotion and Value (pp.145-165). London, UK: Palgrave Macmillan.

Koenigs, M., Young, L., Adolphs, R., Tranel, D., Cushman, F., Hauser, M., & Damasio, A. (2007). Damage to the prefrontal cortex increases utilitarian moral judgements. Nature, 446(7138), 908-911.

Kohlberg, L. (1969). Stage and sequence: The cognitive developmental approach to socialization. In D. A. Goslin (Ed.), Handbook of socialization theory and research (pp.347–480). Chicago, IL: Rand McNally.

Landers, R. L. (2011). Intraclass correlations (ICC) and interrater reliability in SPSS. Retrieved from http://neoacademic.com/2011/11/16/computing-intraclass-correlations-icc-as-estimates-of-interrater-reliability-in-spss/

Lapsley, D. (2015). Moral identity and developmental theory. Human Development, 58(3), 164-171.

Lauer, G. (2009). Going empirical. Why we need cognitive literary studies. Journal of Literary Theory, 3(1), 145-154.

Lerner, J., Li, Y., Valdesolo, P., & Kassam, K. (2015). Emotion and decision making. Annual Review of Psychology, 66, 799-823.

Lewis, M., Haviland-Jones, J. M., & Barrett, L. F. (2010). History of emotions: Issues of change and impact. In Handbook of emotions (pp. 125-133). New York, NY: Guilford Press.

Loewenstein, G. F., Weber, E. U., Hsee, C. K., & Welch, N. (2001). Risk as feelings. Psychological Bulletin, 127(2), 267–286.

Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382-385.

Mihailov, E. (2015). Is deontology a moral confabulation? Neuroethics, 9(1), 1-13.

Milkoreit, M. (2014). Hot deontology and cold consequentialism: An empirical exploration of ethical reasoning among climate change negotiators. Climatic Change, 130(3), 397-409.

Moll, J., & De Oliveira-Souza, R. (2007). Moral judgments, emotions and the utilitarian brain. Trends in Cognitive Sciences, 11(8), 319-321.

Monin, B., Pizarro, D. A., & Beer, J. S. (2007). Deciding versus reacting: Conceptions of moral judgment and the reason-affect debate. Review of General Psychology, 11(2), 99-111.

O'Brien, M., Miner Weaver, J., Nelson, J. A., Calkins, S. D., Leerkes, E. M., & Marcovitch, S. (2011). Longitudinal associations between children's understanding of emotions and theory of mind. Cognition & Emotion, 25(6), 1074-1086.

Osman, M. (2015). Dynamic moral judgments and emotions. Psychology, 6(8), 922-931.

Powell, C. (2003). The Delphi technique: Myths and realities. Journal of Advanced Nursing, 41(4), 376-382.

Razin, A. (2008). The models of moral activity. Proceedings of the XXII World Congress of Philosophy, 349-354.

Tamir, D. I., Bricker, A. B., Dodell-Feder, D., & Mitchell, J. P. (2015). Reading fiction and reading minds: The role of simulation in the default network. Social Cognitive and Affective Neuroscience, 11(2), 215-224.

Seidel, A., & Prinz, J. (2013). Sound morality: Irritating and icky noises amplify judgments in divergent moral domains. Cognition, 127(1), 1-5.

Skulmoski, G., & Hartman, F. (2007). The Delphi method for graduate research. Journal of Information Technology Education, 6(1), 1-21.

Stewart, D. W., Shamdasani, P. N., & Rook, D. W. (2007). Focus groups: Theory and practice. Thousand Oaks, CA: Sage Publications

Storbeck, J., & Clore, G. L. (2007). On the interdependence of cognition and emotion. Cognition & Emotion, 21(6), 1212-1237.

Sunstein, C. R. (2013). Is deontology a heuristic? On psychology, neuroscience, ethics, and law. SSRN Electronic Journal. https://doi.org /10.2139/ssrn.2304760.

Suttie, J. (2015). Is morality based on emotions or reason? Greater good. https://greatergood.berkeley.edu/article/item/is_morality_based_on_emotions_or_reason.

Szekely, R. D., & Miu, A. C. (2014). Incidental emotions in moral dilemmas: The influence of emotion regulation. Cognition and Emotion, 29(1), 64-75.

Tamir, D. I., Bricker, A. B., Dodell-Feder, D., & Mitchell, J. P. (2015). Reading fiction and reading minds: The role of simulation in the default network. Social Cognitive and Affective Neuroscience, 11(2), 215-224.

Ugazio, G., Lamm, C., & Singer, T. (2012). The role of emotions for moral judgments depends on the type of emotion and moral scenario. Emotion, 12(3), 579-590.

Walker, L. J., & Frimer, J. A. (2007). Moral personality of brave and caring exemplars. Journal of Personality and Social Psychology, 93(5), 845-860

Walker, L. J., & Pitts, R. C. (1998). Naturalistic conceptions of moral maturity. Developmental Psychology, 34(3), 403-419.