Here is Eli's discussion of the survey results:
Thanks again to everyone who took the emotional responses survey. Below are the cases and response data for the first 100 responses. I’ve given a bit of analysis following each case, and there are some general remarks following that. First, I wanted to say just a bit about what I was up to here.
My concern with regard to this survey was to test two hypotheses. First, I wanted to see whether anyone would describe an emotional experience that had behavioral and physiological markers typically associated with anger as resentment, even in the absence of a judgment of having suffered a moral injury.
Second, I wanted to see whether anyone would regard resentment as subject to the phenomenon of stable recalcitrance. Recalcitrant emotions are episodes of emotion whereby one experiences an emotion that is in conflict with one’s settled judgments about its object. Stable recalcitrance involves the persistence of recalcitrant emotion over time, despite the stability of judgments that conflict with the emotional response.
The phenomenon of stable recalcitrance is prominent in an argument for judgmentalism about resentment given by Justin D’Arms and Dan Jacobson. They argue that stable recalcitrance is a phenomenon that is unique to the natural emotion kinds. Because resentment is not subject to stable recalcitrance, it is not a natural emotion kind, and should instead be treated as a cognitive sharpening. Since cognitive sharpenings are roughly what judgmentalism says they are, resentment should be understood according to a judgmentalist theory of the emotions, or so the argument goes.
D’Arms and Jacobson support the claim that resentment is not subject to stable recalcitrance by way of a case roughly analogous to Case #2 in the emotional responses survey. They claim that once the subject of this case ceases to believe that they have been treated unfairly, it ceases to make sense to explain their emotional response as resentment. My reaction to this claim has long been “Really? Why doesn’t that make sense?” Case #2 is an attempt to see if I am alone in that reaction.
Without further ado, let’s check out the data.
Case #1
Your favorite football team has just lost a close game to their arch-rivals. Following the conclusion of the game, you feel your face turn red and become hot, your pulse quickens, and you have an intense desire to punch something. For the next several days, whenever you think about your team's loss, you have a similar emotional experience. How would you describe the emotion you are experiencing?
Anger 71.7% 71
Jealousy 2.0% 2
Resentment 12.1% 12
Envy 1.0% 1
None of the Above 19.2% 19
Total Responses 99
Skipped Question 1
In constructing this survey, I was hoping to establish some sort of baseline for anger, in the form of a case that almost everyone would agree was an instance of anger. Clearly, that did not happen, though there was a substantial majority who described this as an instance of anger.
Case #2
You have just been denied tenure. Initially, you identify yourself as resentful of the tenure review board, and you judge that they have evaluated your case unfairly. Over time, you come to see that you have not been treated unfairly, and that you really are not deserving of tenure. Despite this judgment, however, whenever you think about this situation, you feel your face become hot, your adrenaline increases so that you feel a burst of energy, and you feel as though you'd like to punch the members of the tenure board. How would you describe the emotion that you are experiencing?
Anger 48.4% 46
Jealousy 1.1% 1
Resentment 29.5% 28
Envy 1.1% 1
None of the Above 28.4% 27
Total Responses 95
Skipped Question 5
This is D’Arms and Jacobson’s tenure denial case. Although a lot of people agreed with D’Arms and Jacobson’s analysis here, a non-negligible number of you felt the same way I do—that this is best described as an instance of resentment, even after one judges that they have not been treated unfairly by the tenure review board. At a minimum, I think that this case is not as definitive in favor of resentment as a cognitive sharpening as D’Arms and Jacobson take it to be. But I’d look forward to comments on whether that’s a reasonable conclusion to draw here.
Case #3
Suppose you come to find out that a close friend of yours has begun dating your ex-girlfriend, who you broke up with approximately one year ago. Your initial reaction is one that you take to be resentment. On reflection you judge that your friend has not injured you in any morally significant way. You regard your ex-girlfriend as an especially bad romantic partner, and have no desire to rekindle your relationship. Whenever you see the couple together, you experience a rush of adrenaline, your face turns red and begins to feel hot, your pulse quickens, and you feel as though you'd like to either punch something or take a long walk to cool off. Despite your best effort to bring your emotional response in line with your considered judgment, you simply cannot shake this feeling. How would you describe the emotion you are experiencing?
Anger 35.1% 33
Jealousy 36.2% 34
Resentment 17% 16
Envy 4.3% 4
None of the Above 20.2% 19
Total Responses 94
Skipped Question 6
I found the result of this case to be most interesting, but also most disappointing for my own purposes. I had hoped to argue that even if we accept the tenure denial case as an instance of anger, rather than stable recalcitrant resentment, this case clearly involved stable recalcitrant resentment. Those results did not play out, as a much lower percentage of people saw this as a case of resentment, in comparison to Case #2. So that was disappointing.
However, it was intriguing to me that so many people saw this as a case of jealousy, since there are elements of the case that are supposed to direct respondents away from that reply. It seems that many of you would describe yourselves as jealous even when you do not want your former partner back, and do not think well of them as a romantic partner. Even more interesting, as Dan Jacobson noted in his earlier comments, was that the behavioral and physiological manifestations here are those of anger. This indicates what could be a very deep problem for self-attributions of emotion as evidence of an emotion’s constitutive conditions. If neither the behavioral and physiological response, nor one’s judgments, tells in favor of calling the emotion jealousy, one wonders what basis there is for thinking that jealousy is what we are experiencing. The implication is that our self-attributions of emotion are not very reliable.
As for my initial hypotheses, neither was vindicated by these results, and the range of responses even to what seems like an obvious case of anger suggests that appealing to cases to sort out the constitutive conditions for an emotion type may simply be the wrong methodology. However, if our own emotional attributions are informative with regard to the constitutive conditions for an emotion type, these results give us reason to question the judgmentalist account of resentment that is presently so widely accepted. These results also suggest that stable recalcitrant resentment may be possible after all. If D’Arms and Jacobson are correct that this phenomenon is unique to the natural emotion kinds, our account of the emotions ought to capture resentment as a natural emotion kind, rather than a cognitive sharpening. The further question, of course, is how to do that, since resentment does not appear in any of the empirical psychological literature on basic emotions, which at least initially suggests that it does not have the same cross-cultural significance or adaptive function that is attributable to other basic emotions like disgust or fear.
Comments welcome and appreciated, whether with regard to the data, my analysis, or the construction of the survey in general. Thanks again for all the responses.




A worry I had with this survey: the pragmatics of several questions one after the other suggests all by itself that a variety of responses is appropriate. I think you would get lower "anger" responses for 2 and 3 just because they have followed1 then otherwise. Easy to check, of course.
Posted by: Neil Levy | 07/09/2012 at 08:14 PM
Neil-That's an interesting suggestion. My hope was that a series of cases, beginning with a simple case of anger, would force people to formulate some sort of heuristic or principle for differentiating between the cases. But perhaps the cases in isolation would lead to fewer "anger" responses.
Posted by: Eli Weber | 07/10/2012 at 08:12 AM
Eli, that's right. Presenting thm in sequence leads people to formulate heuristics for distinguishing between them. The worry is that the heuristics may be confabulated.
Posted by: Neil Levy | 07/10/2012 at 08:14 PM
I wonder if randomizing the cases would help here. Unfortunately, SurveyMonkey requires a paying account for randomized presentation, but perhaps other formats would make this possible. Either way, I'm now wondering which presentation scenario is likely to elicit what people actually think about these cases.
Posted by: Eli Weber | 07/11/2012 at 09:59 AM
My answer for #2 was "anger" compatible with stable recalcitrance. For #3, I chose "resentment", which seemed obvious given that she was an "especially bad romantic partner". I resent the fact that she wasted so much of my time, when I could've been dating other girls. Seeing her lure my close friend into a probably doomed relationship simply reminds me of how much of my energy she wasted. I'd be interested to hear the thought process of people who chose "jealousy".
Posted by: Joshua | 07/11/2012 at 06:47 PM
My own reactions were measured againt the final instruction: How would I describe the emotion I was experiencing? In my case I selected "None of the above" for all, and based on how I would describe the emotion I was experiencing where I took the emotion to be some instantiated x--not to assert the x was a particular such-and-such. Since in every case I had no rational foundation for any particular emotion I was feeling, I thought simply that that was the case--whatever I felt was irrational. (I agree with Joshua most closely with the 3rd case, based on personal experience, but I also have concluded any resentment even there is silly, because I have to acknowledge my own part in wasting my own life. I also think the examples should be de-genderized, to avoid unpredictable biases of readers irrespective of their sexual preferences.)
So, I took my task to evaluatively describe whatever emotion I was feeling, and simply took the particular descriptions to be "trick" answers. Thus, I was reading the examples as seeking a degree of reflectiveness about emotions, and not just a simple description of them. If you wish to avoid my kind of over-thinking, how about skipping the stipulation of the lack of reasons for feeling some way, and also simply saying: "What following emotion best describes your feelings under these conditions, if any?" or something like that.
Posted by: V. Alan White | 07/11/2012 at 10:00 PM
-Joshua,
I agree with your assessment of the third case, and I'd also like to hear from people who thought of it as jealousy, given aspects of the case intended to direct people away from that answer. That said, it's been noted over on PEA Soup that the case doesn't specify what the object of the emotion is. It's at least plausible to think that the subject in this case is jealous that his friend has someone and he does not, though this is better described as envy than jealousy.
-V.Alan,
Thanks for the suggestion. I wonder if non-philosophers would have a similar problem. Hard to say, but I suspect not, since I don't think the average Joe thinks much about whether their emotions are appropriate. However, I'm a little concerned that you are conflating the question of what emotion is occurring with whether that emotion is rational or justified. For example, even if it's just ridiculous to be angry in Case #1, isn't the anger being felt still anger? The task for each question was descriptive, so I guess I'm not totally clear on why the rationality or justifiability of the response bears on the descriptive task, even if one is trying to be reflective in one's description.
That said, I do appreciate your suggestions for improving the cases, and I'll certainly keep them in mind moving forward.
Posted by: Eli Weber | 07/13/2012 at 09:57 AM
Thanks for pointing me to PEA Soup. I agree that "envy" is plausible, if the subject is prone to competition with his friend. I hadn't thought of that.
The comment from Taylor saying, "all this does is serve as evidence that deep down you are jealous, perhaps" was quite interesting, though. Absent of any input from the people who selected "jealous" for case #3, I bet that Taylor's attitude is representative of many who chose that response. The basic logic would be like this:
1) When I have been jealous in the past, I typically became irrational and made errors in judgment where I should have known better.
2) Looking at scenario #3, it seems that I *shouldn't* rationally feel the way I do, but I'm feeling it anyway.
3) The fact that I know better than to feel this way, but am feeling it anyway, fits my previous experiences of jealousy. So I conclude that I'm feeling jealous.
In other words, maybe people's personal experiences of jealousy cause them to associate jealousy with opacity of motives and perplexity. Perhaps jealousy *should* be opaque and perplexed -- if jealousy should function as a costly signal which would be hard to fake, and perplexity matches the old saying that "jealousy is love and hate commingled". So, for people who are not adept at coming up with better explanations, any confused emotions about a former lover would be explained away as "jealousy".
Posted by: Joshua | 07/14/2012 at 02:51 AM
Joshua,
It seems reasonable to me to think that people rely on past emotional experiences to identify present ones, so I'm not at all opposed to that explanation of the jealousy response. I worry, however, about your description of the "basic logic" behind this assessment. It seems to me the basic logic you describe could be rewritten as:
1. When I am jealous, I often behave irrationally.
2. My response in scenario 3 is not rational.
3. Therefore, my response in scenario 3 must be jealousy.
This argument is clearly not valid, and I worry that this way of understanding the jealousy response commits those who answered that way to an implausible explanatory framework. The deep worry here, in my view, is that any emotional response could be irrational under certain conditions, so the irrationality of one's response couldn't be the basis for distinguishing one's response as a particular emotion type.
I'd be more inclined to think that it is a similarity of the eliciting circumstances, rather than a similarity in the irrationality of my response to the situation, which led people to identify this as a case of jealousy. When we see our former mates, and sometimes our close friends, involved in romantic relationships, we often respond with jealousy. Since this is a case of both, the response gets identified as jealousy.
Let me know if I missed something in your response.
Posted by: Eli Weber | 07/16/2012 at 10:32 AM