Skip to main content

Medical

Thousand Voices of Trauma

Thousand Voices of Trauma: 3,000 synthetic Prolonged-Exposure therapy conversations (500 clients x 6 phases, generated by Claude Sonnet 3.5) plus an emotional-trajectory benchmark in which 8 LLMs rate the emotional intensity (1-10) of each PE-therapy phase per client, scored against the Claude Sonnet 3.5 baseline trajectory.

3,000items
8subjects
99%observed
CC-BY-NC-4.0license
medicinedomain
textmodality

Response matrix

Fit to width. Hover for subject & item; click a cell for details.

Thousand Voices of Trauma response matrix: AI models (rows) against items (columns)
lowhighUnobserved

Scale: emotional intensity {1, ..., 10}

Sample items

Item 1275% solve rateanswer: 6

Prolonged-Exposure therapy conversation (client 418, phase P11: Processing the Exposure).

Therapist: How are you feeling after that imaginal exposure? Client: I... I'm not sure. It's all a bit overwhelming. The memory of that dog attack feels so vivid now. I can still hear the growling, feel the pain... (voice trembles) It's like I'm right back there in that moment. Therapist: That sounds intense. What stood out most? Client: The fear. It was paralyzing. I remember freezing, unable to move as the dog lunged at me. I felt so helpless, like a child again. It reminded me of... of when my ex-husband would... (pauses, takes a deep breath) When he'd get violent. Therapist: I see. How does that connection feel? Client: It's... unsettling. I never realized how similar those feelings were. The helplessness, the terror... It's like my body can't tell the difference between the dog attack and the abuse I endured for years. Therapist: That's an important insight. How does it relate to your symptoms? Client: Well, I guess it explains why I'm always on edge, always expecting the worst. Even now, living alone, I still feel unsafe. It's exhausting, really. I'm constantly scanning for threats, be it angry dogs or... or angry men. Therapist: Thank you for sharing. What else came up? Client: I noticed... shame. I felt ashamed that I couldn't protect myself, both from the dog and in my marriage. I've always prided myself on being strong, independent. But in those moments, I was anything but. Therapist: How do you view that shame now? Client: (sighs) I suppose... it's not really fair to blame myself. I did what I could to survive, both times. It's just... it's hard to shake that feeling of weakness, you know? Therapist: I understand. What helped you get through the exposure? Client: Oddly enough, reminding myself that I'm safe now. That it's just a memory. And... and thinking about how far I've come. I'm not that scared, helpless person anymore. I've built a life for myself, on my own terms. Therapist: That's a powerful realization. How might you use this? Client: I think... maybe I need to be kinder to myself. To recognize my strength in surviving, in moving forward. And perhaps... perhaps I can use that reminder of safety when I start feeling anxious or scared in daily life. Therapist: Excellent insight. How do you feel about continuing? Client: It's tough, I won't lie. But I see the value in it. Each time, it gets a little easier to face those memories. And I'm learning so much about myself in the process. I want to keep going, to see where this leads. Therapist: I'm glad to hear that. What's one thing you'll take away? Client: That I'm stronger than I give myself credit for. And that facing these memories, as painful as it is, is helping me understand myself better. It's... it's empowering, in a way I didn't expect. Therapist: That's a powerful takeaway. Anything else? Client: Just... thank you. For guiding me through this. It means a lot to have someone listen without judgment, to help me make sense of it all. I feel less alone in this journey now. Therapist: You're welcome. You're doing great work. Shall we wrap up? Client: Yes, I think so. I feel drained, but in a good way, if that makes sense. Like I've done something important today. I'm looking forward to our next session, even if it's challenging. Therapist: That's a healthy perspective. Take care, and we'll continue next time.

Subject outcomes

  • Llama 3.1 8B Instructscore 4
  • Amazon Nova Proscore 3
  • Llama 3.1 70B Instructscore 3
  • Llama 3 70B Instructscore 2
  • Llama 3 8B Instructscore 2
  • Mistral Smallscore 2
Item 2388% solve rateanswer: 6

Prolonged-Exposure therapy conversation (client 248, phase P11: Processing the Exposure).

Therapist: How are you feeling after that imaginal exposure? Client: I... I'm not sure. It's all a bit overwhelming. My heart's still racing a bit, and I feel kind of shaky. That memory of the animal attack during my deployment... it's just so vivid, you know? I can still hear the growling, feel the fear... Therapist: Understandable. What stood out most? Client: The helplessness, I think. I was trained for combat, but not for a wild animal. I felt so... unprepared. And the pain, oh God, the pain was excruciating. It's like I can still feel it sometimes, especially when my chronic pain flares up. It's like my body remembers, even when I try to forget. Therapist: How does reliving it affect you now? Client: It's... complicated. On one hand, it's terrifying to go back there. But on the other, it feels... I don't know, maybe a little empowering? Like, I survived that. I'm here. But then I feel guilty for feeling okay about it when others weren't as lucky. Therapist: Guilt is common. How else has this impacted you? Client: It's affected everything. My sleep, my relationships, my work. I'm always on edge, especially in crowded places. And living with roommates is... challenging. They don't understand why I sometimes react so strongly to sudden noises or movements. It's isolating. Therapist: That sounds difficult. Any positive changes? Client: Well... I guess I've become more aware of my surroundings. And I've started to appreciate the little moments of peace more. Oh, and I've been trying some breathing exercises you taught me. They help sometimes, especially with the pain. Therapist: That's great progress. How's your support system? Client: It's... okay. My family tries, but they're back home in the Middle East. They don't really get it. My coworkers are nice, but I keep them at arm's length. I'm afraid of getting too close, you know? But I've been thinking about joining that support group you mentioned. Therapist: That could be helpful. Any other insights? Client: I've realized that... maybe I'm stronger than I thought. Going through this memory again and again, it's tough, but I'm doing it. And each time, it gets a tiny bit easier. It's like... I'm reclaiming that part of my life, bit by bit. Therapist: That's a powerful realization. How will you use it? Client: I think... I want to start challenging myself more. Maybe try to go out more, or talk to my roommates about what I'm going through. And definitely keep up with these sessions. They're hard, but I can see how they're helping. Therapist: Sounds like a good plan. Anything else? Client: Just... thank you. For listening, for guiding me through this. It means a lot to have someone who understands and doesn't judge. I know I have a long way to go, but for the first time in a while, I feel like maybe, just maybe, I can get through this. Therapist: You're doing great. Ready to wrap up? Client: Yeah, I think so. I feel drained, but also... lighter? Is that weird? Like I've put down a heavy backpack I've been carrying. I know I'll have to pick it up again, but now I know I can set it down sometimes. That's... that's something, right? Therapist: Absolutely. It's significant progress. Client: Okay. Yeah. I can do this. One step at a time, right? Same time next week? Therapist: Yes, see you then. Take care.

Subject outcomes

  • Mistral Largescore 5
  • Amazon Nova Proscore 4
  • Llama 3.1 8B Instructscore 4
  • Mistral 7B Instructscore 4
  • Llama 3 8B Instructscore 3
  • Mistral Smallscore 3
Item 3438% solve rateanswer: 4

Prolonged-Exposure therapy conversation (client 460, phase P11: Processing the Exposure).

Therapist: How are you feeling after that imaginal exposure, Ahmed? Client: I... I'm not sure. It's a lot to process. Reliving that moment when I found out about my father's death... it's still so raw, even after all these years. I can feel my heart racing, and my palms are sweaty. It's like I'm right back there in that moment, you know? Therapist: That sounds intense. What stood out to you most? Client: The overwhelming sense of disbelief, I think. I remember standing there, phone in hand, and just... not being able to comprehend what I was hearing. It's like my brain just couldn't process the information. And then this wave of guilt hit me because I hadn't spoken to him in weeks. I was so caught up in my own life, my work, and... and now he was gone. Forever. Therapist: How did it feel to revisit that memory today? Client: It was... difficult. Really difficult. But also, in a strange way, kind of cathartic? I've spent so long trying to avoid thinking about that day, but facing it head-on like this... it's like I'm finally allowing myself to feel everything I've been suppressing. The grief, the anger, the regret - it's all there, but it doesn't feel as overwhelming as I thought it would. Therapist: You're showing incredible strength. How does this connect to your recovery goals? Client: I guess... it's helping me realize that I can face these painful memories without falling apart. For so long, I've been afraid to even think about my dad or that day, worried that it would trigger a panic attack or send me into a spiral of anxiety. But going through this exposure, as hard as it is, is showing me that I'm more resilient than I thought. Maybe... maybe I can start to process my grief in a healthier way now, instead of just trying to push it down all the time. Therapist: That's a powerful insight. What strategies helped you during the exposure? Client: The breathing exercises we practiced were really helpful. When I felt myself starting to get overwhelmed, I focused on my breath, just like we've been working on. And reminding myself that I was safe, that this was just a memory and not happening in real-time... that grounded me. It's still hard, but I feel like I have more tools to cope now. Therapist: You're making great progress. How do you feel about continuing? Client: It's... it's scary, to be honest. Part of me wants to run away from all of this. But I also know that I can't keep living with this weight on my shoulders. My anxiety, the nightmares, the constant fear - it's affecting my marriage, my work, everything. So yeah, I want to keep going. It's not easy, but I think it's necessary. I want to be able to remember my dad without feeling like I'm drowning in guilt and grief. I want to be present for my wife and actually enjoy our life together without this constant shadow hanging over me. Therapist: Your commitment is admirable. What's one thing you'd like to focus on next time? Client: I think... I'd like to try to focus on some of the good memories of my dad. We've been so caught up in the trauma of his death, but there were so many good times too. Maybe revisiting those could help balance out some of the pain? I don't know if that's how this works, but... I'd like to try. Therapist: That's a great idea. We'll explore that next session. How are you feeling now? Client: Drained, but... okay. Better than I expected, actually. It's like a weight has been lifted, even if it's just a little bit. I know we have a long way to go, but for the first time in a while, I feel like maybe, just maybe, I can get through this. Thank you for guiding me through this. It means more than I can express. Therapist: You're doing the hard work. Is there anything else you'd like to discuss today? Client: No, I think I need some time to process all of this. It's a lot to take in. But I'm glad we did this. It's tough, but I think it's what I need. I'm looking forward to our next session, even though I know it won't be easy. But I'm starting to believe that it'll be worth it in the end. Therapist: You're showing real courage. Take care, and I'll see you next week.

Subject outcomes

  • Llama 3.1 8B Instructscore 5
  • Mistral Smallscore 5
  • Mistral Largescore 5
  • Llama 3.1 70B Instructscore 4
  • Mistral 7B Instructscore 4
  • Llama 3 8B Instructscore 4
Item 4513% solve rateanswer: 5

Prolonged-Exposure therapy conversation (client 224, phase P5: Orientation to Imaginal Exposure).

Therapist: Welcome back, James. How are you feeling today? Client: I'm... okay, I guess. A bit nervous about what we're going to do today. I've been having more flashbacks about the cyclone lately, especially at work. It's been making it hard to concentrate. Therapist: I understand. Today, we'll start imaginal exposure. Are you familiar with this? Client: Not really. Is it... like reliving the trauma? That sounds pretty intense. Therapist: It involves recounting the experience, yes. How do you feel about that? Client: Honestly? Terrified. I've been trying so hard to avoid thinking about it. Won't this make things worse? Therapist: It's a common concern. Can I explain why we do this? Client: Yeah, please. I need to understand why we're doing something that seems so... counterintuitive. Therapist: It helps process the memory and reduce its power over time. What are your thoughts? Client: I guess that makes sense. But how can reliving it possibly make it less powerful? It feels like it would just reinforce how scary it was. Therapist: By facing it in a safe environment, we can change how your brain processes it. Client: Okay... I think I get it. But what if I panic? Or can't handle it? Therapist: We'll go at your pace. I'll be here to support you throughout. How does that sound? Client: A little better, I suppose. But I'm still really nervous. What exactly will we be doing? Can you walk me through it? Therapist: We'll start slowly. You'll recount the event, and I'll guide you. Ready to try? Client: I... I think so. But can we stop if it gets too much? I'm worried about losing control. Therapist: Absolutely. You're in control. We can pause anytime. Your bravery is admirable. Client: Thanks. That helps a bit. I guess I'm as ready as I'll ever be. How do we start? Therapist: Close your eyes, take a deep breath, and start describing the day of the cyclone. Client: Okay... takes a deep breath It was a Tuesday morning. I remember because I had an important meeting at work. The sky was... so dark. Unnaturally dark. The wind was already picking up...

Subject outcomes

  • Mistral Smallscore 7
  • Llama 3.1 70B Instructscore 6
  • Llama 3.1 8B Instructscore 5
  • Mistral 7B Instructscore 5
  • Llama 3 8B Instructscore 4
  • Mistral Largescore 4
Item 5563% solve rateanswer: 5

Prolonged-Exposure therapy conversation (client 330, phase P5: Orientation to Imaginal Exposure).

Therapist: Welcome back, Sarah. How are you feeling today? Client: Hi Dr. Thompson. I'm... okay, I guess. A bit nervous about what we're going to do today. I've been thinking about it all week, and I'm not sure I'm ready for this. Therapist: That's understandable. Can you tell me more about your concerns? Client: Well, it's just... the idea of reliving that moment when I found out about my sister's accident. It feels like opening a wound that's barely started to heal. I'm worried I'll fall apart or won't be able to handle it. And honestly, I'm not sure how this is supposed to help me. Won't it just make everything worse? Therapist: I appreciate your honesty. Let's discuss the purpose of this exercise. Client: Okay, I'm listening. But I have to admit, my heart is racing just thinking about it. It's like I can already feel the panic setting in. Therapist: That's a normal reaction. This exercise aims to help you process the trauma safely. Client: Process it? But I've been trying to forget it. How is remembering it in detail going to help? I'm worried it'll just bring back all those feelings of helplessness and grief that I've been trying so hard to push down. Therapist: By facing the memory, we can reduce its power over you. How does that sound? Client: I... I guess that makes sense. But it's scary. Really scary. I've spent so long trying to avoid thinking about it. The idea of purposely bringing it all up... it's overwhelming. What if I can't stop crying? What if I have a panic attack? Therapist: Those reactions are normal. We'll go at your pace, and I'll be here to support you. Client: Okay... I appreciate that. It helps to know you'll be here. Can you tell me more about what exactly we'll be doing? Like, step by step? I think having a clear picture might help me feel a bit more in control. Therapist: Certainly. We'll start with relaxation techniques, then you'll describe the memory in detail. Client: Describe it in detail? Oh god... I'm not sure I can do that. It's all such a blur in my mind. I remember the phone call, and then it's like everything went dark. How am I supposed to describe something I've tried so hard to forget? Therapist: Take a deep breath. We'll work through it together, focusing on manageable parts. Client: Okay... okay. I'm trying to stay calm. It's just... this is bringing up so much. I keep thinking about my sister, about how I'll never see her again. It's like I'm right back in that moment when I first heard the news. How do I stop myself from getting completely overwhelmed by these feelings? Therapist: It's okay to feel overwhelmed. We'll use grounding techniques to help you stay present. Client: Grounding techniques? Like what? I'm sorry for all the questions, I just... I need to feel prepared. This feels like such a big step, and I want to make sure I can handle it. Therapist: We'll use deep breathing, sensory focus, and positive affirmations. These help manage intense emotions. Client: That sounds helpful. I've used deep breathing before when I've had anxiety attacks, and it does help. I'm still nervous, but knowing we have these tools makes me feel a bit more confident. How long will this session last? And what happens if it gets too intense for me? Therapist: The session will last about 90 minutes. We can pause or stop anytime you need. Client: Ninety minutes... that's a long time to be in that headspace. But I guess that's the point, right? To really work through it? I'm trying to remind myself that this is for my own good, that it's part of healing. It's just... it's hard to voluntarily walk into something you know is going to be painful. Therapist: Your courage is admirable. This process can significantly reduce your PTSD symptoms over time. Client: Thank you for saying that. It helps to hear that this could actually make a difference. I've been struggling for so long, and the idea that there might be a way to lessen these symptoms... it gives me hope. Even if it's scary, I think I'm ready to try. Can we start with some of those relaxation techniques now? I think I need to calm down a bit before we begin. Therapist: Of course. Let's start with a brief breathing exercise to center yourself.

Subject outcomes

  • Mistral Smallscore 7
  • Mistral 7B Instructscore 7
  • Llama 3.1 70B Instructscore 6
  • Amazon Nova Proscore 5
  • Llama 3 8B Instructscore 5
  • Mistral Largescore 4
Item 6600% solve rateanswer: 6

Prolonged-Exposure therapy conversation (client 9, phase P5: Orientation to Imaginal Exposure).

Therapist: Good morning, Mr. Johnson. How are you feeling today? Client: Morning, Dr. Thompson. I'm... well, I'm a bit nervous, to be honest. My anxiety's been acting up since I woke up. I know we've talked about doing this imaginal exposure thing, but I'm not sure I'm ready. The idea of revisiting that... that time in my life, it's terrifying. Therapist: I understand. It's natural to feel anxious. Can you tell me more about your concerns? Client: It's just... I've spent so long trying to forget what happened. The thought of deliberately bringing it all back... I'm afraid I might fall apart. What if I can't handle it? What if it makes everything worse? I've already been struggling with my health, and this feels like it might be too much. Therapist: Your concerns are valid. How about we discuss the process first? Client: Yes, please. I need to know what I'm getting into. Will it be like reliving everything all over again? Because I'm not sure I can do that. It's been haunting me for decades, and the memories... they're still so vivid sometimes. Therapist: It's not about reliving, but processing. We'll go at your pace. Ready to hear more? Client: I suppose so. But please, explain it to me slowly. My mind's racing a bit, and I want to make sure I understand everything clearly. Therapist: Of course. We'll start gradually, focusing on one memory at a time. You're in control throughout. Client: That... that does make me feel a bit better. But what exactly will we be doing? And how long will it take? I'm worried about getting overwhelmed and not being able to stop once we start. Therapist: We'll recount the memory verbally. You can pause anytime. Sessions last about 30-45 minutes. Client: Okay, that doesn't sound as bad as I was imagining. But what if I start to panic? Or if the memories become too intense? I've had some pretty severe anxiety attacks before, and I'm worried about triggering one during this process. Therapist: I'll be here to guide you. We have grounding techniques ready if needed. Your safety is priority. Client: That's reassuring. I trust you, Dr. Thompson. You've been so patient with me these past months. I just... I want to get better, you know? For my wife, for myself. But it's so hard to face this. Do you really think this will help with my PTSD symptoms? Therapist: Yes, it's a proven method. Your courage in facing this is admirable. Shall we begin? Client: (Takes a deep breath) Alright. I think I'm ready. Or as ready as I'll ever be. Just... please be patient with me if I struggle. This isn't easy, but I want to try. For the first time in years, I feel like there might be a chance to move past this. So, yes, let's begin. Therapist: Your bravery is commendable. We'll start gently. Remember, you're safe here.

Subject outcomes

  • Mistral Smallscore 8
  • Mistral 7B Instructscore 7
  • Amazon Nova Proscore 6
  • Llama 3 70B Instructscore 6
  • Llama 3.1 8B Instructscore 5
  • Llama 3 8B Instructscore 4
Item 7638% solve rateanswer: 4

Prolonged-Exposure therapy conversation (client 62, phase P7: Reinforcing During Exposure).

Therapist: Welcome back, Mr. Patel. Are you ready to continue our imaginal exposure session? Client: I suppose so, though I'm feeling a bit anxious about revisiting those memories again. Therapist: That's understandable. Remember, you're safe here. Client: Yes, I know. It's just... every time I think about that night, my heart starts racing. I can still hear the shouting, the sound of glass breaking. My son was only 10 at the time, and I remember how terrified he looked, hiding behind me as we watched my daughter-in-law being struck by my eldest son. Therapist: You're doing well. Keep going. Client: The worst part was feeling so helpless. I wanted to intervene, to protect her, but I was frozen. The look in my son's eyes... it was like he was possessed. I'd never seen such rage before. And my poor granddaughter was wailing in the next room, but no one was attending to her. Therapist: Stay with that moment. What else do you notice? Client: I... I can smell the curry we had for dinner. It's still on the stove, forgotten in the chaos. The scent is mixing with the metallic smell of blood from my daughter-in-law's split lip. I feel sick to my stomach, but I can't move. Therapist: You're doing great. Keep describing what you're experiencing. Client: My hands are shaking. I want to reach for the phone, to call for help, but I'm afraid it will make things worse. I can hear my wife sobbing quietly beside me. She's clutching my arm so tightly it hurts, but I barely notice the pain. All I can focus on is the scene unfolding before me. Therapist: It's okay to feel these emotions. You're safe here. Client: I... I don't know if I can continue. The guilt is overwhelming. I should have done something, anything. But I just stood there, watching as my family fell apart. Therapist: Take a deep breath. You're handling this well. Client: (Takes a deep breath) Okay... I remember my daughter-in-law finally breaking free and running towards us. She was crying, begging us to help her. And I... I just stood there, paralyzed. My son was shouting at her to come back, threatening her. The look of betrayal in her eyes when she realized we weren't going to do anything... it haunts me to this day. Therapist: You're being very brave. How are you feeling right now? Client: I feel ashamed, angry at myself. My chest feels tight, and I'm having trouble breathing. It's like I'm right back there, in that moment, failing my family all over again. Therapist: Remember, you're here now. You're safe. Client: Yes, you're right. I'm here now. (Takes another deep breath) I remember the sound of sirens in the distance. Someone must have called the police. My son suddenly seemed to snap out of his rage. He looked confused, almost scared. And then he ran out of the house. We didn't see him for days after that. Therapist: You're doing an excellent job. Keep going. Client: The aftermath was almost worse than the incident itself. The shame, the whispers from neighbors, the pitying looks. Our family was never the same after that night. My daughter-in-law left with the children, and I don't blame her. But I miss them terribly. I keep thinking about all the things I could have done differently, how I could have prevented this from happening. Therapist: It's natural to have those thoughts. How do you feel now? Client: I feel... drained. Sad. But also, oddly, a bit lighter. Like sharing this burden has lifted some of the weight off my shoulders. I've carried this guilt for so long, never really talking about it with anyone. Therapist: You've shown incredible strength today. Client: Thank you. I never thought I'd be able to talk about this without completely falling apart. It still hurts, but maybe... maybe it's a step towards healing. I just wish I could go back and change things, you know? Therapist: That's a common feeling. We'll work through this together. Client: I appreciate that. It's been so long since that night, but sometimes it feels like it just happened yesterday. I wonder if I'll ever truly be able to forgive myself for not doing more. Therapist: Self-forgiveness is a process. You're making progress. Client: I hope so. I want to be able to think about my grandchildren without this cloud of guilt hanging over me. I want to be the grandfather they deserve, even if it's from a distance now. Do you think that's possible? Therapist: Absolutely. Your commitment to healing shows great potential. Client: Thank you. I'm grateful for your guidance through this. It's not easy, but I'm starting to see that maybe, just maybe, I can learn to live with what happened without letting it consume me. I want to be able to remember the good times with my family too, not just this one terrible night. Therapist: That's an excellent goal. Shall we wrap up for today? Client: Yes, I think that would be good. I feel emotionally drained, but also... hopeful? Is that strange? Therapist: Not at all. It's a positive sign. Take care, Mr. Patel.

Subject outcomes

  • Mistral Smallscore 8
  • Llama 3 70B Instructscore 7
  • Llama 3.1 8B Instructscore 7
  • Llama 3 8B Instructscore 6
  • Mistral 7B Instructscore 6
  • Mistral Largescore 5
Item 8675% solve rateanswer: 3

Prolonged-Exposure therapy conversation (client 216, phase P7: Reinforcing During Exposure).

Therapist: Welcome, Mr. Lee. How are you feeling today as we begin our session? Client: I'm feeling a bit nervous, to be honest. I know we're going to be talking about my childhood trauma and the loss of my grandmother, and it's making me anxious. Therapist: That's understandable. Remember, you're safe here. Client: Thank you. It's just... every time I think about it, my heart starts racing. My grandmother was everything to me. She raised me after my parents passed away when I was young. Losing her felt like losing my whole world all over again. Therapist: You're doing well. Take your time. Client: It happened when I was 15. I remember coming home from school and finding her collapsed on the kitchen floor. I... I didn't know what to do. I called for help, but by the time the ambulance arrived, it was too late. I keep replaying that moment in my head, wondering if I could have done something differently. Therapist: Stay with that memory. What do you see? Client: I see her lying there, so still. The kitchen tiles were cold under my knees as I knelt beside her. I can smell the soup she was making - it was still on the stove. I remember shaking her, calling out "Ah Ma, Ah Ma, please wake up." But she didn't respond. Her skin felt cool to the touch. I was so scared. Therapist: You're doing great. Keep going. Client: I... I remember feeling so helpless. I didn't know CPR or anything that could help. I just sat there, holding her hand and crying until the paramedics arrived. They tried to revive her, but... (voice breaks) I knew she was gone. I felt so alone in that moment. It was like my whole world had shattered. Therapist: It's okay to feel those emotions. You're safe here. Client: After that, everything's a blur. Social services came, and I was placed in foster care. But nothing felt right anymore. I withdrew from everyone and everything. I couldn't shake the feeling that I had failed her somehow. That if I had been there earlier, or if I had known what to do, maybe she would still be alive. Therapist: You're handling this well. Continue. Client: The guilt... it's been with me ever since. I threw myself into my studies and work, trying to make her proud, trying to prove that her sacrifice in raising me wasn't wasted. But deep down, I've always felt this emptiness, this fear of getting close to anyone again. What if I lose them too? What if I fail them like I failed her? Therapist: You're being very brave. How are you feeling right now? Client: I feel... overwhelmed. My chest feels tight, and I can feel tears coming. But also... there's a strange sense of relief in talking about it. I've kept this bottled up for so long. I miss her so much, and I wish I could tell her how sorry I am, how much I loved her, how grateful I am for everything she did for me. Therapist: It's okay to feel those emotions. You're doing well. Client: Thank you. I... I've never really allowed myself to grieve properly. I always felt like I had to be strong, to keep moving forward. But now, talking about it, I realize how much pain I've been carrying. It's like a weight I've been bearing all these years, and only now am I starting to let it go. Therapist: You're making progress. How does it feel to share this? Client: It's... it's both terrifying and liberating. I feel vulnerable, but also like I'm finally facing something I've been running from for decades. I'm realizing that maybe... maybe it wasn't my fault. I was just a kid, and I did everything I could. Perhaps it's time I forgive myself. Therapist: That's a powerful realization. You're doing great. Client: I think... I think my grandmother would want that for me. She always encouraged me to be kind to myself. I've spent so long trying to make her proud, but maybe the best way to honor her memory is to heal, to allow myself to be happy. It's what she would have wanted. Therapist: That's a beautiful thought. How do you feel now? Client: I feel... lighter. There's still sadness, but it's not as overwhelming. For the first time in years, I feel like maybe I can move forward without this crushing guilt. I want to remember her with love and gratitude, not just pain and regret. Therapist: You've shown incredible strength today. Well done. Client: Thank you. I never thought I'd be able to talk about this without falling apart. But I feel... I feel like I've taken a step towards healing. It's scary, but also... hopeful. I think I'm ready to start working on letting go of this guilt and fear. Therapist: That's excellent progress. We'll end here for today.

Subject outcomes

  • Llama 3.1 8B Instructscore 8
  • Mistral Smallscore 8
  • Llama 3 70B Instructscore 7
  • Llama 3 8B Instructscore 6
  • Mistral 7B Instructscore 6
  • Mistral Largescore 6
Item 9725% solve rateanswer: 5

Prolonged-Exposure therapy conversation (client 195, phase P7: Reinforcing During Exposure).

Therapist: Let's begin our imaginal exposure. Can you describe the hostage situation you experienced? Client: Okay... I was at the hospital for a routine checkup when suddenly there was commotion. A man burst into the waiting room waving a gun. He was shouting about how the hospital had killed his wife. Everyone was terrified. He made us all huddle in the corner while he ranted and threatened the staff. I remember feeling my heart racing, thinking this might be how I die. Therapist: You're doing well. Continue describing what happened. Client: The man was becoming increasingly agitated. He kept pacing back and forth, occasionally pointing the gun at us. I could hear people crying softly. The air felt thick with fear. I remember thinking about my late partner, wondering if I'd see them soon. Then, a nurse tried to reason with him. He grabbed her and held the gun to her head. I felt frozen, helpless. Therapist: Stay with that moment. What were you feeling? Client: I... I felt utterly powerless. My chest was so tight I could barely breathe. I wanted to help her, but I was paralyzed with fear. The nurse was trembling, and I could see tears streaming down her face. I felt guilty for not doing anything, but I was so scared. Therapist: It's okay to feel those emotions. You're safe now. Client: The standoff seemed to last forever. Police sirens were wailing outside, adding to the chaos. The man was becoming more erratic, shouting about how no one understood his pain. I remember thinking about my grandchildren, wondering if I'd ever see them again. The fear was overwhelming. Therapist: You're doing great. Keep going. Client: Suddenly, there was a loud bang. At first, I thought he had shot someone, but it was a flash grenade. Everything happened so fast after that. Police stormed in, there was shouting, and the man was tackled to the ground. I remember feeling disoriented, my ears ringing from the noise. People were rushing past me, but I couldn't move. I just sat there, shaking uncontrollably. Therapist: How did you feel once it was over? Client: I... I felt relieved, but also numb. A paramedic came to check on me, but I couldn't speak. I just kept staring at where the man had been standing. It didn't feel real. Even after I got home, I couldn't shake the feeling of vulnerability. I kept replaying the scene in my mind, wondering what I could have done differently. The guilt and fear... they stayed with me for a long time. Therapist: It's understandable to feel that way. You survived a traumatic event. Client: Yes, I suppose I did. But it changed me. I became hyper-vigilant, always scanning for danger. I couldn't go to hospitals without having panic attacks. I felt ashamed of my reaction, like I should have been braver. It's been hard to reconcile the person I thought I was with how I acted that day. Therapist: Your reactions were normal. You're showing courage by facing this memory. Client: Thank you. It helps to hear that. I've never told anyone the full story before. It's hard to relive it, but I also feel a strange sense of relief. Like I'm finally acknowledging what happened instead of trying to push it away. I just wish I could let go of the guilt and fear. Therapist: That's a common feeling. We'll work on that together. Client: I appreciate that. It's still difficult to think about, especially the moments when I thought I might die. The fear was so intense, unlike anything I'd ever experienced. I remember looking at the other hostages, seeing the same terror in their eyes. It made me realize how fragile life is, how quickly everything can change. Therapist: You're doing an excellent job processing these difficult memories. Client: Thank you. It's hard, but I think it's helping. I've carried this burden for so long, always worried that something like that could happen again. I want to be able to go to a hospital without reliving that day. I want to feel safe again. But it's been a long journey, and sometimes I wonder if I'll ever fully recover. Therapist: Recovery is possible. You're taking important steps right now. Client: I hope so. I'm trying to be patient with myself, but it's challenging. Sometimes I have nightmares about that day, or I'll hear a loud noise and suddenly I'm back in that waiting room. But being able to talk about it like this, it feels like I'm reclaiming some control. Like I'm not letting that experience define me anymore. Therapist: That's a powerful realization. How do you feel now? Client: I feel... drained, but also a bit lighter. It's still painful to remember, but it doesn't feel as overwhelming as it used to. I think I'm starting to understand that my reactions were normal, that I'm not weak for being affected by it. It's a strange mix of exhaustion and hope. Therapist: That's a common response after processing trauma. Well done today. Client: Thank you. I'm grateful for your guidance through this. It's not easy, but I think I'm starting to see a way forward. I know there's still a lot of work to do, but for the first time in a while, I feel like I might be able to move past this eventually. It's a small step, but it feels significant. Therapist: It is significant. You've shown great courage today. Client: I appreciate that. I'm trying to be kinder to myself, to acknowledge the progress I'm making. It's a slow process, but sessions like this help me see that change is possible. I'm looking forward to continuing this work, even though I know it won't always be easy. Thank you for creating a safe space for me to confront these memories. Therapist: You're welcome. We'll continue working together at your pace.

Subject outcomes

  • Llama 3.1 8B Instructscore 8
  • Llama 3 8B Instructscore 8
  • Mistral Smallscore 8
  • Llama 3 70B Instructscore 7
  • Mistral Largescore 7
  • Amazon Nova Proscore 6
Item 10775% solve rateanswer: 8

Prolonged-Exposure therapy conversation (client 297, phase P6: Monitoring SUDS Ratings).

Therapist: Welcome back, Fatima. Today we'll continue with our imaginal exposure exercise. Are you ready to begin? Client: Yes, I think so. I'm a bit nervous, but I know it's important. Therapist: That's understandable. Remember, you're in control. Let's start with your baseline SUDS rating. Client: I'd say about a 4 out of 10. I'm feeling a little tense just thinking about it. Therapist: Okay. Close your eyes and bring yourself back to that day in the military hospital... Client: (Taking a deep breath) I'm there. The smell of antiseptic is so strong. I can hear the beeping of machines and people rushing around. My heart is starting to race a bit. Therapist: Good. Stay with that memory. What do you see? Client: I see rows of beds with injured soldiers. Some are groaning in pain. There's blood on the floor. I'm trying to help, but there are so many of them. My hands are shaking as I try to apply pressure to a wound. Therapist: How's your distress level now? Client: It's gone up to a 6. My palms are getting sweaty, and I feel a knot in my stomach. Therapist: That's okay. You're doing well. Keep going. Client: A young soldier is brought in on a stretcher. He's barely conscious, and there's so much blood. I freeze for a moment, not knowing what to do. The doctor is yelling orders, but it sounds muffled, like I'm underwater. Therapist: Stay with that moment. What are you feeling? Client: I feel... helpless. Overwhelmed. My chest is tight, and I'm having trouble catching my breath. The room seems to be spinning a little. Therapist: Take a deep breath. You're safe here. What's your SUDS rating now? Client: It's an 8. I can feel my heart pounding in my ears. Therapist: You're doing great. Keep breathing. What happens next? Client: I snap out of it and start helping. We're working frantically to save him, but... (voice breaking) we lose him. I can still see his face, so young. I feel like I failed him. Therapist: It's not your fault. How are you feeling right now? Client: I'm at a 9. My whole body is tense, and I feel like I might cry. Therapist: That's okay. Let it out if you need to. You're safe here. Client: (Sobbing) I just... I wish I could have done more. I keep seeing their faces, all the ones we couldn't save. Therapist: It's natural to feel that way. Take a moment. How's your breathing? Client: It's a bit calmer now. The tightness in my chest is easing a little. Therapist: Good. What's your SUDS rating? Client: It's come down to a 7. I still feel shaky, but not as overwhelmed. Therapist: You're doing really well. Can you describe what you see now? Client: The chaos has died down. I'm sitting on a chair, staring at my hands. They're clean now, but I can still feel the stickiness of the blood. A nurse puts a hand on my shoulder, asks if I'm okay. Therapist: How does that feel? Client: It's... comforting. Like I'm not alone in this. My breathing is steadier now. Therapist: That's good. What's your SUDS rating? Client: It's down to a 5. I feel drained, but more in control. Therapist: You've done excellent work today. Let's start bringing you back to the present. Client: (Opening eyes, taking a deep breath) That was intense, but... I feel like I processed some of it. Therapist: You showed great courage. How do you feel now? Client: Tired, but... lighter somehow. Like I've let go of something I've been carrying. Therapist: That's often how it feels. You've made significant progress today.

Subject outcomes

  • Llama 3.1 70B Instructscore 8
  • Llama 3.1 8B Instructscore 8
  • Llama 3 70B Instructscore 8
  • Mistral 7B Instructscore 8
  • Amazon Nova Proscore 7
  • Mistral Largescore 7
Item 11788% solve rateanswer: 9

Prolonged-Exposure therapy conversation (client 82, phase P10: Full Imaginal Exposure).

Therapist: Welcome, Mrs. Johnson. How are you feeling about our imaginal exposure session today? Client: Oh, well... I'm a bit on edge, to be honest. I've been thinking about it all week, and part of me wants to just cancel and go home. But I know that won't help in the long run. Therapist: I understand. Your courage is admirable. Shall we begin? Client: I suppose so. Where do you want me to start? Therapist: Close your eyes and take us to the beginning of the hostage situation. Describe what you see and feel. Client: Okay... I'm at the bank. It's a Tuesday afternoon, and I'm just waiting in line to deposit a check. The air conditioning is humming, and there's soft music playing. I can smell coffee from the little café area they have... Then suddenly, there's shouting. A man bursts through the door waving a gun. My heart starts racing, and I feel frozen in place. He's yelling at everyone to get down on the ground. I... I can't move. My legs feel like lead. Therapist: You're doing well. What's your SUDS level right now? Client: Um, about a 6, I'd say. Therapist: Okay. Take a deep breath and continue. What happens next? Client: The man with the gun, he's pacing back and forth. I can hear his heavy breathing. Someone starts to cry, and he screams at them to shut up. I'm on the ground now, my cheek pressed against the cold tile. I can taste something metallic in my mouth – I think I've bitten my lip. The gunman is talking to someone behind the counter, demanding money. His voice is shaking. I think... I think he's scared too. Therapist: Good. Stay with that moment. What are you feeling? Client: I'm terrified. My whole body is trembling. I keep thinking about my daughter, wondering if I'll ever see her again. I want to run, but I'm paralyzed with fear. The air feels thick, like I can't get enough oxygen. Therapist: Remember to breathe. You're safe here. What's happening now? Client: There's a commotion near the entrance. I hear glass breaking. My heart is pounding so hard I think it might burst out of my chest. I risk a glance up and see police officers entering. The gunman is shouting, waving his weapon around wildly. I squeeze my eyes shut, praying it will all be over soon. Therapist: What's your SUDS level now? Client: It's... it's an 8. This is really hard. Therapist: You're doing great. Let's take a moment to ground ourselves. Feel your feet on the floor. Can you describe something you see in this room? Client: I... I see the plant in the corner. It has green leaves with white edges. Therapist: Good. Now, when you're ready, let's continue. What happens next? Client: Okay... There's a loud bang. At first, I think it's a gunshot, but then I realize it's a flash-bang grenade. My ears are ringing, and there's chaos all around. People are screaming and running. I'm still on the floor, too scared to move. I can smell gunpowder and sweat. Someone grabs my arm – it's a police officer. He's yelling at me to get up and run, but my legs won't work. He practically drags me out of the building. Therapist: How does your body feel in this moment? Client: I'm shaking uncontrollably. My throat is so dry it hurts to swallow. I feel dizzy and nauseous. As we get outside, the bright sunlight hurts my eyes. I can hear sirens and people shouting. It's all a blur. Therapist: You're doing well. Stay with those sensations. What happens after you're outside? Client: I'm sitting on the curb. Someone puts a blanket around my shoulders, but I can't stop shivering. A paramedic is talking to me, but I can't focus on what he's saying. I keep replaying the scene in my head – the gun, the shouting, the fear. I feel... I feel ashamed that I was so helpless. Therapist: It's normal to feel that way. Remember, you survived a terrifying situation. What's your SUDS level now? Client: It's still pretty high... maybe a 7. Therapist: Okay. Take a deep breath. Can you tell me about any positive thoughts or feelings you have looking back on this experience? Client: I... I guess I'm grateful that no one was seriously hurt. And I remember feeling a sense of connection with the other hostages. We went through something horrible together, and there was a kind of unspoken bond. Therapist: That's a good observation. Let's stay with that feeling for a moment. How does it change your perspective on the event? Client: It makes me feel less alone, I suppose. Like we were all in it together. But it's still hard to shake the fear and helplessness. Therapist: That's understandable. Can you describe what happened in the days following the incident? Client: The first few nights were awful. I couldn't sleep. Every little noise made me jump. I kept reliving it over and over. I was afraid to leave my house, especially to go to any banks or stores. I felt so vulnerable, like it could happen again at any moment. Therapist: How are you feeling right now as you recall those days? Client: It's... it's bringing back a lot of those feelings. My hands are clammy, and my heart is racing again. But it's not as intense as before. I know I'm safe here. Therapist: Good. What's your SUDS level? Client: It's down to about a 5 now. Therapist: That's progress. Let's focus on how you've coped since then. Can you tell me about any strategies or support that have helped you? Client: Well, these therapy sessions have been helpful. And I've been doing some meditation, which sometimes calms me down. My daughter has been incredibly supportive – she even went with me the first time I went back to a bank. It was terrifying, but I did it. Therapist: That's excellent. How did you feel after that first trip back to the bank? Client: I was shaky and exhausted, but also... proud, I guess. Like I had faced my fears. It didn't fix everything, but it felt like a step forward. Therapist: That's a significant accomplishment. As we start to wrap up this session, can you tell me about any changes you've noticed in how you think about the incident now compared to right after it happened? Client: I think... I think I'm starting to see it as something that happened to me, not something that defines me. It's still scary to think about, but I don't feel as powerless. I know I can face difficult things and survive them. Therapist: That's a powerful realization. How are you feeling now? Client: I'm tired, but also a bit relieved. It's like I've let go of something I've been carrying around. Therapist: What's your final SUDS level? Client: I'd say it's down to a 3 now. Therapist: That's great progress. You've done excellent work today. Let's take a few deep breaths together before we end the session. Client: Okay. Thank you... this was hard, but I think it was good for me. Therapist: You should be proud of yourself. We'll continue to work through this in our future sessions. For now, remember to use your coping strategies if you feel overwhelmed later. Client: I will. Thank you again. Therapist: You're welcome. Take care, and I'll see you next week.

Subject outcomes

  • Mistral Smallscore 9
  • Mistral 7B Instructscore 9
  • Amazon Nova Proscore 8
  • Llama 3 70B Instructscore 8
  • Llama 3 8B Instructscore 7
  • Llama 3.1 8B Instructscore 6
Item 12813% solve rateanswer: 8

Prolonged-Exposure therapy conversation (client 359, phase P10: Full Imaginal Exposure).

Therapist: Welcome, John. How are you feeling about today's session? Client: I'm... a bit on edge, to be honest. I know we're going to dive into that animal attack again, and just thinking about it makes my heart race a bit. Therapist: That's understandable. Remember, you're safe here. Let's start with a SUDS rating. Client: Um, I'd say about a 5 out of 10 right now. Just talking about it brings back some of that tension. Therapist: Okay. When you're ready, close your eyes and take us back to that day. Client: (Deep breath) Alright... I'm on my usual hiking trail near the coast. It's a beautiful day, the sun is shining, and I can hear the waves crashing in the distance. I'm alone, which I usually enjoy, but today it feels... different. There's this eerie quiet that I can't shake. Therapist: Good. What do you see around you? Client: I see the dense bush on either side of the trail. The leaves are a vibrant green, almost too green. There's a bend in the path ahead, and I can't see what's beyond it. I'm walking slowly, my boots crunching on the gravel... Therapist: Stay with that moment. What happens next? Client: I... I hear a rustling in the bushes to my left. At first, I think it's just a bird or maybe a small marsupial. But then... oh God, I see these yellow eyes peering out at me. They're huge, and they're fixed right on me. Therapist: You're doing well. What's your SUDS level now? Client: It's... it's climbing. Maybe a 7? My palms are starting to sweat just thinking about those eyes. Therapist: Remember to breathe. You're safe here. Continue when you're ready. Client: (Shaky breath) Okay... The eyes belong to a dingo. It's much larger than I expected, and its teeth... they're bared and gleaming. I freeze. I know I shouldn't run, but every instinct is screaming at me to get out of there. The dingo takes a step forward, and I can hear this low, guttural growl... Therapist: Stay with it. What are you feeling in your body? Client: My heart is pounding so hard I can feel it in my throat. My legs are shaking, and there's this cold sweat breaking out all over. I want to run, but I'm paralyzed with fear. Therapist: You're doing great. Keep going. Client: The dingo lunges at me. I try to back away, but I stumble and fall. I can feel the gravel digging into my palms as I hit the ground. The dingo is on me in an instant. Its hot breath is on my face, and I can smell the... the rotting meat on its breath. Oh God, I thought I was going to die right there. Therapist: Take a deep breath. What's your SUDS level? Client: It's... it's a 9. I feel like I'm right back there. Therapist: You're safe here. Remember, this is a memory. Stay with it. Client: (Breathing heavily) The dingo's teeth sink into my arm. The pain is... it's indescribable. Sharp and burning all at once. I'm screaming, but it feels like no sound is coming out. I'm thrashing, trying to push it off, but it's so strong. I can feel its claws digging into my chest as it holds me down. Therapist: You're doing well. What happens next? Client: I... I manage to grab a rock with my free hand. It's jagged and cuts into my palm, but I barely notice. I swing it as hard as I can at the dingo's head. There's a sickening thud, and it yelps, letting go of my arm. I hit it again and again until it finally backs off. Therapist: How are you feeling now? Client: Terrified. Relieved. My whole body is shaking. The dingo is still there, circling, but it's keeping its distance now. I'm struggling to my feet, holding the rock out in front of me like a shield. My arm is bleeding badly, and the pain is... it's overwhelming. Therapist: Stay with that feeling. What do you do? Client: I start backing away slowly, never taking my eyes off the dingo. It's watching me, licking its chops. I can see blood on its muzzle... my blood. I'm dizzy from the blood loss and the adrenaline. Every step feels like it might be my last. Therapist: You're doing great. What's your SUDS level now? Client: It's still high... maybe an 8? I can feel my heart racing just like it did that day. Therapist: Remember to breathe. You're safe here. Continue when you're ready. Client: (Deep breath) I keep backing away until I reach the bend in the trail. The dingo hasn't followed, but I can still see its eyes gleaming in the bushes. As soon as I round the corner, I turn and run. I'm stumbling, my vision blurry from tears and sweat. The pain in my arm is excruciating, but the fear of the dingo coming after me keeps me going. Therapist: What are you thinking in this moment? Client: I'm... I'm thinking I might die out here. That no one knows where I am, that I could bleed out before I reach help. I'm angry at myself for hiking alone, for not being more prepared. And I'm... I'm praying. Praying to make it out alive. Therapist: Stay with those thoughts. What happens next? Client: I finally reach the trailhead. There's a couple getting ready to start their hike. They see me, covered in blood and dirt, and their faces... the shock and horror. The woman screams, and the man rushes towards me. I collapse, the adrenaline finally wearing off. They're calling for help, pressing something against my wound. I'm fading in and out of consciousness. Therapist: You're doing well. How does your body feel in this moment? Client: Heavy. So heavy. The pain is... it's everywhere. My arm feels like it's on fire, and my chest aches where the dingo's claws dug in. I'm shivering uncontrollably, even though I feel hot. And there's this... this overwhelming relief. I made it. I survived. Therapist: What's your SUDS level now? Client: It's... it's come down a bit. Maybe a 6? The relief is starting to outweigh the fear. Therapist: Good. Take us through what happens after that. Client: The ambulance arrives. The paramedics are asking me questions, but I can barely focus enough to answer. They're cutting away my shirt, cleaning my wounds. The sting of the antiseptic is nothing compared to the throbbing pain in my arm. They start an IV, and as the pain medication kicks in, everything starts to get hazy. Therapist: Stay with that feeling. What are you thinking? Client: I'm... I'm thinking about how close I came to dying. About how I'll never be able to look at that trail the same way again. And I'm... I'm feeling guilty. Guilty that I couldn't stop the attack, that I wasn't stronger or smarter. That I let this happen. Therapist: It's important to remember that this wasn't your fault. How does your body feel now? Client: It feels... drained. Like I've run a marathon. My muscles are aching from the tension, and I feel this heaviness in my chest. But there's also this... this tingling sensation. Like my body is reminding me that I'm alive. Therapist: You've done really well. Let's start to bring you back to the present. What's your SUDS level? Client: It's... it's down to a 4 now. I can feel myself starting to relax a bit. Therapist: Good. Take a few deep breaths. When you're ready, open your eyes and come back to the room. Client: (Opens eyes, looks around) Wow... that was intense. I haven't let myself think about it in that much detail before. Therapist: You did an excellent job. How are you feeling now? Client: I'm... I'm exhausted, to be honest. But there's also this sense of... I don't know, accomplishment? Like I faced it head-on for the first time. Therapist: That's a normal reaction. You've taken a big step today. Let's take a few minutes to ground ourselves before we end the session. Client: Okay... yeah, that sounds good. I... I appreciate you guiding me through that. It was tough, but I think... I think it might be helping. Therapist: You've shown a lot of courage today, John. We'll continue to work through this together.

Subject outcomes

  • Llama 3.1 70B Instructscore 9
  • Mistral 7B Instructscore 9
  • Mistral Smallscore 9
  • Llama 3 70B Instructscore 8
  • Llama 3.1 8B Instructscore 7
  • Mistral Largescore 7

Subjects

  1. 1Mistral Small6.866
  2. 2Mistral 7B Instruct6.5193
  3. 3Llama 3 70B Instruct6.4461
  4. 4Mistral Large6.3487
  5. 5Llama 3.1 70B Instruct6.269
  6. 6Amazon Nova Pro5.9713
  7. 7Llama 3.1 8B Instruct5.954
  8. 8Llama 3 8B Instruct5.729