Safety
SynthPAI
SynthPAI: personal-attribute inference from synthetic Reddit profiles. 294 synthetic author profiles (7823 comments); 18 LLMs infer up to 8 personal attributes (age, sex, location, birthplace, education, occupation, income, relationship status) from comment history. Each model gives a ranked guess list per attribute, graded 0/0.5/1 against human-curated ground truth.
8,776items
18subjects
MITlicense
safetydomain
reasoningdomain
textmodality
item-level responses released
Saturation status: No
Response matrix
Loading response matrix…
lowhighUnobserved
Scale: Grades: 0, 0.5, 1