Skip to main content

Reasoning & Knowledge

LLM-BP TAG Node Classification

Per-node GPT-4o vanilla-LLM baseline for zero-shot node classification over 11 real-world text-attributed graphs (LLM-BP).

152,026items
1subjects
100%observed
Apache-2.0license
generaldomain
textmodality

Response matrix

Fit to width. Hover for subject & item; click a cell for details.

LLM-BP TAG Node Classification response matrix: AI models (rows) against items (columns)
Correct (1)Incorrect (0)Unobserved

Scale: 1 = correct · 0 = incorrect

Sample items

Item 10% solve rateanswer: Hunting & Fishing

The title of the item in this Sports & Fitness category is BLACKHAWK! 44H015PL-L BH- Taser X-26 Level 2 LH Plain Duty Holster, Black

How subjects answered

  • GPT-4o incorrect

    Based on the title "BLACKHAWK! 44H015PL-L BH- Taser X-26 Level 2 LH Plain Duty Holster, Black," the item likely belongs to the "Accessories" category. This is because a holster is an accessory related to carrying equipment rather than a primary item in sports or fitness activities.

Item 20% solve rateanswer: Animals

Description: Grade 5 Up-After having left his life as a kittypet, apprentice Firepaw of the ThunderClan has been given his warrior name of Fireheart and his first mission-to find the WindClan and assist them back to their traditional hunting grounds. While he and his friend Graystripe are successful in their quest, Fireheart knows that trouble is brewing, and he isn't sure that the ThunderClan's deputy can be trusted. As events escalate, a warrior from RiverClan is accidentally killed, an apprentice is injured, and Fireheart brings into the Clan a kittypet kitten-his nephew-without thinking of the consequences. Finally, he must decide who to trust and who to fight. Readers not familiar with the first book may find this one hard to follow. Hunter provides a directory that tells which cats are in which clans, but it is cumbersome to flip back and forth. The characterizations of the animals are somewhat flat, although it is possible to tell them apart, and the plot's twists and turns seem mapped out and predictable. Librarians with a readership for Into the Wild (HarperCollins, 2003) will probably want this volume; others can pass.Lisa Prolman, Greenfield Public Library, MACopyright 2003 Reed Business Information, Inc.Gr. 6-9. Firepaw, the former kittypet who became a ThunderClan warrior in Into the Wild [BKL F 15 03], faces danger and treachery within and without his clan as he struggles with his identity. Because some clan members refuse to accept him, he feels like an outsider. Also, it appears that ShadowClan and RiverClan are forming an alliance to usurp land belonging to the displaced WindClan. ThunderClan's leader sends Firepaw and his friend Graystripe to lead WindClan back to its home, but intrigue among the clans and among individuals within them spells trouble for Firepaw. Characters remain true to their feline natures, adding to the plausibility of events in this tension-filled story. Readers will be happy to learn that another episode is in the works. Sally EstesCopyright American Library Association. All rights reserved; Title: Warriors #2: Fire and Ice (Warriors: The Prophecies Begin)

How subjects answered

  • GPT-4o incorrect

    The text belongs to the "Science Fiction & Fantasy" category. The description indicates a narrative involving clans of anthropomorphized animals, which is a common element of fantasy literature. The storyline includes elements of adventure, identity struggle, and imaginary settings, further supporting its classification under this category.

Item 30% solve rateanswer: Hunting & Fishing

The title of the item in this Sports & Fitness category is NDZ Performance For Glock 17 19 21 22 23 27 30 34 36 41 Rear Plate Blk G1-4 Texas Flag version 2

How subjects answered

  • GPT-4o incorrect

    The title provided describes an accessory specifically designed for Glock firearms, which suggests it relates to a part or upgrade for firearms rather than a sporting activity or equipment. Given the categories listed, the most appropriate category for this item would be "Accessories" because it fits best as an add-on or component for firearm enthusiasts, which generally falls under accessories in sports and fitness contexts.

Item 40% solve rateanswer: Literature & Fiction

Description: Joan Plowright--as the older Mary Lennox--narrates the Frances Hodgson Burnett classic about a spoiled orphan girl who finds hope and beauty on a Yorkshire estate. This full-cast drama is--if it's possible to apply the term to an audio program--spectacular. The use of music and sound not only conveys the mood but also gives a panoramic feel to the story. Top-notch performances by "FawltyTowers" Prunella Scales (as Mrs. Madlock) and Lily Milton, Thomas Orange, and Garrett Moore (as the children) make the garden and its surroundings come alive. Kudos go to engineer/producer Dave Arnold and director Philip Glassborow on a fine and memorable production. S.E.S. Winner of AudioFile Earphones Award AudioFile 2002, Portland, Maine-- Copyright AudioFile, Portland, Maine; Title: The Secret Garden (Radio Theatre)

How subjects answered

  • GPT-4o incorrect

    The text description provided is about "The Secret Garden," which is a classic novel by Frances Hodgson Burnett. Given the context and the information about this being a dramatic audio adaptation, the most appropriate category for this text is 'Classics'.

Item 50% solve rateanswer: Growing Up & Facts of Life

Description: PreS-KMr. Brown knows that today is a good day for a hat. And he would know, because he has one for every occasiona wide-brimmed hat for rain, a cozy earflap hat for snow, even a chef's hat for the big Bear County Cook-off! But today, a mischievous rabbit is creating chaos with its magic wand. Each time Mr. Brown opens his front door, something has changed, causing the bear to go back inside to change his hat. Finally, Mr. Brown must leave his house or be late to meet mousy Miss Plum. So he stacks several hats on his head and arrives at Miss Plum's just in time for a surprise birthday party for him! Luckily, his friend has just the right hat for that! This bright and cheerful hat-filled book (don't miss the whimsical endpapers) is similar in tone and structure to Brian Won's Hooray for Hat! and Jory John's Goodnight, Already! The illustrations, created digitally with pencil, crayon, and ink, use a presentational perspective; kids will feel as though they are looking at a theater pantomime through a proscenium. Flat, geometric shapes create backgrounds, and loose-limbed characters stare directly at viewers. VERDICT Although the book fails to pull readers in emotionally and there's no explanation for the pesky rabbit, the repetitive structure, plot-driven narrative, and large, easy-to-read font make this a fun storytime title for toddlers or preschoolers.Amy Seto Forrester, Denver Public Library; Title: A Good Day for a Hat

How subjects answered

  • GPT-4o incorrect

    Based on the provided description and title, "A Good Day for a Hat" appears to fall under the category of 'Humor'. The story's whimsical and lighthearted tone, along with the humorous chaos caused by the magical rabbit and Mr. Brown's various hats, contribute to this classification. Additionally, the repetitive and fun nature of the narrative-targeted towards toddlers or preschoolers- strengthens its alignment with the 'Humor' category.

Item 6100% solve rateanswer: Golf

The title of the item in this Sports & Fitness category is Tour Edge Backdraft Putter (Right-Handed GT-1 35 Inches with Headcover)

How subjects answered

  • GPT-4o correct

    The title "Tour Edge Backdraft Putter (Right-Handed GT-1 35 Inches with Headcover)" suggests that the item is related to golf equipment. Specifically, a putter is a type of club used in the game of golf. Therefore, the category the text belongs to is 'Golf'.

Item 7100% solve rateanswer: Hunting & Fishing

The title of the item in this Sports & Fitness category is Nikon M-223 BDC 600 8489 3-12x42SF Riflescope (Black)

How subjects answered

  • GPT-4o correct

    The title "Nikon M-223 BDC 600 8489 3-12x42SF Riflescope (Black)" belongs to the category "Hunting & Fishing."

Item 8100% solve rateanswer: Other Sports

The title of the item in this Sports & Fitness category is Greek Hoplite High Carbon Steel Blade Sword

How subjects answered

  • GPT-4o correct

    Based on the title "Greek Hoplite High Carbon Steel Blade Sword," the item likely belongs to the "Other Sports" category. This is because swords typically do not fall under more specialized categories like those listed, and "Other Sports" can include items that don't fit into the other predefined categories.

Item 9100% solve rateanswer: Hunting & Fishing

The title of the item in this Sports & Fitness category is Gliss Pink Fishing Line

How subjects answered

  • GPT-4o correct

    The category that the text "Gliss Pink Fishing Line" belongs to is 'Hunting & Fishing'.

Item 10100% solve rateanswer: Boating & Sailing

The title of the item in this Sports & Fitness category is Fuel Pump Assy 66M-24410-10 11 00 01 for Yamaha 4-Stroke 9.9HP 15HP 13.5HP F 13.5 15 F 9.9 Outboard Motor

How subjects answered

  • GPT-4o correct

    The title describes a part for an outboard motor, which is related to boating. Therefore, the appropriate category for this text is "Boating & Sailing."

Item 11100% solve rateanswer: Growing Up & Facts of Life

Description: Third-grader Fran and her puppy, Hercules, have a lot in common. Most importantly, both have a hard time controlling their impetuous behavior. Fran's teacher keeps telling Fran, "I'm at the end of my rope with you." Fran's pregnant mother tells Fran that they may not be able to keep Hercules because "I've had it with that dog. Either he gets trained or he's out of here." Hercules does learn to behave after Fran takes him to "puppy kindergarten" where he practices the crucial skills of "sit," "stay," and "heel." And Fran, who will lose the coveted part of Princess Penelope in the school play if she does not act more like a princess in the classroom and on the playground, realizes that "[i]f Hercules could change, so could she." However, Fran's behavior--unlike that of Hercules--goes beyond youthful exuberance to calculated, selfish meanness: she puts a roadkill dead toad in a classmate's backpack, injures a smaller child by shoving him at the water fountain, and cheats shamelessly at tetherball. It is hard for the reader to like Fran, who is indeed the "big bully" that the other children proclaim her to be. Still, the parallel between puppy training and Fran's own efforts at self control sends a hopeful (if overly optimistic) message that even deep-seated moral flaws are corrigible.Judy Cox is an elementary school teacher who has written many picture books and chapter books for children. Publishers Weekly praised Coxs rhythmic story and the narratives cheerful, buoyant tempo for "My Family Plays Music", winner of the Coretta Scott King/John Steptoe New Talent Illustrator Award. She lives in Ontario, Oregon.; Title: Puppy Power

How subjects answered

  • GPT-4o correct

    The text "Puppy Power" revolves around a child named Fran and her puppy Hercules. It deals with themes of personal growth, behavior correction, and the challenges of youthful impetuosity, which are common elements in literature about growing up. The story explores Fran's journey toward better behavior and the consequences of her actions, paralleled by her puppy's training. Given these details, the most fitting category for this text would be 'Growing Up & Facts of Life'.

Item 12100% solve rateanswer: Hunting & Fishing

The title of the item in this Sports & Fitness category is MTech USA MT-A866BK Spring Assist Folding Knife, Black Stonewashed Blade, Black Handle, 5-Inch Closed

How subjects answered

  • GPT-4o correct

    The title "MTech USA MT-A866BK Spring Assist Folding Knife, Black Stonewashed Blade, Black Handle, 5-Inch Closed" is best categorized under "Hunting & Fishing." This is because folding knives like the one described are often used for outdoor activities such as hunting and fishing.