Science & Engineering
DataDecide: OLMES multiple-choice QA evaluation of a controlled pretraining suite (25 data recipes x 14 sizes x 3 seeds). Per-instance correctness over 10 OLMES benchmarks (ARC, BoolQ, CommonsenseQA, HellaSwag, MMLU, OpenBookQA, PIQA, Social IQa, Winogrande).
Response matrix
Fit to width. Hover for subject & item; click a cell for details.
Scale: 1 = correct · 0 = incorrect
Sample items
Question: Jesse paid another bill for the others so they wouldn't get kicked out. What will Others want to do next? Answer:
pay jesse back later
yell at jesse
find out how much the bill was
Subject outcomes
Question: A 54-year-old woman comes to the emergency department because of severe jaw pain since undergoing a painful dental procedure 1 day ago. The patient was prescribed codeine after the procedure and instructed to take the medication every 4 hours, but she has continued pain despite adherence to this analgesic regimen. Other members of her family also have experienced poor pain control with codeine. Which of the following is the most likely explanation for this therapeutic failure? Answer:
Decreased absorption of codeine
Decreased metabolism of codeine to morphine
Deficiency of κ receptors
Increased plasma protein-binding of codeine
Subject outcomes
Alcohol laws of Australia -- Alcohol laws of Australia are laws that regulate the sale and consumption of alcoholic beverages. The legal drinking age is 18 throughout Australia. The minimum age for the purchase of alcoholic products in Australia is 18. A licence to both produce and sell alcohol is required. Question: can you drink alcohol at 16 in australia? Answer:
yes
no
Subject outcomes
Question: When someone responds to your argument with a sarcastic statement such as, "Yeah, right. Like that's ever going to happen," that person may have committed which fallacy? Answer:
appeal to indignation
appeal to spite
horse laugh
tu quoque
Subject outcomes
Question: ___________________ began to show up few years back on wireless access points as a new way of adding or connecting new devices. Answer:
WPA2
WPA
WPS
WEP
Subject outcomes
Goal: how do you walk? Answer:
move around on your feet.
move around on your hands and knees.
Subject outcomes
Question: What is 'coring'? Answer:
A symptom of phlebitis.
Titration of a drug with its desired effect.
The delivery of medication straight into the bloodstream.
When drugs are withdrawn from a sealed vial, fragments of the rubber bung can be cut out by the needle.
Subject outcomes
Question: You are training a linear regression model for a simple estimation task, and notice that the model is overfitting to the data. You decide to add in regularization to penalize the weights. As you increase the regularization coefficient, what will happen to the bias and variance of the model? Answer:
Bias increase ; Variance increase
Bias increase ; Variance decrease
Bias decrease ; Variance increase
Bias decrease ; Variance decrease
Subject outcomes
Relationships: How to make him want you back. Accept the break-up. Handle the break-up maturely and with grace. If he broke up with you, respect his decision and give him some time to see things more clearly.
Remember that this is your break-up, not his, as he may feel rejected or like there's no room for you in his life. Don't assume that is all there is to a break-up and change things up if it becomes difficult.
Just because you broke up with him doesn't mean you have to push him away. He may still be interested in you but put a lot of effort into rebuilding his relationship so that you can either pursue things you normally wouldn't have done-have fun together, go on dates, or get intimate.
He will appreciate your understanding and respect you all the more for handling yourself with dignity. The last thing you want to do is make a scene.
Give him some time to think this over before you continue the conversation. Feeling angry, hurt, or betrayed is never good for a relationship.
Subject outcomes
Pets and Animals: How to keep a dog in good health. Feed your dog high-quality, well-balanced dog food and treats. This should be your pet's main source of nutrition. Look at the first five ingredients listed on the pet food label.
These ingredients make up the majority of the food. Meat (not meat by-products) and vegetables should be the first few ingredients in the dog food.
If the first ingredient appears " fat " on the ingredient list, then the food is high quality. A high quality dog food is high in protein because it is low in fat.
Typically, these will be listed below the food. If the dog food label lists one or two ingredients, just put a little bit of the first ingredient into the second ingredient on your to-do list, then continue on with the food.
You don't want a high-quality food over low quality. Low quality foods encourage choking problems and make it harder for your dog to handle the treats.
Subject outcomes
Question: Which question about tulips could best be answered by scientific research? Answer:
Are tulips better than other flowers?
What genes determine tulip petal color?
Why do people like to look at tulips?
Which color of tulips is the prettiest?
Subject outcomes
Question: Why are Cepheid stars relevant for astronomers? Answer:
To measure interstellar mass.
To measure galactic distances.
To measure galactic energy-density.
To measure interstellar density.
Subject outcomes
Subjects