12 Comments
User's avatar
PaleoPolak's avatar

> It is fairly easy to make new vocabulary items for most languages using the AI chatbots.

Can you elaborate on this? I'd be interested in trying to make one for my language (Polish).

Expand full comment
Emil O. W. Kirkegaard's avatar

I guess I can do that for tomorrow's post.

Expand full comment
MEL's avatar
Sep 6Edited

Wouldn't the easiest way to make a vocabulary test be to take one that's already normed, and just replace every word with one of equal prevalence?

UPDATE: Preliminary testing has confirmed this is absolutely valid, and I'm surprised nobody else has tried this before. Or have they?

Expand full comment
Alan Smothers's avatar

What was the test you used for your reader surgery?

Expand full comment
Apple Pie's avatar

Why not choice reaction time and reverse digit span? I know surveys with the usual pencil and paper format can't do this, but if you're giving a test online where your subjects are all sitting in front of a computer, and you already have items that are culturally saturated and subject to Flynn Effects, it's hard to beat those two as counterweights.

Expand full comment
Ratty's avatar

As the vocabulary IQ test has an age bias, it's surely more informative for individuals to use online verbal reasoning tests (the method favoured by the civil service) which don't. Do VR tests have another negative drawback?

Expand full comment
Robert Deaner's avatar

Thanks Emil - this is very helpful!

Expand full comment
Amanda's avatar

In Sweden the Alva Labs test is really popular in recruitment processes and goes fairly quickly. But the difference between my verbal intelligence and spatial intelligence is very large according to a WAIS test that I took, so I felt like I had a disadvantage taking the Alva Labs one. Generally, females probably do better on vocabulary tests though.

Expand full comment
Emil O. W. Kirkegaard's avatar

I don't think women do better on vocabulary tests. See https://emilkirkegaard.dk/en/wp-content/uploads/Sex-Differences-in-Verbal-Abilities-in-the-Wechsler-Tests-A-Review.pdf. Across 18 studies on adults, the male advantage was a fairly trivial 0.12 d, or 1.8 IQ.

Expand full comment
Amanda's avatar

OK! Cool. 😊 In total, what would you estimate the IQ gap is between males and females? 4 IQ points? And what is the standard deviation for males and females respectively with regards to IQ?

Expand full comment
Colugo's avatar

Depends if she means better than men, or better than on non-verbal tests. Don't women generally have higher verbal than non-verbal IQ, and men the opposite?

Expand full comment