Examines the reported percentile of GPT-4’s simulated US Uniform Bar Examination performance. Its passing score is different from its percentile, which depends on the comparison cohort and how essays are scored. Reanalysis challenges the widely repeated 90th-percentile figure.
Examines whether novices gain more than experienced workers from generative AI within the same job or task. Evidence from customer support, writing and consulting often shows larger gains for initially weaker performers; this is not a rule for every profession.
Tests whether access to AI coding assistants shortens development tasks. Controlled exercises and workplace studies show gains, while experienced developers working in familiar repositories have sometimes taken longer. Task complexity, tool generation and familiarity matter.