Publications
Designing a strong test for measuring true common-sense reasoning
Abstract
Common-sense reasoning has recently emerged as an important test for artificial general intelligence, especially given the much-publicized successes of language representation models such as T5, BERT and GPT-3. Currently, typical benchmarks involve question answering tasks, but to test the full complexity of common-sense reasoning, more comprehensive evaluation methods that are grounded in theory should be developed.
- Date
- January 1, 1970
- Authors
- Mayank Kejriwal, Henrique Santos, Alice M Mulvehill, Deborah L McGuinness
- Journal
- Nature Machine Intelligence
- Volume
- 4
- Issue
- 4
- Pages
- 318-322
- Publisher
- Nature Publishing Group UK