IQ Test Result: Advanced AI Machine Matches Four-Year-Old Child's Score
Artificial intelligence machines are rapidly gaining on humans, but they have some way to go on IQ tests.
MIT Technology Review | October 1, 2015
But an outstanding questions is: to what extent do these capabilities add up to the equivalent of human intelligence? Today, we get answer of sorts thanks to the work of Stellan Ohlsson at the University of Illinois and a few pals who have put one of the world’s most powerful artificial intelligence machines through its paces using a standard IQ test given to humans.
<more at http://www.technologyreview.com/view/541936/iq-test-result-advanced-ai-machine-matches-four-year-old-childs-score/; related links: http://arxiv.org/abs/1509.03390 (Measuring an Artificial Intelligence System's Performance on a Verbal IQ Test For Young Children. Stellan Ohlsson, Robert H. Sloan, György Turán, Aaron Urasky. arXiv:1509.03390v1 [cs.AI] Submitted September 11, 2015. [Summary: We administered the Verbal IQ (VIQ) part of the Wechsler Preschool and Primary Scale of Intelligence (WPPSI-III) to the ConceptNet 4 AI system. The test questions (e.g., "Why do we shake hands?") were translated into ConceptNet 4 inputs using a combination of the simple natural language processing tools that come with ConceptNet together with short Python programs that we wrote. The question answering used a version of ConceptNet based on spectral methods. The ConceptNet system scored a WPPSI-III VIQ that is average for a four-year-old child, but below average for 5 to 7 year-olds. Large variations among subtests indicate potential areas of improvement. In particular, results were strongest for the Vocabulary and Similarities subtests, intermediate for the Information subtest, and lowest for the Comprehension and Word Reasoning subtests. Comprehension is the subtest most strongly associated with common sense. The large variations among subtests and ordinary common sense strongly suggest that the WPPSI-III VIQ results do not show that "ConceptNet has the verbal abilities a four-year-old." Rather, children's IQ tests offer one objective metric for the evaluation and comparison of AI systems. Also, this work continues previous research on Psychometric AI.]) and http://www.technologyreview.com/view/538431/deep-learning-machine-beats-humans-in-iq-test/ (Deep Learning Machine Beats Humans in IQ Test. Computers have never been good at answering the type of verbal reasoning questions found in IQ tests. Now a deep learning machine unveiled in China is changing that. June 12, 2015)>
No comments:
Post a Comment