Research shows natural language benchmarks don’t measure AI models’ general knowledge well

http://feedproxy.google.com/~r/venturebeat/SZYF/~3/UIT9ez59-2c/

Open-domain question-answering models — models theoretically capable of responding to novel questions with novel answers — often simply memorize answers found in the data on which they’re trained, depending on the data set. That’s the assertion of a team of researchers affiliated with Facebook and the University College London,  » ….