Technology
Facebook’s new benchmarking system asks humans to interrogate AIs – Yahoo Lifestyle Australia
Facebook’s AI research (FAIR) lab has taken a new approach to benchmarking: it’s putting humans in the loop to help train their natural language processing (NLP) AIs directly and dynamically.
Benchmarking is a crucial step in developing ever more sophisticated artificial intelligence. It provides a helpful abstraction of the AIs capabilities and allows researchers a firm sense of how well the system is performing on specific tasks. But they are not without their drawbacks. Once an algorithm masters the static dataset from a given benchmark, researchers have to undertake the time-consuming process of developing a new one to further improve the AI. As AIs have improved over time, resea…
Continue Reading
