Reasoning with Transformer-based Models: Deep Learning, but Shallow Reasoning

Conference: The 3rd Conference on Automated Knowledge Base Construction Authors: Chadi Helwe, Chloé Clavel, Fabian Suchanek Abstract: Recent years have seen impressive performance of transformer-based models on different natural language processing tasks. However, it is not clear to what degree the transformers can reason on natural language. To shed light on this question, this survey paper discusses the

Read More