Phase-Associative Memory
Phase-Associative Memory (PAM) is a new sequence model using complex-valued representations. It achieves 30.0 validation perplexity on WikiText-103, close to a matched transformer's 27.1.
via ArXiv cs.CL#Natural Language Processing