Sequence Modeling

Phase-Associative Memory

Phase-Associative Memory (PAM) is a new sequence model using complex-valued representations. It achieves 30.0 validation perplexity on WikiText-103, close to a matched transformer's 27.1.