Perfect Recall Does Not Mean Intelligent Routing
TL;DR for operators A sequence model can remember earlier inputs accurately without being equally capable of selecting or rearranging them. In a twelve-task benchmark, changing the input initialization of a conventional echo state network reduced simple-copy error from 0.400 to 0.000. But the best evaluated reservoir still recorded 0.429 error on selective copying and 0.477 on sorting, compared with 0.348 and 0.358 for S6. ...