Abstract: Owing to the parallelism feature and convenient hardware implementation of recurrent neural network (RNN), many RNN models have been proposed to solve linear and nonlinear algebra problems.