Reinforcement Learning Algorithms: Acceleration Design And Non-Asymptotic Theory