Let us solve this with real numbers instead of just theory.
This numeric check shows directly why the gun moves backward slowly while the bullet moves forward fast, and it shows the law at work is conservation of linear momentum, not mass or energy conservation alone.