Why does a heavy rifle not kick as strongly as a light rifle using the same cartridge?

Why does a heavy rifle not kick as strongly as a light rifle using the same cartridge?

When bullet is fired from a rifle, then the bullet also pushes the gun in opposite direction with equal magnitude of force. In case of heavy, the recoil velocity of the heavy rifle is smaller then that of the light rile. So it does not kick strongly.
i.e. image