Will a person while firing a bullet from a gun experience a backward jerk ? Why?

Yes, it is due to the law of conservation of linear momentum.