Revisiting the effects of stochasticity for Hamiltonian samplers