Analytical and numerical analysis of the complete Lipkin-Meshkov-Glick Hamiltonian