IMO, you should start with what the primary purpose of the firearm is. If the firearm is just for range fun and plinking, then pretty much any gun that you fancy will do. Be it inexpensive, expensive, super accurate, etc.
I have handguns that are for teaching new shooters, just nice to have and personal defense. If it's for personal defense, I'm looking for RELIABILITY first and foremost and then train, train, train. I chose the Glock 17 since it is reasonably priced, proven reliable, has a vast selection of support for sights, holsters, etc and it accurate enough right out of the box.
Hi-Points have a reputation for being cheap and unreliable. Does that mean that everyone of them is junk, no? However, just from reputation alone, it wouldn't be my first choice for a personal protection firearm when Glocks or even M&Ps and XDs aren't that much more expensive. I truly believe you get what you pay for, particularly when it comes to firearms. I don't look down on those who choose the most budget conscious choice, but I am not willing to waste my money trying out those budget firearms either. Let others do the testing and choose from tried and true.