Rule of thumb: Most people can easily conceal a larger pistol than they believe they can.
A few very basic questions you need to answer about the intended firearm:
Are you looking for more of a pocket pistol to eliminate the concealment clothing issues?
Will you be carrying concealed exclusively?
Is your body type sufficient to conceal a larger than compact pistol?
Weight of the firearm is always a factor. Choosing a polymer frame pistol limits available options. Would you be less apt to choose a heavier all-metal pistol, like a 1911?
Have you decided on a caliber?
Do you intend to use a red dot?
Do you mind being limited to 8-10 rds, or is 15 rds a better idea? Higher capacity = heavier gun, but it also means more rds without carrying more mags.
The smaller the pistol, the less control you'll have, which is why I'm sure you are asking about accuracy.
I hit the 25ft KHSC pistol target 4 out of 5 rds with my G42 .380, but I really had to concentrate. Everyone else trying it out missed 100% of their rds and gave up.
The Sig P320 is available in Carry and Subcompact configurations. The ergonomics are best of all my subcompacts. I have the G26, G30, G42, & S&W Shield 9mm.. That's not including my .22LR 5rd derringer revolver.
I've been considering divesting my collection of 1-2 subcompacts to get the new Sig P365. Waiting to make sure all the bugs are worked out first. New models tend to have fixes the first year or two.