Ive googled this before too and as already mentioned, the concensus is it's the compression/release of springs that wears them out and not just long term compression. The caveat most people cite is whether or not the mag has metal feed lips since if they're not they could warp and cause feeding issues. Like you my question involved home defense - I leave a couple of glock 21 mags loaded long term with more expensive JHPs that I don't use for practice. They have metal feed lips but I've had them in there for years so hopefully the concensus is correct!
As far as my pmags for my ar10 and m4, I have ten mags for each but i leave all empty but one for my m4 because those weapons are not for what i call routine HD; in other words my glock and mossberg 500 are for routine home invasion type situations and my ar10 and m4 are for civil emergency type situations, like the aftermath a of hurricanes, earthquakes, zombie apocalypses, :0 etc - that's their application. If the shit hits the fan ill load them then. I just leave one m4 mag full just in case, but why take a chance on the unknown by keeping all 20 mags loaded?