Home or renters insurance can cover that. Just ask your insurance provider.
Homeowner's insurance normally only covers a small amount, normally around $1K-2K. If you have firearms, jewelry and/or furs or other valuables, you need a policy rider/addendum that covers the total value. In my experience, the rider costs a lot depending on the amount covered.
That's okay if i have a fire or some major burglary that causes a loss of everything covered all at once. But, if I only lose one pistol, a Rolex watch or a diamond ring, the cost for the premiums would be approaching the replacement cost of some items after 5-10 years if no claims are filed.
As usual, insurance is a gamble between you and the insurer. They are betting you'll pay more in premiums (which they use to make more money) than you'll cost them in losses. Sometimes the insurance is so expensive, it's a better option to put your premiums in an investment/CD and use that to self-insure. Then, if you ever need the money in a pinch, you'll have it to use. It takes discipline, but if you choose a long term cDm it'll keep you from using it on an impulse.
You might want to shop around for other homeowner's insurance companies. Might find one that's cheaper, which could make a rider more affordable.