Curious About Buying Gold Bullion

Recently, there are days when I feel like it would make a lot of sense to go back to the old ways where you kept your savings in your bed mattress. I am not ready to go that far, because who knows what could happen to that. But, I am curious about buying Gold Bullion. I know that it sounds very old fashioned, but I think there is something to be said for the way things were done years ago. I would like to find a secure and safe way to invest my money and am wondering if this is it.