My guinea pig is so cute. but weird..?

Guinea pigs love to burrow and that is what your guinea pig was trying to do. In the wild they would burrow if afraid so your little guy was afraid, however, he found security in being near you, so tha tis a very good sign. The purring is saying he likes what you are doing, so keep up the good work.