My guinea pig cries when holding him!?

Okay so after a couple of weeks of trying my guinea pig has finally started letting me pick him up but the only problem is he cries when I pick him up. Then after like a minute or so he wriggles and tries to get out of my hands? What can I do to stop him from crying? Pleaseee help!!!