I’ve found that a plastic toothpick is the perfect tool for this. It is a soft enough material not to scratch the phone but it digs out the lint. A normal wood toothpick also works, but the plastic ones tend to be thinner making them easier to scrape with.

If the phone is still having issues after that or looks visibly inside, some contact cleaner applied and scrubbed with a pipe cleaner will remove gunk.