Is there anything you find incredibly annoying but still have to do for your project ?

Most certainly! I think the biggest for me would be the high level planning and decision making on what things to focus on. That's my biggest challenge right now. I hate it but I don't believe I can outsource it as I would any other large task that I hate.