Is breastfeeding really that difficult?

And I'm not talking about sore nipples and pain. I know that this will most likely happen at the start. But I'm wondering - Is breastfeeding really THAT hard? I'm due in 5 weeks, FTM, and all I read is horror stories and how insanely difficult breastfeeding is. Like, having the baby latch is incredibly hard, keeping your supply up etc etc... it makes me a little worried, because I am planning on breastfeeding (plus pumping).

How has your experience been? Has breastfeeding really been 'incredibly hard'? If so, why? Or has your experience been rather easy? Thank you!