It is so worth it. I'm not really bothered by clunky controls personally at this point as I just feel like if you are playing with controller then most AAA titles are clunky to control at this point. But I do absolutely see where you are coming from and could even see the argument that RDR2 is a bit worse in that regard than most.
But holy hell is it worth it. I really think that it is the deepest game I have ever played. World building, story, character writing, cinematography, humor, self awareness, difficulty and fun. Its absolutely phenomenal, and I had high expectations going in.
Please do yourself a favor and push through the control schemes. There's so much to love there.
Witcher 3 is phenomenal, one of my absolute favorite games. Blood and Wine I think is my favorite DLC expansion I've ever played.