I get hundreds of views and MAYBE one new subscriber per video

My shorts do better than my long form videos in terms of views, but either way, I tend to only get only 1 new follower per upload if I get 1 at all. The retention of each video is good. What is this a sign of? A big portion of my viewers watch the whole video but no one is interested in following. Should I revamp the entire way I do things and risk losing retention?