I accidentally gave a stranger my number

A few months ago, I (18F) was walking home when someone grabbed me - turns out he was blind and wanted me to walk him home. I was obviously very very wary but I also didnt want to leave him stranded there, so I did so and it turned out fine. I saw him a couple of times after that, and offered to help him.

He's around 40 I think and told me that he got injured in a boxing accident. He seemed normal enough - he tried to ask me out and I told him I had a boyfriend and he seemed to leave me alone about it.

Now, most recently, he said he'd started to get his vision back and he asked me to put my number into his phone. I tried my best to leave but he sort of pressured me. I didnt put in a fake number, I dont know why - I was just worried that he might see me in the street or something. As I was leaving, he sort of stroked my hand, and I told him (again) that I had a boyfriend. He looked disappointed and said oh I thought you were single. I thought that would be the end of it.

But this morning, I woke up to messages from him. I havent looked at them, I dont know why but I'm slightly scared. He knows the street I live on but I never told him exactly where, but I'm just not comfortable with this.

I dont know him well enough to know how he'll respond if I air him or tell him to stop messaging me. I dont know if I'm being overdramatic about this whole thing. Any advice would be greatly appreciated.

TLDR: A stranger sort of pressured me into giving him my number. I don't really want to respond or talk, I was just helping him out of kindness but he lives really close to me and I'm slightly scared. Should I do something or am I just being overdramatic? Any advice would be appreciated.