Should i tell the police if someone is using my phone number fraudulently?

Much as you don't want to change your number personally I would. Report it to your provider and it could be worth having a word with your local Police.