How can I get rid of, prevent, or at least numb the pain of my recurring mouth ulcers?

I strongly recommend you to see a doctor, since the recurring mouth ulcer happens too often. It is abnormal. It must have something to do your diet or your mouth hygiene.