You have made the mistake of cleaning the ears even if they are clean. By doing this you have injured the skin in the ear which must have got infected. That is why you are having the pain.
See an ent surgeon
at the earliest. He will be in a position to cure this.