Tiny, clear bumps inside mouth?

Two days ago, the inside of my mouth started to hurt. Then I noticed a canker sore at the side of my mouth, and all these tiny, clear bumps tered around. Sometimes, one of the tiny bumps would swell up, until I kept pushing it with my tongue, and it reduced its size again. Is this something to worry about, or will it go away soon?