not sure what they are haha

Sounds like keratosis pilaris. I am not sure on treatment but have a google and see if that sounds like what you've got :)

I have them too, like Lizabella suggests keratosis polaris which is really ingrown hairs.

I found exfoliating the area well, with both a scrubbing brush and then with an acid (currently using The Ordinarys 7% Glycolic Acid Toning Solution) followed by a standard body moisturiser has eliminated the problem.

Keratosis pilaris is cause by build up of keratin, a normal substance that helps to protect skin. The keratin build up blocks the hair follicles, but they are not ingrown hairs if that makes sense. Lots of exfoliation and moisturisation will help. I agree with Pretty_please, glycolic acid lotion will help to reduce the appearance.

beautyheaven actually did an article recently on Keratosis Pilaris recently, it was very informative

I have them too. You will need to regularly exfoliate the area and I read that using glycolic acid is the best way. I have been using the nib+fab glycolid fix body cream for a few days, hopefully it works.