I used a piece of paper to push it further into a slot.

Wait. Loose BATTERY?! If your battery has expanded to the point of becoming loose, I'd just bite the bullet and get a replacement battery, since a bulging battery is a fire hazard. If you mean the charger PORT, I believe replacements are cheap online and (kinda) easy to install.