XPS 9560 Left side overheating while plugged in.

So after years of using. I replaced my original battery just recently. The only issue I find with the old battery was I can't use my laptop when not plugged in because it drains too quick.

I ordered a replacement one from this local computer store. I noticed when my laptop is plugged in, the left side of the laptop gets really hot. The fans aren't really spinning like crazy and my system works smoothly though. This picture below is where it gets hot


This only happens when its charging, it's scary because I'm not even doing some heavy task but the heat is very noticeable. My old dying battery doesn't have this issue though. It only happened when I replaced my battery.

What I've tried so far:
-Tweak the power management on bios
-Tweak the power plan settings
-Uninstalled / Reinstalled GPU driver

So far nothing is working from what I saw from other forums.


UPDATE:
-I set the limit to stopped charging at 90% using the BIOS power management setting... and when the battery reach 90%, the heat stops... Still, while charghing below 90%... the heat is really noticeable.