Intel Graphics Driver off when switched to Second Screen

I have been trying to set up my tv as my primary display to play games. When I select project only second screen, the graphics driver automatically switches to my Nvdia graphics. Now this would not have been a problem, but when I try playing games, it suddenly shutters in middle of game and the frame drops from 200 to 21. I feel maybe the graphics drivers are creating a problem. Is there a way to fix this??

Using Dell Inspiron 7567 i5

Samsung TV UA48J5300