Fuel Pump always humming

[MedMantle]

Okay, so after battling with some stripped torx-head bolts I managed to remove my rear seats and pryed that cover off. I'm not too sure how exactly I'm supposed to remove the pump though.. do I leave the pipes on or do I open the Fuel Cap to depressurize and remove the piping and connector before I turn off the round plastic top?

I've been driving around seatless and it feels quite good but the road noise is terrible. I had a mechanic friend listen to the noise but he couldn't identify it.

I have discovered something else. It only appears after driving for about a minute. I drove down my driveway and back up and while I was idle it slowly started to hum and the volume also progressively got louder. I also found that when I turn my steering wheel while Idling in Neutral that the sound goes away as the RPM drops slightly. My friend also found If he turns full lock that the sound sometimes does NOT return till we blip the accelerator. It sounds like it is coming from the Fuel Pump's location but now things are just getting weird :/