Welcome to the site. The 2003/2004 have issues with the central junction box(cjb) fuel pump circuit. I would check your wiring to see if it has been bypassed so that the pump comes on with the key instead of being controlled be the pcm. The other possibility is a failing ignition switch & key cylinder.
The cjb is located behind the right kick panel.
Can you read/understand wiring diagrams?