Thank you all for the input. The truck is in decent shape for an 05. The previous owner replaced the rocker panels, since we live in Michigan. The design of those is poor as far as a way for water and salt to escape. Every one I've ever owned gets clogged with mud and the salty water just sits there. That repair alone cost him $2500. He also replaced many suspension parts as well as brakes and wheel hubs
I think I'm going to 'risk it' as far as any other repairs at this time. I'll clean up the scoring and reuse the camshaft. I did replace the oil pump without removing the pan. I tend to think as someone pointed out that most of the metal shavings would have gotten filtered out. Digging into it further by removing the oil pan doesn't make sense to me. If I remove some of the main and rod caps to see how they look and they look bad, I'd feel as if I had to replace the engine. I know it sounds counterintuitive, but IF the engines goes a later point then I would consider a crate/reman engine. I'm already $1100 into it and 10 labor hours. In my opinion it isn't prudent to invest anymore into an engine that I could just replace for a couple thousand more.
I flushed the pan with kerosene and used an inspection camera to check for any residue. I also poured the kerosene into the oil pickup tube from the top while I had the oil pump off. I did replace the pump with a Meling high volume pump as suggested. It wasn't easy to remove and replace the pick up bolts, but with a little patience, instruction from FordTechMakuLoco, and the right tools I did it!
The previous owner had already been using 5w-30 full synthetic instead of the recommended 5w-20. I will continue to use 5w-30. I plan on changing the oil and filter early in case the flushing with kerosene didn't clean it up 100%.
Thanks for the advice eveyone.