Re: S2600GZ, What should I change the first?

I'd suggest you replace DIMM D1 first.

I think it should be OK to temporarily remove the DIMM from D1 slot. Just remember that for each CPU, all blue DIMM slots need to be populated before the black slots.