If you installed your AVIC-D3, without a rear camera, did you connect this wire or not? I'm wondering if its really necessary, or if I should not worry about hooking it up.

No it's not needed if you're not going to hook up a backup camera.

Hooked mine up to an N2 and made it more accurate. It no longer jumps and flips when i back up!