Hardest part? The part where you actually make a picture. :P
Seriously, I'd say shading. I have a hard time visualising things in 3d, so I can never tell where the light and shadows should go. Even now I just guess at it 90% of the time.