Jim, Audacity will cover at least the first two items above. I can't speak for the third. It's open source, so the price is right, and is available on Windows, Unix/Linux, and MacOS X.
That's about what I can think of for now. I'd be interested
in information about good products to help with any of the
tasks I've described, but the ones I consider most important
are
* doing the initial capture to WAVE format,
* cutting some of the tape hiss and transport noise, and
* applying and labelling index marks so that I can jump
quickly to whatever segment I want to listen to, without
a lot of fast-forwarding, overshooting, rewinding, etc.