Do not have much experience in this area, thus I can name only two companies I know as reliable and affordable.
VPSland.com - narrow specialization made them successful, I think.
and
Globaltap.com - full-fledged VPS for reasonable prices. Good company also.