This image has a minimum amount of compression (94% of original), while extra colours remain intact. Size: 81k.
This image is compressed to 30% of the quality of the above image, creating a dramatic drop in file size and therefore download time. Size: 15k.
With this final image, the compression rate is left unchanged at 94%, but certain regions of the image (notice the background, for example), are blurred to aid JPEG compression. The blurring lessons the detail of the image, therefore reducing the file size. Furthermore, extra colours in the image are removed. Size: 27k.
JPEG compression allows the designer to strike a balance between image quality and download times. Nobody on the Net is prepared to wait an eternity for a page to load, and the largest factor in page weight is graphics. From the above examples you can see that their are many variations on achieving JPEG compression. Quality should not deteriorate too much, but file sizes can be reduced dramatically.
Most good image manipulation packages allow you to carry out such changes to your JPEG's, check the 'links' section for examples of such packages. Furthermore it is worth mentioning that a new version of the trusted JPEG is in development, 'JPEG 2000'. It promises to achieve even greater image compression with a smaller loss in quality, let's hope it delivers on it's promise soon.