I have worked with Joomla! for a number of years and whilst in many ways it is an excellent content management system, it does still suffer from a common problem. A lot of CMSs get very bloated with extra (sometimes) unnessary code.
This bloating is often made worse when plugins or modules or components are installed.
One of my main objectives when working with Joomla! at the moment is to do as much as I can to remove some of this bloat.
// Remove a CSS File
I've only tested this in Joomla! 3 (which you should be using now anyway...)