Components can be marked inactive in Bugzilla, which I believe will prevent users from filing new bugs without losing any historical data. Perhaps this should be part of the retirement process?