This might be unconventional, but how about:
* create two partiations.
* Put damn small Linux on one (50M, designed to boot from credit card CD, so
already doesn't keep logs etc). Leave a bit of room for extra software.
* Put home dirs etc on the other partition.
If you have a fair bit of ram boot using the --toram switch, since it's so
damn small.