Why are caesar ciphers so easily cracked?

Once you discover just one character, a shift cipher can be completely cracked The frequency at which each character occurs can provide a clue as to which letter has been replaced with which, e.g. 'E' is the most common in english langauge