No man proved a more worthy opponent to Ulysses S. Grant than Confederate General Robert E. Lee. Lee was born the fourth child of Colonel Henry Lee and Ann Hill Carter on January 19, 1807.