Bitter and non-bitter almonds are similar in appearance. They both have brown skin and off-white colored insides. Bitter almonds are usually smaller and more pointed than sweet almonds. They also have an astringent and bitter flavor.  Usually the oil is extracted from the bitter almond and used to make almond butter, flavored liqueurs or almond extracts. The bitter almond has a stronger almond scent, which is why it is often used to make almond soaps, lotions or fragrances.