The foods that you eat come in contact with the germs and bacteria that live in the mouth. If you don't brush, plaque will accumulate on the teeth. Plague thrives on the starches and sugars that are found in a great deal of foods. When plaque combines with the sugars and starches, an acid is produced that attacks enamel on the teeth, and eventually causes decay.