Despite its many advantages and benefits, there are some downsides of almond milk as well. Here is a look at a few of them.