Preheat oven to 350 degrees F. Lightly grease a muffin tin with nonstick cooking spray or line with paper muffin liners.
In a small bowl, whisk together flour, baking powder and salt. Set aside.
In the bowl of a stand mixer, beat butter and sugar together until light and fluffy. Add eggs, vanilla, almond extract, and almond milk. Mix until combined. Add flour mixture and mix on low until just combined. Gently stir in the almonds and cherries.
In a small bowl, combine the almonds, brown sugar, flour, cinnamon, and butter. Mix together with your hands until crumbly.
Divide batter evenly into muffin cups. Sprinkle muffins with the almond streusel topping. Bake for 22 to 24 minutes, or until a toothpick inserted into the center comes out clean. Remove from oven and let muffins cool on a wire rack.
While the muffins are cooling, make the almond glaze. In a small bowl, whisk together the powdered sugar, milk, and almond extract. Drizzle the glaze over the muffins and serve!
Note-muffins will keep in an airtight container on the counter for up to 2 days. You can freeze the muffins for up to 1 month, but don't freeze with the glaze. Thaw the muffins and then add the glaze.