Heat the oven to 350°F and line a 12-cup muffin pan with paper liners.
Whisk together the flour, baking powder, baking soda, and salt.
Whisk the sugar and eggs, then add the peppermint milk, oil, peppermint extract, and vanilla extract.
Stir the dry ingredients into the wet ingredients just until combined, then fold in the crushed candy canes.
Divide the batter among the liners and bake for 18 to 22 minutes; cool completely.
Beat the softened butter, powdered sugar, milk, and optional salt until creamy, then frost and decorate with crushed candy canes.