Have you ever used your coffee grinder to grind fresh chiles or other fresh spices? Don't look at me like I'm crazy - for the freshest tasting chile powder and other spices, it's worth grinding your own at home.
The problem, though, arises when your next morning cup of joe has a nice kick from the leftover spice. How to solve it? Grind a handful of toasted-oat cereal or torn bread pieces for about 30 seconds. This will absorb the leftover flavor and odor of the chiles or spices.