Prevent Customers from Showing in Multiple Email Segments

[cneagle]

I am currently making email segments so that we can make more targeted email blasts for our store. The issue I'm having right now is I don't want customers showing up in multiple email segments. For example, I have a segment for the Top 20 customers who have purchased and I have another segment for active users who have placed 1 or more orders. So, the top 20 customers are showing up in both those segments. 

Is there a way to exclude the top 20 segment customers from the active users segment?