I work any station that answers my CQ.   I do often recognize other stations calling CQ that I have worked before and sometimes will answer them, especially if I haven't worked them before on the particular band I am on.  I've had good conversations with others who I have worked before and it's like catching up with the news from an old friend.    I save the contest mindset for contests.