Inactive users list not updating even when user has a recent last action date

Hi !
I’ve created a list of more than 6 months inactive users, sent them an email asking them to reply to it if they still want to receive my newsletters. Some of them did reply, or did read the email, and have a new “last action date”. But they will still appear in the “more thant 6 months inactive users”, even if I update the list on the maintenance page.
Is it normal ? Do I have to remove them from the list manually ? Or am I missing something ?