I use thenewsletterplugin.com for my wordpress.
Can you confirm that all the clients emails are not stored in the WP data base but directly on the DB of the newsletterplugin ?
Newsletter is a totally self-hosted solution and all the data resides on your hosting space only. Even the diagnostic data can be enabled only by.a specific optin. We have absolutely no access to your subscribers list and related info.