Whenever I apply an action (ex. sending a test message) the dialog shows briefly but dissapears within moments, making it impossible to read what’s going wrong (or right, for that matter)…
You probably have another plugin interfering with Newsletter since the messages are not removed by Newsletter. Try disable other plugins if possible to find the one which is causing the issue.