I'm afraid that the problem may be with your server - are you sure you are allowed to send emails with size exceeding 3MB.
If you are sure about it, turn on logging:
https://www.limilabs.com/blog/logging-in-mail-dll
Can you try disabling chunking:
using (Smtp client = new Smtp())
{
client.Configuration.EnableChunking = false;
...and pipelining:
using (Smtp client = new Smtp())
{
client.Configuration.EnableChunking = false;
client.Configuration.EnablePipelining = false;