From what I understand, silent payments only gives the sender the ability to generate addresses that the receiver can pull Bitcoin from. So it protects the receiver, but it does not protect the sender and it does not protect the amounts. This is a step in the right direction for Bitcoin, but it’s still nothing compared to Monero.
Edit: Instead of having the receiver manually have to give you a new address that’s fresh every single time you want to pay them. This automatically can generate new addresses to pay them without their input.
I do this and I use Proton as my email provider. I think as long as you set the email security standards, which Proton, for example, teaches you how to do, you should be fine.