Broadside
AT A GLANCE
There was a need to send out account statements and other notifications at volumes exceeding 1 million a day, from one client alone. Normal corporate email systems were all incapable of handling these volumes. A large, scalable mass email sending system was required.
Broadside
AT A GLANCE
There was a need to send out account statements and other notifications at volumes exceeding 1 million a day, from one client alone. Normal corporate email systems were all incapable of handling these volumes. A large, scalable mass email sending system was required.
Challenges, not problems
The system needed to take emails and templates in various formats, process them, and send them out. It needed to keep track of each email, with exact status of what happened to it. It needed to scale by just adding servers. And it needed detailed ad hoc reports.
Solutions,not ideas
We built a system which was horizontally scalable from Day 0, automatically distributing mail traffic and log processing workloads across all nodes in the cluster. Every event on every email is tracked and updated in system logs. A Solr cluster holds the logs, pushing out archives to AWS S3.
Challenges, not problems
The system needed to take emails and templates in various formats, process them, and send them out. It needed to keep track of each email, with exact status of what happened to it. It needed to scale by just adding servers. And it needed detailed ad hoc reports.
Solutions,not ideas
We built a system which was horizontally scalable from Day 0, automatically distributing mail traffic and log processing workloads across all nodes in the cluster. Every event on every email is tracked and updated in system logs. A Solr cluster holds the logs, pushing out archives to AWS S3.