Refocusing a Feature
We improved the usabilty of SendGrid's most frequently used feature and, in the process, added a bump to the bottom line.
The Email Activity Feed is the most heavily used UI feature in SendGrid. Originally incepted as a lightweight querying interface to our email event stream, it evolved to become the go-to troubleshooting tool when email wasn't reaching intended recipients.
But popularity has a price. It was used in ways beyond its original intent and, as a result, soon became heavily criticized for its limitations. It was clear from onboarding research and other feedback channels that we needed to redesign this from the ground up, focusing on user goals at the forefront.
Identifying the "What?"
We had no shortage of in-app feedback for the feature. This provided a solid basis to start understanding how people were using the feature.
My first step was to make sense of the disparate things we were hearing. I exported the data and started categorizing it by themes.
Note: A lot of feedback pointed to unmet needs elsewhere in the product, which I passed along to other product managers.
Digging into the "Why?"
Armed with clues for the most nagging problems, we conducted 1:1 interviews with users. Here, we sought to understand the contexts they were troubleshooting and what information they needed.
As is often the case, user requests didn't need to be taken at face value. Through laddering we uncovered root causes that helped us articulate the problem while opening the door to a variety of solutions.
I presented these findings to gain buy-in for the project and to help build empathy with users.
Armed with these insights (and with executive support), we formed an engineering team and kicked off the project. During this, I facilitated a design studio based on the themes identified earlier. After briefing stakeholders on the research, we sketched solutions for a few different scenarios of use.
We discussed the designs and riffed on each others ideas, eventually winnowing down to a few strong concepts. Because the team was involved in the design phase, they understood the value and were invested in the solution.
Moving to low-fidelity
Building off of the ideas generated in the studio, I started wireframing alongside engineers and product managers. These initial iterations were quite crude, often just chunks of UI laid out on a page. But they were concrete enough to convey ideas, have meaningful discussion, and build shared understanding.
Testing with users
As our confidence in the solution increased, so did the fidelity of the designs. Throughout this period, we continued to usabilty test and iterate.
We then moved into a build that customers could use. Early into the process we started inviting users—first through a feature-flagged closed beta and later an opt-in open beta. For a few weeks, we ran both experiences in parallel. This let us understand how users reacted to the new design, while not forcing them to cut over immediately. It also gave our engineers time to tune the performance.
Final Design — Search
The main entrypoint remains the search page. From here, users can execute simple, common queries or conduct ad-hoc searches based on more esoteric metadata.
Critically, the results are grouped by email. Previously, events were returned chronologically, which made it hard to piece together what happened to a single email.
Note: Each email emits 4+ events like sent, delivered,received, opened, and/or clicked. When you send more than 1 email, these get mixed together in the log files.
Grouping results by email while allowing ad hoc searching, at scale, is a computationally (and financially!) expensive query. But clear user feedback early on backed up this design decision.
Final Design — Email Detail
On the detail page, users could view detailed information about each email. An important UI feature is the "timeline." In early research, we found that users didn't have a strong mental model about when or where events occur during the lifetime of an email. This pattern helps them pinpoint where problems (if any) are occurring.
The Event History timeline helps users isolate exactly where issues occur.
To help demystify events, I wrote humane, action-oriented interpretations to the server responses.
A card-based architecture accommodates dozens of event types, each with varying details.
Final Design — Upgrade
Users could upgrade to retain longer periods of history. Pricing was calculated based on the user's current plan.
The improvements have been widely acclaimed—a testament to our crisp understanding of user needs.
@sendgrid oh my goodness the new activity panel 😍
This update is freaking awesome. Thank you!
The new activity feed is your best update so far!
I just want to say... it's about darn time and thank you, thank you, thank you. You just made my life a whole lot easier.
Activity Feed beta is amazing! Thank you so much for implementing ... this makes it absolutely perfect.
I like the visual changes as well and it helps us track down delivery issues vs. the previous interface. Please tell the team a big thank you!