Boldin

Fintech

Startup

AI

AI Insight Summary

Role

Role

design lead

design lead

team

team

CTO, CPO, design team,
eng (fe & be), qa

CTO, CPO, design team,
eng (fe & be), qa

CTO, CPO, design team, eng (fe & be), qa

Superlative

Superlative

most likely to succeed

most likely to succeed

With AI being everything, everywhere, all at once we wanted to be deliberate about where it fit for our audience. Our users had an appetite for AI, but do they trust it with their real data in our planner? We had to find out.

For this beta feature, 3 questions came to mind:

  1. Is this helpful and did our audience want it?

  2. What's the setup, cost, and maintenance?

  3. Will it drive upgrades?

Hint: Yes, worth the ROI, and yes.

Sept – Nov 2025

Free Trial rate

0
1
2
3
4
5
6
7
8
9
.
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
%

Second highest converting feature

Beta users

0
1
2
3
4
5
6
7
8
9
,
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9

In test

Two Design Concepts

The page-level summary was selected for Phase 1 to contain cost and effort during the test. It also allowed the team to validate whether AI Insight Summaries drive engagement at all before investing in more granular chart-level experiences.

Per chart summary

Each individual chart on an Insight page gets its own AI summary button. Generates highly specific context per data point.

pros

  • Granular, chart-specific context

  • Richer Amplitude data on pain points

  • Surfaces hidden user confusion

Cons

  • 13–16 prompts per page

  • Higher LLM cost at scale

  • Complex tracking setup

Page-Level Summary

One AI summary per Insight page, surfaced via a prominent CTA. Covers all charts in context with user-specific financial details.

pros

  • 1 prompt per page cost efficient

  • Lower engineering effort

  • Holistic narrative for the user

Cons

  • Less chart-specific detail

  • May miss power user needs

  • Single summary may not catch all

Per chart summary

Page level summary

Control vs Beta

Page views & engagement

Users who saw AI Insight Summaries visited Insight pages at higher rates than those who didn't (control). Every page showed a lift with some nearly doubling.

Taxes

+
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
%

7.27 → 14.62 avg views

Savings

+
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
%

6.17 → 13.12 avg views

Income & expenses

+
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
%

5.68 → 10.28 avg views

Chance of success

+
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
%

5.81 → 8.36 avg views

Withdrawals

+
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
%

4.82 → 7.88 avg views

LIfetime Income proj.

+
0
1
2
3
4
5
6
7
8
9
0
1
2
3
4
5
6
7
8
9
%

4.15 → 5.66 avg views

Users didn't just glance at these pages, they returned to them to re-examine their plan and explore more deeply rather than bouncing.

superlative

Most likely to succeed

We killed AI Insight Summaries. Dead.

Ok, ok – what we saw was amazing. Our audience had a hunger for AI and after reviewing the cost and engagement, we decided to implement AI throughout the planner with a new AI Planner Assistant (details to come).

Allegedly, I'm pretty good.

Allegedly, I'm pretty good.

Zenia has shown strong judgment in balancing the needs of current customers with opportunities to engage potential audiences. Her ability to weigh multiple perspectives ensures that initiatives are both customer-centric and strategically aligned.

brendan t.

growth marketing manager

Boldin

Zenia is a leader within the design team, often tackling the most complex user flows, such as the scenario work, where her involvement has been essential.

Patrick H.

Product Manager

Boldin

Zenia is often the designer who tackles the most complex, hairy problems the design team has. She has worked hard to understand our data model, technical constraints, business perspectives, and is able to design solutions that take all of that into account. 

Rachel D.

Frm. Head of Design & Manager

Boldin

Zenia O'Leary

Design leader / Growth / Strategy

Zenia O'Leary

Design leader / Growth / Strategy

Zenia O'Leary

Design leader / Growth / Strategy