I’ve been tracking the growing trend of using Generative AI within personal finance, and I recently came across a pair of fascinating CNBC articles discussing a new study published in the Journal of Financial Planning. The data shows a massive shift in how people approach their money, noting that roughly 66% of Americans (and up to 82% of Gen Z and Millennials) who use GenAI have leveraged it for financial advice.
However, the study—which tested seven major platforms including ChatGPT, Claude, and Gemini—raised some critical structural warnings that are worth discussing, especially for a data-conscious community like ours:
The Illusion of Authority: Andrew Lo, director of MIT’s Laboratory for Financial Engineering, noted a significant concern with LLMs: “no matter what you ask it, it’ll always come back with an answer that sounds authoritative, even if it’s not.”
The Precision Trap: The research explicitly pointed out that, counterintuitively, AI isn’t inherently great at crunching numbers or performing precise financial calculations. Asking it to run a numerical analysis on your own specific situation remains highly risky.
The Efficiency Gap: The process often devolves into an unstable sequence of trial and error—sometimes requiring more than 20 prompts—leaving the user with an output they still have to manually double- and triple-check against their actual data.
As a community that thrives on clean data pipelines, it makes me wonder: Why leave the deterministic, 100% accurate outcome of a structured database or spreadsheet for a probabilistic system that requires manual auditing and a 20-prompt guessing game?
Have you tried incorporating ad-hoc AI prompts into your financial workflows? Where do you draw the line between a helpful linguistic tool and a data integrity risk?
Would love to hear your thoughts!

