Yuri Frayman: Building application performance automation one step at a time
Seven-time founder and Cast AI CEO on why entrepreneurship never gets easier
How serious is the problem Cast AI set out to solve?
First, if you look at your P&L, cloud costs are usually among the top five expense lines — top two for some companies, top three for others. The second issue is an application’s performance and stability. What are human beings doing? They take an application at a moment in time and create the infrastructure for it. But an application evolves continuously. As you add more users, the application’s needs change, and staying on top of that is humanly impossible. It would mean working seven days a week, 24 hours a day. So DevSecOps engineers optimize it for performance at a set moment in time, but that doesn’t help the application’s ultimate performance.
Performance automation can do that, while allowing the DevSecOps engineers to focus on higher-value problems. It reduces cost and opens up additional budget for other investments.
You’ve always relied on automation. Did generative AI help take it to the next level?
Yes. Before generative AI, we could automate app performance and how the app interacted with a database. Does it need more CPUs? Or different kinds of CPUs? Or more memory? Since we introduced a large language model, we can analyze all the metrics and suggest changes in the application’s source code to make it more efficient.
Generative AI allows us to create a test environment, where we can make the code changes, and test the hypothesis of how to improve that application. And it sends the results back to the developer for review. So now the application developer doesn’t have to spend time working on the maintenance of the application, and can be writing other code.