Navigating the AI Frontier: Secure Adoption of LLMs in FinTec
Room B | Mon 20 Jan 1:30 p.m.–2:15 p.m.
Presented by
-
Rob Kenefeck
https://www.linkedin.com/in/robkenefeck/
Rob is a Principle Consultant @ControlPlane - He likes to talk about how Security is fundamental to DevOps, how Kubernetes often isn't the best answer to your problem and his lived experience of SRE.
Rob has been automating toil in Linux for more than 20 years, but was initially dismissive of Kubernetes when it first came along - as an adopter of containerisation with Docker and orchestrating through scripts. Since then, Rob has come to appreciate all it can do and also the limitations of it. Rob has been teaching DevOps and Kubernetes course while also helping large enterprises setup internally managed Kubernetes platforms with a product based mindset.
Rob Kenefeck
https://www.linkedin.com/in/robkenefeck/
Abstract
ControlPlane has been a member of FINOS (FinTech Open Source Foundation) since 2022, and are part of the core team for the AI Readiness Initiative. Rob recently joined ControlPlane and was captivated by this AI journey, having been a skeptical consumer of the gimmicks LLM offered. Having heard multiple stories of insecurely implemented LLM’s, Rob became interested in how the ‘best practise’ for securing them was being developed.
The FINOS Simple AI Governance framework provides threat enumeration for LLM-based applications in financial services. By collaborating to identify common use cases and common pitfalls, the framework enhances security for everyone whose data is handled by these systems. The Working Group is in its early stages, and have some draft frameworks which are still being developed, but there are already some key lessons that have been identified.
AI has become increasingly popular the last few years, and the existing frameworks that financial services organisations have for managing AI models, model development and deployment aren’t compatible with the rapidly emerging generative AI models. If security is not considered up front, and learnings/discovery is closed to individual enterprises, it will take much longer to get up to speed.
This talk discusses the current state, and what common lessons there are to learn about it.
ControlPlane has been a member of FINOS (FinTech Open Source Foundation) since 2022, and are part of the core team for the AI Readiness Initiative. Rob recently joined ControlPlane and was captivated by this AI journey, having been a skeptical consumer of the gimmicks LLM offered. Having heard multiple stories of insecurely implemented LLM’s, Rob became interested in how the ‘best practise’ for securing them was being developed. The FINOS Simple AI Governance framework provides threat enumeration for LLM-based applications in financial services. By collaborating to identify common use cases and common pitfalls, the framework enhances security for everyone whose data is handled by these systems. The Working Group is in its early stages, and have some draft frameworks which are still being developed, but there are already some key lessons that have been identified. AI has become increasingly popular the last few years, and the existing frameworks that financial services organisations have for managing AI models, model development and deployment aren’t compatible with the rapidly emerging generative AI models. If security is not considered up front, and learnings/discovery is closed to individual enterprises, it will take much longer to get up to speed. This talk discusses the current state, and what common lessons there are to learn about it.