← All talks

Illuminating Shadow AI: An Open-Source Tool for CustomGPT Risk Assessment

BSides Charm 202621:378 viewsPublished 2026-06Watch on YouTube ↗
Speakers
Tags
About this talk
Shadow AI adoption creates blind spots where employees expose IP and PII through custom LLMs like CustomGPT. This talk introduces GCI (CustomGPT Compliance Insights), an open-source tool that audits administrative APIs and applies regex patterns to hunt for secrets and sensitive data in unstructured chat logs. The session covers the underlying research and demonstrates identifying high-risk exposures that standard DLP tools miss.
Show original YouTube description
How comfortable are you knowing your company is using custom LLMs, like CustomGPT, with zero visibility into the sensitive data flowing through them? Organizations are racing to adopt AI, creating new blind spots faster than they can secure them. The reality is hundreds of shadow AI instances where employees inadvertently expose company IP and PII daily. This session introduces GCI (CustomGPT Compliance Insights), a new open-source tool built to solve this exact visibility gap. We will jump directly into the research behind the tool, dissecting the attack surface of administrative APIs and the specific regex patterns we developed to hunt for secrets in unstructured chat logs. We will demonstrate how the tool identifies high-risk exposures, from hardcoded credentials to sensitive PII, that standard DLP solutions often miss. You will leave with the source code in hand and a practical method to run your own audits and minimize these risks immediately. Sharon Shama Sharon has a strong background in defensive research, especially around emerging AI technologies and GCP environments. Off the clock, she channels that same curiosity into cooking, taking on kitchen challenges like beef Wellington and lemon pie.
[ feedback ]