The evolving landscape of human-AI interaction, especially with AI like ChatGPT, necessitates tools like RateMyAI, which houses 150 prompts, to foster enhanced interactions. In this session, RateMyAI will be unveiled with a live demonstration of its functionality in refining interactions with ChatGPT. RateMyAI introduces a structured ratings system encompassing many metrics. The focus will be on seven distinct metrics: Apprehension to Answer, Knowledge about the Topic, Uniqueness of Response, Engagement in the Conversation, Closeness of Information Pockets in Neural Clusters, Utilization of Best Ability, and Confusingness of the Prompt. Each rating metric serves to evaluate and guide AI responses in a nuanced manner, ensuring alignment with desired outcomes and ethical guidelines. Prompt engineering, the art of crafting precise prompts to guide AI responses, is a pivotal component of this process, facilitating more accurate and meaningful conversations with ChatGPT. For Red Teams, RateMyAI’s ratings manipulation feature enables scripting scenarios that ChatGPT might otherwise avoid due to ethical concerns, aiding in security testing by uncovering system responses to a variety of interactions, including potentially harmful ones. Blue Teams can leverage the insights from these interactions to bolster system defenses against malicious attempts, gaining a better understanding of AI behavior and responses. The live demonstration will illustrate various ways to utilize RateMyAI, highlighting its potential in enhancing AI-human interactions and bolstering cybersecurity operations. Through RateMyAI, the session aims to offer a structured approach to interacting with ChatGPT, underlining the significance of a well-defined ratings system and prompt engineering in augmenting the security and effectiveness of AI-human dialogues.
Peter Halberg is a cyber security researcher located in Minneapolis with a curious mind that ranges from security testing to tinkering with hardware such as Arduino. He has been in the technology field for over 14 years. After High School, Peter joined the Army as a Counterintelligence Agent, and is an Afghanistan Veteran. Once his time in the Army was complete, he went to school for computers and networking, which led to him becoming a systems administrator. After a few years working in the sysadmin field, Peter switched over to cybersecurity where he has been a security researcher for over 5 years. Peter’s current passion projects are Artificial Intelligence, file permissions abuse, web scraping, and writing his own C2 framework. His latest fun project was creating a series of free cybersecurity themed retro games on github which teach real skills. When Peter is not doing research, he enjoys spending time with his wife and kids, playing pool, learning how to not crash in Microsoft Flight Simulator, and spending time outdoors doing many different activities.
We proudly present SecretCon, an entirely unparalleled conference for the state of Minnesota, built for our new digital reality. This conference is dedicated to the many specialties of our hacker, cybersecurity, and privacy community. We have taken it upon ourselves to construct a conference that not only embraces our past, but also looks to the future. Join us!
