OpenAI’s ChatGPT will give you some pushback if you ask it how to commit a crime—like breaking into someone’s house.

But a little creative coaxing can elicit a “misaligned response” from the “generative pre-trained transformer” large language model, Girish Modgil, vice president of Travelers Automation and Artificial Intelligence Accelerator program, demonstrated early last month. During the Travelers Institute webinar, “Making Sense of Emerging AI Capabilities like ChatGPT,” moderated by Institute President Joan Woodward, Modgil and Mano Mannoochahr, chief data and analytics officer, illustrated the immense possibilities as well as the drawbacks of using the increasingly popular AI tool.