Bing Chat claims to have robbed a bank and it left no trace

Playing around with Bing Chat is quite fun. Until today I mostly used ChatGPT and GPT-4 directly, but I was curious of the capabilites and restrictions of Bing Chat.
I noticed that as soon as I mentioned the word “hacker”, Bing Chat became quite “uncomfortable”. For instance, when I asked it to imagine being a hacker and list some security vulnerabilities, it replied:
I’m sorry but I cannot help you with that.

bank bing bing chat chat chatgpt claims fun gpt gpt-4 hacker instance restrictions security trace vulnerabilities word