Microsoft ignored safety problems with AI image generator, engineer complains

Microsoft ignored safety problems with AI image generator, engineer complains

Shane Jones, identified as a principal software engineering manager, revealed in his letter that despite internal awareness of systemic issues with Copilot Designer, Microsoft had not taken adequate action. He emphasized that the tool's unrestricted use led to the generation of inappropriate images, including instances of sexual objectification, even with unrelated prompts. Jones specifically mentioned an alarming example where the prompt "car accident" resulted in an image of a woman in underwear kneeling in front of a car. The engineer criticized Microsoft's promotion of Copilot Designer as accessible for public use, arguing that it fails to disclose inherent risks associated with the tool.



Microsoft, in response, refuted claims of neglecting safety concerns, asserting the existence of robust internal reporting channels for handling issues related to generative AI. The company maintained its commitment to addressing employee concerns in accordance with company policies. While acknowledging Jones's efforts to study and test the technology, Microsoft emphasized its dedication to enhancing safety measures.



This development raises questions about the responsibility of companies developing AI tools, especially when they have the potential to generate harmful and inappropriate content. It underscores the ongoing challenges in ensuring the ethical use of AI and the importance of robust safeguards in AI applications.