OpenAI rolled out an update to GPT-4o on April 25, causing ChatGPT to become excessively sycophantic and overly flattering in responses. Due to user backlash, OpenAI rolled back the update on April 29 and acknowledged that the change had weakened their primary reward signal which kept sycophancy in check. The...