The Pond

Search

  • About me
  • My research
  • Random post
  • All posts
  • Open source
  • Subscribe

Tag: specification gaming

7 items with this tag.

  • 12/23/2025

    Recontextualization Mitigates Specification Gaming Without Modifying the Specification

    • specification gaming
    • mats program
    • AI

  • 12/18/2025

    2025-Era “Reward Hacking” Does Not Show that Reward Is the Optimization Target

    • reinforcement learning
    • specification gaming
    • AI

  • 11/22/2025

    Output Supervision Can Obfuscate the CoT

    • reinforcement learning
    • specification gaming
    • mats program
    • AI

  • 6/19/2023

    Mode Collapse in RL May Be Fueled by the Update Equation

    • reinforcement learning
    • specification gaming
    • AI

  • 8/11/2022

    Seriously, What Goes Wrong with “Reward the Agent when It Makes You Smile”?

    • specification gaming
    • AI

  • 7/25/2022

    Reward Is Not the Optimization Target

    • reinforcement learning
    • specification gaming
    • shard theory
    • AI

  • 9/13/2019

    What You See Isn’t Always What You Want

    • reinforcement learning
    • specification gaming
    • AI