Jacob Coxon, a 27-year-old AI researcher who has worked at both OpenAI and Anthropic, is leaving the AI field. He accuses both American companies of gambling with human lives by simultaneously developing superintelligence—AI systems capable of self-improvement—in an irresponsible manner.

Evan Hubinger, Anthropic's security executive, also supports the view that AI poses a risk of human extinction. Anthropic's decision to abandon its commitment to halt operations if it cannot control risks is concerning to competitors, as they worry rivals will dominate the market. Coxon believes no company can responsibly develop superintelligent AI without government involvement or collaboration.

Due to these concerns, over 1,000 technology sector employees have urged the U.S. government to slow down advanced AI system development. OpenAI paused model training for two weeks in August and tightened controls before resuming. Currently, American lawmakers have introduced legislation to halt AI advancement until a federal AI oversight body is established.

Ref: Bangkok Post