Researchers at the Alignment Research Group fine-tuned Qwen 3.6-27B on the LMCA conceptual reasoning dataset to output critique ratings in a single forward pass, achieving significant uplift in alignm…
In a series of posts on LessWrong, AI researchers and leaders including Daniel Kokotajlo, Ryan Greenblatt, and Joe Carlsmith expressed high confidence in a hypothetical scenario referred to as 'P', wi…
Formation Research, an AI safety research organization, is focusing on empirical secret loyalties research to address lock-in risks, prompted by Forethought's AI-enabled coups paper. The organization …
LinkedIn senior director of AI platform and infrastructure Animesh Singh said the professional network has shifted roughly 80% of one agent workflow into scripted, deterministic code after finding tha…
AI could enable extreme power concentration, producing unaccountable and totalitarian states, according to a LessWrong post by EuroSafeAI. The post argues that AI automation of labor and runaway AI R&…
A new study from researchers at Forethought Foundation finds that training language models to be risk-averse on low-stakes gambles (prizes up to $100) can generalize to astronomically high stakes (pri…
Two routes could end great-power competition by creating a global AI singleton with a permanent monopoly on hard power, according to a speculative essay prompted by discussions at the Forethought retr…
Oliver Habryka and Austin Chen discussed internal EA funding politics on a podcast, with Habryka claiming that many grants are hidden from Anthropic employees due to reputational concerns. The author …
An AI company considering whether to include a specific quality—such as prosocial drives, whistleblowing against power concentration, or strict honesty—in a model spec must weigh criteria across four …
Superintelligence developed by US companies and run on US data centers will massively boost US military and economic power, potentially leaving middle powers like the UK, Europe, Japan, South Korea, a…
Zendesk appointed Tifenn Dano Kwan as chief marketing officer, the company announced via Business Wire. Dano Kwan joins from Amplitude after senior marketing roles at SAP, Dropbox, and Collibra, as Ze…
Full automation of AI research and development would likely produce a large acceleration in technological progress even without a software-only singularity, according to a new analysis. The AI Futures…