The paradox of the "scaling laws" for large models: The stronger RL (reinforcement learning) becomes, the further AGI (artificial general intelligence) seems?
In the race towards Artificial General Intelligence (AGI), the currently most sought-after path—Reinforcement Learning (RL)—may be leading us astray. The stronger RL becomes, the further we may actually be from true AGI.
On December 24, renowned tech blogger and Dwarkesh Podcast host Dwarkesh Patel released a thought-provoking video,