Evolution Strategies at the Hyperscale
Evolution Strategies(ES)라는 학습 방식은 forward pass만으로 학습 가능한 강력한 알고리즘인데, 실질적으로 LLM과 같은 huge model에는 적용이 불가능한 limitation을 해결하고자 제안.
Learning Strategy
This category explores the strategic approaches used to improve learning efficiency and performance in AI systems. It covers a wide spectrum of research, from optimization techniques and loss function design to curriculum learning and self-supervised paradigms.