Neurips 2023
Jazmia Henry Jazmia Henry

Neurips 2023

This paper:

  • Explores work done by researchers since the original scaling laws paper and will revisit evidence of scaling laws’ veracity

  • Suggests that in cases of significantly large data sets that come from low quality data sources, scaling laws no longer hold true and instead the law of diminishing returns takes its place

  • Explores empirical investigations that show where scaling laws work and where they do not

  • Suggests ways we can consider scaling laws as a component of many predictors that can contribute to model performance while ensuring data quality is at the center of the power law.

Read More