File:Densing Law of LLMs, Figure 2.png
Jump to navigation
Jump to search
Size of this preview: 800 × 388 pixels. Other resolutions: 320 × 155 pixels | 640 × 310 pixels | 1,024 × 497 pixels | 1,660 × 805 pixels.
Original file (1,660 × 805 pixels, file size: 251 KB, MIME type: image/png)
Summary
| Description |
English: Figure 2. The results for loss estimation and performance estimation. Here, the lines are fitted curves. X-axis in (a) refers to the pre-training compute, which is approximated by Compute = 6N D. Triangles in (b) are larger models for prediction. |
| Date | |
| Source |
https://arxiv.org/abs/2412.04315 [Submitted on 5 Dec 2024 (v1), last revised 6 Dec 2024 (this version, v2)] Densing Law of LLMs Chaojun Xiao, Jie Cai, Weilin Zhao, Guoyang Zeng, Biyuan Lin, Jie Zhou, Zhi Zheng, Xu Han, Zhiyuan Liu, Maosong Sun |
| Author | Chaojun Xiao, Jie Cai, Weilin Zhao, Guoyang Zeng, Biyuan Lin, Jie Zhou, Zhi Zheng, Xu Han, Zhiyuan Liu, Maosong Sun |
Licensing
This file is licensed under the Creative Commons Attribution 4.0 International license.
- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
|
This media file is uncategorized.
Please help improve this media file by adding it to one or more categories, so it may be associated with related media files (how?), and so that it can be more easily found.
Please notify the uploader with {{subst:Please link images|File:Densing Law of LLMs, Figure 2.png}} ~~~~ |
File history
Click on a date/time to view the file as it appeared at that time.
| Date/Time | Thumbnail | Dimensions | User | Comment | |
|---|---|---|---|---|---|
| current | 19:38, 21 February 2025 | | 1,660 × 805 (251 KB) | wikimediacommons>Cosmia Nebula | Uploaded a work by Chaojun Xiao, Jie Cai, Weilin Zhao, Guoyang Zeng, Biyuan Lin, Jie Zhou, Zhi Zheng, Xu Han, Zhiyuan Liu, Maosong Sun from https://arxiv.org/abs/2412.04315 [Submitted on 5 Dec 2024 (v1), last revised 6 Dec 2024 (this version, v2)] Densing Law of LLMs Chaojun Xiao, Jie Cai, Weilin Zhao, Guoyang Zeng, Biyuan Lin, Jie Zhou, Zhi Zheng, Xu Han, Zhiyuan Liu, Maosong Sun with UploadWizard |
File usage
The following page uses this file:
