Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update release v0.1.2 #5

Closed
wants to merge 34 commits into from
Closed

Conversation

nuzant
Copy link
Collaborator

@nuzant nuzant commented Mar 11, 2025

No description provided.

nuzant and others added 30 commits February 27, 2025 11:36
… window and initial loss scale.

Merge branch fw/loss-scale of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/2

Signed-off-by: 晓雷 <[email protected]>


* .
different seeds for every epoch & every rank
Merge branch whj/fix-dataloader of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/3

Signed-off-by: 晓雷 <[email protected]>
Merge branch fw/fix-dataloading-not-shuffle of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/4

Signed-off-by: 晓雷 <[email protected]>


* fw/fix-dataloading-not-shuffle
* .
* .
* .
…vLLM generation.

Merge branch fw/vllm-key-value-alloc of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/7?tab=commit

Signed-off-by: 晓雷 <[email protected]>


* .
* remove pring
Merge branch fw/balanced-datapck of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/5

Signed-off-by: 温差 <[email protected]>


* .
* fw/fix-dataloading-not-shuffle
* .
* .
* .
* .
* .
Merge branch math_verifier_timeout of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/8

Signed-off-by: 博惟 <[email protected]>


* debug: math verifier timeout
* debug: math verifier timeout
* timeout in math_verify_utils
* format
…ecover.

Merge branch fw/fix-recover-filter of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/10

Signed-off-by: 晓雷 <[email protected]>


* .
* cleanup
* cleanup
Merge branch update-tutorial of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/12?tab=comment

Signed-off-by: 晓雷 <[email protected]>


* support setup env and start train
* update tutorial
* update training script
Merge branch fw/update-requirements of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/14

Signed-off-by: 晓雷 <[email protected]>


* format and update requirements.txt
* cleanup
Merge branch 0304-7b-zero-readme of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/13

Signed-off-by: 晓雷 <[email protected]>


* update 7B zero figures
* update readme
* update amc
* update readme
* Delete Data Comparison
* typo
* update figures
* fix typo
…and memory allocation

Merge branch ranghou-math of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/15?tab=diff

Signed-off-by: 晓雷 <[email protected]>


* support specifying number of gpus and mems for actors
* PR fix
Merge branch mzy/auto-eval of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/11

Signed-off-by: 博惟 <[email protected]>


* test
* move evaluator to main process
* .
* clear codes
* add docstring
* .
* separate wandb groups
* .
Merge branch ranghou-math of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/18

Signed-off-by: 晓雷 <[email protected]>
Signed-off-by: 博惟 <[email protected]>


* support specifying number of gpus and mems for actors
* PR fix
* support tensorboard
* bug fix
* add doc
…support

Merge branch fw/uvloop of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/6

Signed-off-by: 晓雷 <[email protected]>


* .
* fw/fix-dataloading-not-shuffle
* .
* .
* .
* .
* .
* add v2 master worker
* cpu test pass
* ppo run
* .
* format
* fix
* merge and format
* change default env vars to v1 worker
Merge branch functioncall-code of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/17

Signed-off-by: 晓雷 <[email protected]>


* test code evaluation with faas
* support functioncall for code
* fix code crash bug
* format
* .
Merge branch fw/datatransfer-v2 of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/9

Signed-off-by: 晓雷 <[email protected]>


* .
* fw/fix-dataloading-not-shuffle
* .
* .
* .
* .
* .
* add v2 master worker
* cpu test pass
* ppo run
* .
* pass sft test
* pass ppo dp test
* format
* fix
* run
* .
* cleanup
* .
* format
* run
* merge and format
* refactor
* sft pass
* .
* format
* format
* format
* .
* .
Merge branch fw/fix-timeutil-recover of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/21

Signed-off-by: 步偶 <[email protected]>


* fix timeutil consistency during recover
Merge branch mzy/fix-slurm of [email protected]:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/23

Signed-off-by: 博惟 <[email protected]>


* fix slurm + singularity environment
@nuzant nuzant closed this Mar 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants