InternEvo-v0.2.3dev20240201

What's Changed

• tool(transformers): update scripts for converting between the huggingface format by @x54-729 in #19
• Fix:(initialize) remove fix_seed for initialization by @li126com in #22
• Fix(StaticBatchSampler): fix statics of num_consumed_samples_in_epoch for ckpt by @li126com in #5
• support pip install InternEvo by @sallyjunjun in #26
• Feat(QA ckpt): check training loss when loading checkpoint by @li126com in #24
• docs/update project name to InternEvo and fix some en doc by @huangting4201 in #21
• test(workflow): change env by @kkscilife in #25
• feat(model): add LinearRotaryEmbedding by @gaoyang07 in #28
• test(case): add load ckpt then assert loss into ci by @kkscilife in #29
• Fix QA port: add free_port by @li126com in #30
• feat(third_party/flash-attention): update submodule flashattn to v2.2.1 by @huangting4201 in #31
• test(ci): optimize ci by @kkscilife in #27
• refactor(moe): refactor moe for extensibility by @blankde in #34
• Feat(QA): check only forward output when not using flash attention by @li126com in #39
• fix(moe): fix bugs with moe checkpoint by @blankde in #38

New Contributors

• @x54-729 made their first contribution in #19
• @li126com made their first contribution in #22
• @sallyjunjun made their first contribution in #26
• @blankde made their first contribution in #34

Full Changelog: v0.2.2dev20240118...v0.2.3dev20240201

InternEvo-v0.2.2dev20240118

What's Changed

• test(workflow): change reponame by @kkscilife in #4
• Merge main to develop by @huangting4201 in #17

New Contributors

• @kkscilife made their first contribution in #4

Full Changelog: https://github.com/InternLM/InternEvo/commits/v0.2.2dev20240118