Code

add bloom models#73

Code

Open

ydli-ai wants to merge 41 commits intoTencent:mainTencent/TencentPretrain:mainfrom fengyh3:feat_bloomfengyh3/TencentPretrain:feat_bloomCopy head branch name to clipboard

Commits

Commits on Nov 24, 2022

• bug fix

  ydli-ai

  committed
  f21223a

  Copy full SHA for f21223a

Commits on Nov 25, 2022

• Merge branch 'main' of https://github.com/Tencent/TencentPretrain

  Show description for cf74ac6
  ydli-ai

  committed
  cf74ac6

  Copy full SHA for cf74ac6

Commits on Dec 1, 2022

• Merge branch 'main' of https://github.com/Tencent/TencentPretrain

  ydli-ai

  committed
  efc6539

  Copy full SHA for efc6539

Commits on Dec 14, 2022

• Merge branch 'main' of https://github.com/Tencent/TencentPretrain

  ydli-ai

  committed
  9fe4f32

  Copy full SHA for 9fe4f32

Commits on Jan 4, 2023

• Merge branch 'main' of https://github.com/Tencent/TencentPretrain

  ydli-ai

  committed
  6baa170

  Copy full SHA for 6baa170

Commits on Mar 7, 2023

• Merge branch 'main' of https://github.com/Tencent/TencentPretrain

  ydli-ai

  committed
  ec90e5e

  Copy full SHA for ec90e5e

Commits on Mar 16, 2023

• Merge branch 'main' of https://github.com/Tencent/TencentPretrain

  ydli-ai

  committed
  a1047b7

  Copy full SHA for a1047b7

Commits on Mar 30, 2023

• Merge branch 'main' of https://github.com/Tencent/TencentPretrain

  ydli-ai

  committed
  3816b6b

  Copy full SHA for 3816b6b

Commits on Apr 2, 2023

• add lora for pretrain.

  fengyh3

  committed
  a0e7c8f

  Copy full SHA for a0e7c8f

Commits on Apr 3, 2023

• add lora for decoder and fix some bug.

  fengyh3

  committed
  ffc42e6

  Copy full SHA for ffc42e6

Commits on Apr 4, 2023

• fix lora deepspeed save model.

  fengyh3

  committed
  0f3c195

  Copy full SHA for 0f3c195

• Merge pull request #1 from fengyh3/dev

  Show description for 7deba29
  fengyh3

  authored
  7deba29

  Copy full SHA for 7deba29

• Dev (Tencent#5)

  Show description for c11f465
  

  ydli-ai

  and

  fengyh3

  authored
  c11f465

  Copy full SHA for c11f465

• Llama v2 (Tencent#6)

  Show description for de2e59a
  

  ydli-ai

  and

  hhou435

  authored
  de2e59a

  Copy full SHA for de2e59a

• add zero3 load lora

  ydli-ai

  committed
  c5979a8

  Copy full SHA for c5979a8

• add llama config

  ydli-ai

  committed
  05a8cda

  Copy full SHA for 05a8cda

Commits on Apr 5, 2023

• add llama config

  ydli-ai

  committed
  d732942

  Copy full SHA for d732942

• add llama config

  ydli-ai

  committed
  143c3aa

  Copy full SHA for 143c3aa

• add llama config

  ydli-ai

  committed
  7b92d3d

  Copy full SHA for 7b92d3d

• add llama config

  ydli-ai

  committed
  834c1c3

  Copy full SHA for 834c1c3

• add llama config

  ydli-ai

  committed
  c8ca114

  Copy full SHA for c8ca114

• add llama config

  ydli-ai

  committed
  6747460

  Copy full SHA for 6747460

• add llama config

  ydli-ai

  committed
  35edf4c

  Copy full SHA for 35edf4c

• add llama config

  ydli-ai

  committed
  81fb0e4

  Copy full SHA for 81fb0e4

• add llama config

  ydli-ai

  committed
  c36d3ee

  Copy full SHA for c36d3ee

• add llama config

  ydli-ai

  committed
  dfaf694

  Copy full SHA for dfaf694

• add llama config

  ydli-ai

  committed
  caa93bc

  Copy full SHA for caa93bc

• add llama config

  ydli-ai

  committed
  82a2794

  Copy full SHA for 82a2794

• add llama config

  ydli-ai

  committed
  eed09ee

  Copy full SHA for eed09ee

• add llama config

  ydli-ai

  committed
  3142668

  Copy full SHA for 3142668

• Merge branch 'main' into lora

  ydli-ai

  authored
  1255800

  Copy full SHA for 1255800

• add llama config

  ydli-ai

  committed
  4a774f0

  Copy full SHA for 4a774f0

• add llama config

  ydli-ai

  committed
  e78ce16

  Copy full SHA for e78ce16

Commits on Apr 7, 2023

• add llama config

  ydli-ai

  committed
  85600fb

  Copy full SHA for 85600fb

• add llama config

  ydli-ai

  committed
  af7d1c8

  Copy full SHA for af7d1c8

• add llama config

  ydli-ai

  committed
  038e58c

  Copy full SHA for 038e58c

• add llama config

  ydli-ai

  committed
  1f44866

  Copy full SHA for 1f44866

• add llama config

  ydli-ai

  committed
  02924b7

  Copy full SHA for 02924b7

• Merge pull request #2 from ydli-ai/lora

  Show description for 974ddf0
  fengyh3

  authored
  974ddf0

  Copy full SHA for 974ddf0

Commits on Apr 10, 2023

• Merge branch 'Tencent:main' into main

  fengyh3

  authored
  b42c0db

  Copy full SHA for b42c0db

Commits on Apr 16, 2023

• add bloom

  fengyh3

  committed
  cc0fa81

  Copy full SHA for cc0fa81