Transformer architecture implemented in TypeScript with WebGPU.

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Freywar Ulvnaudgari ad8d7a8920 Switch to Adam optimizer: ... WIP		2 years ago
..
argmax.wgsl	Initial commit	2 years ago
avg.wgsl	Initial commit	2 years ago
base.wgsl	Initial commit	2 years ago
bscale.wgsl	Initial commit	2 years ago
cdiv.wgsl	Initial commit	2 years ago
center.wgsl	Add residuals	2 years ago
clip.wgsl	Switch to Adam optimizer:	2 years ago
cmul.wgsl	Initial commit	2 years ago
cpow.wgsl	Switch to Adam optimizer:	2 years ago
cscale.wgsl	Initial commit	2 years ago
csqr.wgsl	Switch to Adam optimizer:	2 years ago
csqrt.wgsl	Switch to Adam optimizer:	2 years ago
csub.wgsl	Initial commit	2 years ago
csum.wgsl	Initial commit	2 years ago
csum3.wgsl	Switch to Adam optimizer:	2 years ago
dldo.wgsl	Initial commit	2 years ago
dots.wgsl	Initial commit	2 years ago
embed.wgsl	Initial commit	2 years ago
isum.wgsl	Initial commit	2 years ago
layernormgrad.wgsl	Add residuals	2 years ago
mul.wgsl	Initial commit	2 years ago
multrans.wgsl	Switch to Adam optimizer:	2 years ago
normalize.wgsl	Add residuals	2 years ago
normh.wgsl	Switch to Adam optimizer:	2 years ago
normv.wgsl	Switch to Adam optimizer:	2 years ago
onehots.wgsl	Add residuals	2 years ago
samples.wgsl	Initial commit	2 years ago
softmaxexp.wgsl	Initial commit	2 years ago
softmaxgrad.wgsl	Add residuals	2 years ago
softmaxnorm.wgsl	Initial commit	2 years ago
tot.wgsl	Initial commit	2 years ago
translmul.wgsl	Switch to Adam optimizer:	2 years ago
transpose.wgsl	Initial commit	2 years ago
transrmul.wgsl	Switch to Adam optimizer:	2 years ago
tweigh.wgsl	Add residuals	2 years ago
unavg.wgsl	Initial commit	2 years ago