wassname/peft
1
0 Fork 0
mirror of https://github.com/wassname/peft.git synced 2026-10-30 13:21:29 +08:00
Code Issues Packages Projects Releases Wiki Activity

Fix typo in examples/causal_language_modeling/peft_lora_clm_accelerate_ds_zero3_offload.py (#275) (#277)

Browse Source 
Co-authored-by: rmilleti <rmilleti@amazon.com>
This commit is contained in:
Robert Milletichandrmilleti authored and GitHub committed 2023-04-07 17:49:35 +02:00
1 parent 445940fb7b
commit 0422df466e
1 file changed
+1 -1
Download Patch File Download Diff File Expand all files Collapse all files
examples/causal_language_modeling/peft_lora_clm_accelerate_ds_zero3_offload.py
+1 -1
View File
@@ -267,7 +267,7 @@ def main():
tracemalloc.cpu_peaked + b2mb(tracemalloc.cpu_begin)
)
)
train_epoch_loss = total_loss / len(eval_dataloader)
train_epoch_loss = total_loss / len(train_dataloader)
train_ppl = torch.exp(train_epoch_loss)
accelerator.print(f"{epoch=}: {train_ppl=} {train_epoch_loss=}")