wassname/peft
1
0
Fork 0
mirror of https://github.com/wassname/peft.git synced 2026-09-09 11:28:32 +08:00
Code Issues Packages Projects Releases Wiki Activity

Fix typo in examples/causal_language_modeling/peft_lora_clm_accelerate_ds_zero3_offload.py (#275) (#277)

Browse Source 
Co-authored-by: rmilleti <rmilleti@amazon.com>
This commit is contained in:
Robert Milletich
2023-04-07 17:49:35 +02:00
committed by GitHub
co-authored by rmilleti
parent 445940fb7b
commit 0422df466e
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
examples/causal_language_modeling/peft_lora_clm_accelerate_ds_zero3_offload.py
+1 -1
View File
@@ -267,7 +267,7 @@ def main():
tracemalloc.cpu_peaked + b2mb(tracemalloc.cpu_begin)
)
)
train_epoch_loss = total_loss / len(eval_dataloader)
train_epoch_loss = total_loss / len(train_dataloader)
train_ppl = torch.exp(train_epoch_loss)
accelerator.print(f"{epoch=}: {train_ppl=} {train_epoch_loss=}")