From 03bb01dcf5d942ae498715e6922136ab27fa59a4 Mon Sep 17 00:00:00 2001
From: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
Date: Sun, 15 Jan 2023 15:59:32 +0100
Subject: [PATCH] Update README.md

---
 README.md | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)

diff --git a/README.md b/README.md
index b8b788f..072c19b 100644
--- a/README.md
+++ b/README.md
@@ -65,9 +65,9 @@ GPU memory required by different settings during training are given below. The f
 
 Hardware: Single A100 80GB GPU with CPU RAM above 64G
 
-|   Model         | Full Finetuning | PEFT-LoRA  |
+|   Model         | Full Finetuning | PEFT-LoRA  | PEFT-LoRA with Gradient Checkpoitning  |
 | --------- | ---- | ---- |
-| CompVis/stable-diffusion-v1-4 | 27.5GB GPU / 3.97GB CPU | 15.5GB GPU / 3.84GB CPU | 
+| CompVis/stable-diffusion-v1-4 | 27.5GB GPU / 3.97GB CPU | 15.5GB GPU / 3.84GB CPU | 8.12GB GPU / 3.77GB CPU | 
 
 
 **Training**
@@ -100,6 +100,7 @@ accelerate launch train_dreambooth.py \
   --lora_text_encoder_alpha 17 \
   --learning_rate=1e-4 \
   --gradient_accumulation_steps=1 \
+  --gradient_checkpointing \
   --max_train_steps=800
 ```