storyupdate

data/actions_batch.csv

@@ -0,0 +1 @@
+tree_id,path,context,story_block_1,previous_action,story_block_2

data/ai_dungeon_seed.csv

@@ -0,0 +1,8 @@
+tree_id,apoc_seed1,apoc_seed2,apoc_seed3,apoc_seed4
+Context,Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ,Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ,Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ,Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. 
+Story Block,You are standing outside an old rundown gas station at the edge of town. There are old broken cars surrounding the gas station and on the road. You are extremely hungry and haven't eaten in a few days. ,You find a car with the keys in the ignition and try to start it. Nothing happens. You keep looking and find another car that looks like it might work. You manage to get the engine started. ,As you leave the store you notice movement out behind your car. A man steps out with a hungry look in his eyes. His clothes are in tatters and he is carrying a crowbar.,You walk for two hours and take a break. You've left the town you were in and are now in a more rural area. There's a farmhouse to your right and a forest on your left. 
+Action,look in the gas station for food. ,drive around looking for any people or stores that might have supplies.,run at the man and attack him.,go in the farmhouse and look for food.
+Story Block,"You search the gas station for food, but find nothing you can eat.","You drive around the town and see many boarded up buildings, but no people. Eventually you find a store that you think might have supplies.",You run forward to attack the man. His crowbar crashes into your chest and you fall to the ground. He kicks you a few times and then grabs your granola bars and runs off.,"You try to open the farmhouse front door, but it's locked. There's a broken window on the right and a shed behind the house."
+Action,search the cars for food.,go inside the store and see if there are any supplies.,go after him.,go through the window into the farmhouse. 
+Story Block,"You search the cars for food, you search three without success, but in the glove compartment of the fourth you find a box of crackers.",It looks like the store has been ransacked and all the shelves are empty. You manage to find a package of granola bars and a flashlight behind the counter.,"You go after him. As you try and stand up though you realize you're in extreme pain. You think one of your ribs is broken. You manage to get yourself on your feet, but realize catching him is impossible. ","You break the rest of the glass in the window and try to carefully crawl through. You cut yourself on the edges as you're climbing in, but you make it inside. "
+Action,eat the crackers.,eat a granola bar.,look for something to wrap your chest with.,search the farmhouse for food. 

data/batch.csv

@@ -1,4 +0,0 @@
-context,story_block_1,previous_action,story_block_2␍
-The world has ended. The cities are in ruin and few people are left alive.,"You go after him. As you try and stand up though you realize you're in extreme pain. You think one of your ribs is broken. You manage to get yourself on your feet, but realize catching him is impossible. ",look for something to wrap your chest with.,␍
-The world has ended. The cities are in ruin and few people are left alive.,You go to the backyard of the house. There's a dirty grill and an overturned slide. There's a door to the house on the back porch.,open the back door into the house.,␍
-The world has ended. The cities are in ruin and few people are left alive.,You get back on the road and continue your journey. After a few hours you realize how starving you are. You' really need to find a food.,look around to see what's around me.,␍

data/data_nick_1.csv

@@ -1,21 +0,0 @@
-Prompt,You wake up in an old rundown hospital with no memory of how you got there. You look around and see ,,,
-Story Continuation or Continuation Reference,broken equipement lying around the room. The hospital seems to be completely empty.,B16,C10,D22
-Action,leave the hospital and see if there is anything outside.,ask the man what he wants and where everybody is.,leave the store and get back in your car.,eat a few granola bars.
-Result,Outside the hospital you see a worn down road and empty cars. Everything is strangely quiet and you start getting worried. You feel hungry and wonder when the last time you ate was.,"He looks at you confused. ""What are you stupid? This is the end of the world man!"" he says.",You think about what the man said. How is this possible? Why were you in that hospital and what should you do now?,"You finish off the rest of your granola bars. You're full now, but are worried about what you'll eat when you get hungry again."
-Action,try to find a working car.,"say ""What do you mean? I just woke up in a hospital with no memory. What happened?""",drive back to the hospital to see if you can find any clues. ,keep walking towards Clayton.
-Result,You find a car with the keys in the ignition and try to start it. Nothing happens. You keep looking and find another car that looks like it might work. You manage to get the engine started. ,"He responds ""Like I said, the end of the world. When the bombs starting falling three years ago we thought we could pull through. But then the skies turned black, crops started dying and everyone went crazy. Most people died in the first couple months."" ",As you pull in to the hospital parking lot the car sputters and dies. It's out of fuel an slows to a halt. ,You walk for two hours and take a break. You've left the town you were in and are now in a more rural area. There's a farmhouse to your right and a forest on your left. 
-Action,drive around looking for any people or stores that might have supplies.,ask him how he managed to survive.,go back to the room you woke up in.,go in the farmhouse and look for food.
-Result,"You drive around the town and see many boarded up buildings, but no people. Eventually you find a store that you think might have supplies.",He tells you that he was away hunting when it all started happening. He managed to live off the land for the first little while. But after the animals started dying he ran out of food and came to the city.,You get to the room. It's the same as how you remember it. Broken equipment eveywhere. But there's also a small notebook that you didn't notice before lying on the floor. ,"You try to open the farmhouse front door, but it's locked. There's a broken window on the right and a shed behind the house."
-Action,go inside the store and see if there are any supplies.,ask him if you two can work together. ,read the notebook.,go through the window into the farmhouse. 
-Result,It looks like the store has been ransacked and all the shelves are empty. You manage to find a package of granola bars and a flashlight behind the counter.,"The man shakes his head. ""Hardly enough food for one person. I've only lived this long by looking after myself."" He turns and starts walking away.",It looks like a journal. As you flip through the pages you see drawings of the death and destruction. The journal talks about someone's horrific experiences during the aftermath of the war. ,"You break the rest of the glass in the window and try to carefully crawl through. You cut yourself on the edges as you're climbing in, but you make it inside. "
-Action,eat a granola bar.,run after the man and tell him you'll both do better together.,try to see if anything in it sparks your memory.,search the farmhouse for food. 
-Result,You feel a little bit better. But you're still hungry.,"He stops and thinks about it for a second, then says, ""Fine. I guess there might be advantages to working together."" ","you read for a while hoping this will give you some clue. None of the events written about spark anything, but you do read someone's name that you feel like you should know. ""Sarina"". It says she heard about a community called ""Bright Meadow"" that was safe and had food and was leaving to find it. ",You search around the farmhouse for food. You find some thick sturdy shirts and some rusty tools but no food. It's getting dark outside. You think it might be a good idea to sleep the night here.
-Action,eat another granola bar.,ask him where he thinks we should go next.,see if you can find out where Bright Meadow is from the journal. ,sleep the night in the farmhouse.
-Result,You feel better. You should probably save the rest of your food though.,He tells you there is a house on the road that looked undisturbed that might be worth checking out. ,You look through the journal to see if there are any clues about where Bright Meadow is. You find a crude map that shows Bright Meadow to the north of a town called Clayton. ,You wake up in the middle of the night sweating from a nightmare. In it you saw a woman screaming in some dark place. You feel like you need to rescue her and that you're the only one who can help her. 
-Action,leave the store and get back in the car.,start going towards the house. ,go to Clayton.,go back to sleep till the morning.
-Result,As you leave the store you notice movement out behind your car. A man steps out with a hungry look in his eyes. His clothes are in tatters and he is carrying a crowbar.,You are walking towards the house. You reach an intersection. There is a police station on one corner an office building on another. The house is another half mile down the road. ,You don't know where Clayton is. But maybe if you found a map you could figure out where it is.,"You try to go back to sleep, but can't shake the feelings from your dream. You decide you might as well get up and see if you can do anything productive. "
-Action,run at the man and attack him.,keep going towards the house. ,look for a map somewhere in the hospital. ,look around the farmhouse for anything else useful.
-Result,You run forward to attack the man. His crowbar crashes into your chest and you fall to the ground. He kicks you a few times and then grabs your granola bars and runs off.,You keep walking and eventually reach the house. You see a two story house that looks fairly undisturbed. There's a garage on the right and a path to the backyard on the left. ,You start looking around for a map. You find an administrator's office that you think might have one.,You look around the farmhouse for anything else useful. You don't find anything else useful.
-Action,go after him.,go around the house to the backyard.,search the office for a map.,leave the farmhouse and continue walking towards Clayton.
-Result,"You go after him. As you try and stand up though you realize you're in extreme pain. You think one of your ribs is broken. You manage to get yourself on your feet, but realize catching him is impossible. ",You go to the backyard of the house. There's a dirty grill and an overturned slide. There's a door to the house on the back porch.,You look through the filing cabinets for a map. You find a bunch of patient records in a filing cabinet. In the desk you find a map that shows other hospitals in the region. It says Clayton is 15 miles to the West of here. ,You get back on the road and continue your journey. After a few hours you realize how starving you are. You' really need to find a food.
-Action,look for something to wrap your chest with.,open the back door into the house.,leave the hospital and start heading towards Clayton.,look around to see what's around me.

data/results_batch.csv

@@ -0,0 +1,5 @@
+tree_id,path,context,story_block_1,previous_action_1,story_block_2,previous_action_2
+apoc_seed1,000,Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ,"You search the gas station for food, but find nothing you can eat.",search the cars for food.,"You search the cars for food, you search three without success, but in the glove compartment of the fourth you find a box of crackers.",eat the crackers.
+apoc_seed2,000,Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ,"You drive around the town and see many boarded up buildings, but no people. Eventually you find a store that you think might have supplies.",go inside the store and see if there are any supplies.,It looks like the store has been ransacked and all the shelves are empty. You manage to find a package of granola bars and a flashlight behind the counter.,eat a granola bar.
+apoc_seed3,000,Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ,You run forward to attack the man. His crowbar crashes into your chest and you fall to the ground. He kicks you a few times and then grabs your granola bars and runs off.,go after him.,"You go after him. As you try and stand up though you realize you're in extreme pain. You think one of your ribs is broken. You manage to get yourself on your feet, but realize catching him is impossible. ",look for something to wrap your chest with.
+apoc_seed4,000,Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ,"You try to open the farmhouse front door, but it's locked. There's a broken window on the right and a shed behind the house.",go through the window into the farmhouse. ,"You break the rest of the glass in the window and try to carefully crawl through. You cut yourself on the edges as you're climbing in, but you make it inside. ",search the farmhouse for food. 

data/seed_forest_1/apoc_seed1.json

@@ -0,0 +1 @@
+{"tree_id": "apoc_seed1", "context": "Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ", "first_story_block": "You are standing outside an old rundown gas station at the edge of town. There are old broken cars surrounding the gas station and on the road. You are extremely hungry and haven't eaten in a few days. ", "action_results": [{"action": "look in the gas station for food. ", "result": "You search the gas station for food, but find nothing you can eat.", "action_results": [{"action": "search the cars for food.", "result": "You search the cars for food, you search three without success, but in the glove compartment of the fourth you find a box of crackers.", "action_results": [{"action": "eat the crackers.", "result": null, "action_results": []}]}]}]}

data/seed_forest_1/apoc_seed2.json

@@ -0,0 +1 @@
+{"tree_id": "apoc_seed2", "context": "Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ", "first_story_block": "You find a car with the keys in the ignition and try to start it. Nothing happens. You keep looking and find another car that looks like it might work. You manage to get the engine started. ", "action_results": [{"action": "drive around looking for any people or stores that might have supplies.", "result": "You drive around the town and see many boarded up buildings, but no people. Eventually you find a store that you think might have supplies.", "action_results": [{"action": "go inside the store and see if there are any supplies.", "result": "It looks like the store has been ransacked and all the shelves are empty. You manage to find a package of granola bars and a flashlight behind the counter.", "action_results": [{"action": "eat a granola bar.", "result": null, "action_results": []}]}]}]}

data/seed_forest_1/apoc_seed3.json

@@ -0,0 +1 @@
+{"tree_id": "apoc_seed3", "context": "Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ", "first_story_block": "As you leave the store you notice movement out behind your car. A man steps out with a hungry look in his eyes. His clothes are in tatters and he is carrying a crowbar.", "action_results": [{"action": "run at the man and attack him.", "result": "You run forward to attack the man. His crowbar crashes into your chest and you fall to the ground. He kicks you a few times and then grabs your granola bars and runs off.", "action_results": [{"action": "go after him.", "result": "You go after him. As you try and stand up though you realize you're in extreme pain. You think one of your ribs is broken. You manage to get yourself on your feet, but realize catching him is impossible. ", "action_results": [{"action": "look for something to wrap your chest with.", "result": null, "action_results": []}]}]}]}

data/seed_forest_1/apoc_seed4.json

@@ -0,0 +1 @@
+{"tree_id": "apoc_seed4", "context": "Long ago the bombs fell and the world ended. You are one of the few who is still alive. You are trying to survive by scavenging among the ruins of what is left behind. ", "first_story_block": "You walk for two hours and take a break. You've left the town you were in and are now in a more rural area. There's a farmhouse to your right and a forest on your left. ", "action_results": [{"action": "go in the farmhouse and look for food.", "result": "You try to open the farmhouse front door, but it's locked. There's a broken window on the right and a shed behind the house.", "action_results": [{"action": "go through the window into the farmhouse. ", "result": "You break the rest of the glass in the window and try to carefully crawl through. You cut yourself on the edges as you're climbing in, but you make it inside. ", "action_results": [{"action": "search the farmhouse for food. ", "result": null, "action_results": []}]}]}]}

data/storytree.py

@@ -3,8 +3,7 @@ format of tree is
 dict {
     tree_id: tree_id_text
     context: context text?
-    story_prompt: story_prompt_text
-    story_continuation: story_continuation_text
+    first_story_block
     action_results: [act_res1, act_res2, act_res3...]
 }
 
@@ -18,111 +17,166 @@ dict{
 
 import csv
 import json
+import os
 
-def get_numeric_cell(cell_string):
-    letter = cell_string[0]
-    number = cell_string[1:]
-    if number.isnumeric():
-        col_num = ord(letter.lower()) - 97
-        row_num = int(number)
-        return row_num, col_num
-    else:
-        return None
+def data_to_forest(filename):
 
-
-def dungeon_data_to_tree(filename):
-    tree = {}
-    tree["tree_id"] = filename
-    current_action_results = []
-    tree["action_results"] = current_action_results
+    trees = []
     rows = []
 
-    with open(filename) as csvfile:
-        reader = csv.reader(csvfile, delimiter=',')
-        for reader_row in reader:
-            rows.append(reader_row)
+    with open(filename, newline='') as f:
+        reader = csv.reader(f)
+        for row in reader:
+            rows.append(row)
 
-    tree["story_prompt"] = rows[0][1]
-
-    col_ind = 1
-    n_columns = len(rows[0])
-    while col_ind < n_columns:
-
-        row_and_col = get_numeric_cell(rows[1][col_ind])
-
-        # if it's a cell designation got to traverse tree to find starting point
-        if row_and_col is not None:
-            cols_to_traverse = [row_and_col[1], col_ind]
-            current_action_results = tree["action_results"]
-            while cols_to_traverse[0] is not 1:
-                new_row_and_col = get_numeric_cell(rows[1][cols_to_traverse[0]])
-                cols_to_traverse.insert(0, new_row_and_col[1])
-
-            for j in range(len(cols_to_traverse) -1):
-                next_row_and_col = get_numeric_cell(rows[1][cols_to_traverse[j+1]])
-                traverse_rows = int((next_row_and_col[0] - 2) / 2)
-                for _ in range(traverse_rows):
-                    current_action_results = current_action_results[-1]["action_results"]
-
-        else:
-            tree["story_continuation"] = rows[1][col_ind]
-
-        ind = 2
-        while(ind < len(rows)):
-
-            action_result = {"action": rows[ind][col_ind], "result": None, "action_results": []}
-            if ind+1 < len(rows):
-                action_result["result"] = rows[ind+1][col_ind]
+    for i in range(1, len(rows[0])):
+        tree = {}
+        tree["tree_id"] = rows[0][i]
+        tree["context"] = rows[1][i]
+        tree["first_story_block"] = rows[2][i]
+        tree["action_results"] = []
+        current_action_results = tree["action_results"]
+        row_ind = 3
+        while row_ind < len(rows):
+            action_result = {}
+            action_result["action"] = rows[row_ind][i]
+            if row_ind+1 < len(rows):
+                action_result["result"] = rows[row_ind+1][i]
+            else:
+                action_result["result"] = None
+            action_result["action_results"] = []
             current_action_results.append(action_result)
             current_action_results = action_result["action_results"]
-            ind += 2
+            row_ind += 2
+        trees.append(tree)
 
-        col_ind += 1
-
-    return tree
+    return trees
 
 
-def build_action_samples_helper(context, story_block, action_results):
+def build_action_samples_helper(context, story_block, action_results, path, tree_id):
 
     samples = []
 
-    for action_result in action_results:
-        if len(action_result["action_results"]) is 0:
-            row = [context, story_block, action_result["action"], action_result["result"]]
+    for i, action_result in enumerate(action_results):
+        new_path = path[:]
+        new_path.append(i)
+        if len(action_result["action_results"]) is 0 and action_result["result"] is not None:
+            row = [tree_id, "".join(str(x) for x in new_path), context, story_block, action_result["action"], action_result["result"]]
             samples.append(row)
         else:
-            sub_result = build_action_samples_helper(context, action_result["result"], action_result["action_results"])
+            sub_result = build_action_samples_helper(context, action_result["result"], action_result["action_results"], new_path, tree_id)
             samples += sub_result
 
     return samples
 
 
-def make_write_actions_batch(tree, filename):
+def make_write_actions_batch(forest, filename):
     # Traverse to the bottom levels of each tree
-    with open(filename, mode='w') as file:
+    with open(filename, mode='w', newline='') as file:
         writer = csv.writer(file, delimiter=',', quotechar='"', quoting=csv.QUOTE_MINIMAL)
-        writer.writerow(["context", "story_block_1", "previous_action", "story_block_2"])
+        writer.writerow(["tree_id", "path", "context", "story_block_1", "previous_action", "story_block_2"])
 
-        first_story_block = tree["story_prompt"] + tree["story_continuation"]
-        samples = build_action_samples_helper(tree["context"], first_story_block, tree["action_results"])
+        for tree in forest:
+            first_story_block = tree["first_story_block"]
+            samples = build_action_samples_helper(tree["context"], first_story_block, tree["action_results"], [], tree["tree_id"])
 
-        for sample in samples:
-            writer.writerow(sample)
+            for sample in samples:
+                writer.writerow(sample)
+
+
+def build_result_samples_helper(context, story_block, parent_action_result, path, tree_id):
+
+    samples = []
+    action_results = parent_action_result["action_results"]
+
+    for i, action_result in enumerate(action_results):
+        new_path = path[:]
+        new_path.append(i)
+        if action_result["result"] is None:
+            row = [tree_id, "".join(str(x) for x in new_path), context, story_block, parent_action_result["action"], parent_action_result["result"], action_result["action"]]
+            samples.append(row)
+        else:
+            sub_result = build_result_samples_helper(context, parent_action_result["result"], action_result, new_path, tree_id)
+            samples += sub_result
+
+    return samples
+
+
+def make_write_results_batch(forest, filename):
+
+    with open(filename, mode='w', newline='') as file:
+        writer = csv.writer(file, delimiter=',', quotechar='"', quoting=csv.QUOTE_MINIMAL)
+        writer.writerow(["tree_id", "path", "context", "story_block_1", "previous_action_1", "story_block_2", "previous_action_2"])
+
+        for tree in forest:
+            first_story_block = tree["first_story_block"]
+            samples = []
+            for i, action_result in enumerate(tree["action_results"]):
+                path = [i]
+                samples += build_result_samples_helper(tree["context"], first_story_block, action_result, path, tree["tree_id"])
+
+            for sample in samples:
+                writer.writerow(sample)
 
 
 def save_tree(tree, filename):
     with open(filename, 'w') as fp:
         json.dump(tree, fp)
 
+def save_forest(forest, forest_name):
+
+    if not os.path.exists("./" + forest_name):
+        os.mkdir("./" + forest_name)
+    for tree in forest:
+        save_tree(tree, "./" + forest_name + "/" + tree["tree_id"] + ".json")
+
 def load_tree(filename):
     with open(filename, 'r') as fp:
         tree = json.load(fp)
     return tree
 
-tree = dungeon_data_to_tree("./data_nick_1.csv")
-tree["context"] = "The world has ended. The cities are in ruin and few people are left alive."
-make_write_actions_batch(tree, "batch.csv")
+def csv_to_dict(file):
+    update_dict = {}
+    field_names = []
 
-save_tree(tree, "tree_data.json")
-data = load_tree("tree_data.json")
-print("done")
+    with open(file, newline='') as f:
+        reader = csv.reader(f)
+        for row in reader:
+            if len(update_dict) is 0:
+                for item in row:
+                    update_dict[item] = []
+                    field_names.append(item)
+
+            else:
+                for i, item in enumerate(row):
+                    update_dict[field_names[i]].append(item)
+
+    return update_dict
+
+
+def update_tree(tree_file, update_file, type="action"):
+    # TODO need to write this and figure out batch files more clearly
+    # Batches should keep track of paths so it's easier to go back in and update them.
+
+    update_dict = csv_to_dict(update_file)
+
+    print("done")
+
+
+# tree = dungeon_data_to_tree("./data_nick_1.csv")
+# tree["context"] = "The world has ended. The cities are in ruin and few people are left alive."
+# make_write_results_batch(tree, "batch.csv")
+#
+# save_tree(tree, "tree_data.json")
+# data = load_tree("tree_data.json")
+# tree = dungeon_data_to_tree("./manual_data.csv")
+# tree["context"] = "The world has ended. The cities are in ruin and few people are left alive."
+# make_write_actions_batch(tree, "actions_batch.csv")
+# make_write_results_batch(tree, "results_batch.csv")
+
+forest = data_to_forest("./ai_dungeon_seed.csv")
+save_forest(forest, "seed_forest_1")
+make_write_actions_batch(forest, "actions_batch.csv")
+make_write_results_batch(forest, "results_batch.csv")
+
+print("Done")