v1.0 final

This commit is contained in:
cjnaz
2020-03-30 23:05:06 -07:00
parent d84314ed1a
commit eb828b0f9d
2 changed files with 40 additions and 85 deletions
+14 -23
View File
@@ -9,21 +9,18 @@ If you want it to do other functions, grab the code and go for it.
## Usage
```
$ ./xbsjsonedit -h
usage: xbsjsonedit [-h] [--Print] [--Tags-Print] [--Tags-Count TAGS_COUNT]
[-V]
Infile
usage: xbsjsonedit [-h] [--print] [--tags TAGS] [--names] [-V] Infile
xBrowserSync json backup editor
positional arguments:
Infile json backup file
Infile json backup file.
optional arguments:
-h, --help show this help message and exit
--Print, -p Print bookmark hierarchy (redirect to less or a file)
--Tags-Print, -t Print tags list
--Tags-Count TAGS_COUNT, -c TAGS_COUNT
Filter Tags-List for min number of times a tag is used (defult 2). =0 prints only single use tags.
--print, -p Print bookmark hierarchy (redirect to less or a file).
--tags TAGS, -t TAGS Print tags list filtered by tags with a minimum <n> number of uses. n=0 prints only single use tags.
--names, -n Used with --tags to enable printing the titles/names for each tag.
-V, --version Return version number and exit.
```
@@ -69,35 +66,29 @@ Five modes are supported Listing/Deleting based on:
The Print function prints the full list of bookmarks in folder hierarchical form, listing the ID number and Title of each folder and bookmark. The `--Print` switch may be used for getting a good visual dump of the bookmarks in less or an editor for reference while using the interactive mode. The tags on each bookmark are listed as well.
The `--Tags-Print` switch prints bookmarks by tag name, where a minimum of 2 bookmarks share the same tag, as set by the `--Tags-Count` switch. Setting `--Tags-Count 1` prints all bookmarks with tags. Setting `--Tags-Count 0` prints all bookmarks with only one tag - useful for finding remnant tags.
The `--tags <n>` switch prints each tag where the number of bookmarks with that tag >= `<n>`. Optionally include the `--names` switch to list the bookmark titles/names for each tag. `--tags 0` is a special case that prints only tags that have exactly one occurrence, which may be useful for finding extraneous/remnant tags usage.
A lower case letter `t/g/d/f/x/y` will list the offenders, while an upper case letter
`T/G/D/F/X/Y` will allow for selective deletes of the offenders. The lower case List operation
need not be run before running the upper case Delete operation.
`T/G/D/F/X/Y` will allow for selective deletes of the offenders. The lower case List operation need not be run before running the upper case Delete operation.
Delete functions support individual bookmark selection, or all that match the selection mode.
You cannot do any damage to the original bookmark file during a session, so experiment and poke
around.
You cannot do any damage to the original bookmark file during a session, so experiment and poke around.
When deleting empty folders you may find that you need to repeat the operation a few times.
This happens when there are folders within folders that contain no bookmarks. The lower folder
must be deleted before the next higher folder is seen as empty. Just repeat the folder deletes
until the Matches count is 0.
This happens when there are folders within folders that contain no bookmarks. The lower folder must be deleted before the next higher folder is seen as empty. Just repeat the folder deletes until the Matches count is 0.
The output file defaults to the Infile + "_OUT", and can be specified during the write operation.
You may want to write out intermediate editing results to save work done up to that point.
The output format is "pretty printed" json for readability, and is accepted by the
xBrowserSync app Restore function via copy/paste. Note: xBrowserSync will allow you to restore
to (blast) your current
syncID, so you may want to Disable Sync, then create a new sync before restoring the modified bookmarks. **NOTE** that tags are not restored if sync is disabled. To recover, simply enable sync and do another restore.
The output file defaults to the Infile + "_OUT", and can be specified during the write operation. You may want to write out intermediate editing results to save work done up to that point. The output format is "pretty printed" json for readability, and is accepted by the xBrowserSync app Restore function via copy/paste.
- **Note** [_may no longer be the case_]: xBrowserSync will allow you to restore to (blast) your current syncID, so you may want to Disable Sync, then create a new sync before restoring the modified bookmarks.
- **NOTE** that tags are not restored by xBrowserSync if sync is disabled. To recover, simply enable sync and do another restore.
## Known issues:
- This code only works with Python 3. Development and testing was done on Linux with Python 3.7.3.
- This code only works with Python 3. Development and testing was done on Linux with Python 3.7.3. Limited testing was done on Windows with Python 3.8.0.
## Version history
- 200329 v1.0 Merged pull request #3 from mblais (add unbuffered getch input; add 'all' option), Reworked --tags and --names switches.
- 191206 v0.3 Added tags dump
- 191205 v0.2 Updated to xbrowsersync v1.5 and Python 3.x ONLY
- 181128 v0.1 New
+26 -62
View File
@@ -1,14 +1,13 @@
#!/usr/bin/env python3
# -*- coding: UTF-8 -*-
"""xBrowserSync json backup editor"""
__version__ = "v0.4 200329"
__version__ = "v1.0 200330"
#==========================================================
#
# Chris Nelson 2018 - 2019
#
# 200329 v0.4 Merged pull request #3 from mblais - add unbuffered getch input; add 'all' option
# 200330 v1.0 Merged pull request #3 from mblais (add unbuffered getch input; add 'all' option), Reworked --tags and --names switches.
# 191206 v0.3 Added tags dump
# 191205 v0.2 Updated to xbrowsersync v1.5 and Python 3.x ONLY
# 181128 v0.1 New
@@ -54,20 +53,22 @@ def main():
if args.print:
digin(parent=json_dict["xbrowsersync"]["data"]["bookmarks"], parent_id="", path="/", search_term="", operation="printtree")
exit()
if args.tags_print:
if args.tags > -1:
digin(parent=json_dict["xbrowsersync"]["data"]["bookmarks"], parent_id="", path="/", search_term="", operation="GatherTags")
for tag in sorted(tags_dict.keys()):
if args.tags_count == 0:
if args.tags == 0:
if len(tags_dict[tag]) == 1:
print ("\n[{}]:".format(tag))
print (" {:<4} - {}".format(tags_dict[tag][0]["id"], tags_dict[tag][0]["title"]))
elif args.tags_count == -1:
print ("{:5} {}".format(len(tags_dict[tag]), tag))
print ("[{}] (1):".format(tag))
if args.names:
print (" {:<4} - {}".format(tags_dict[tag][0]["id"], tags_dict[tag][0]["title"]))
print()
else:
if len(tags_dict[tag]) >= args.tags_count:
print ("\n[{}]:".format(tag))
for bookmark in tags_dict[tag]:
print (" {:<4} - {}".format(bookmark["id"], bookmark["title"]))
if len(tags_dict[tag]) >= args.tags:
print ("[{}] ({}):".format(tag, len(tags_dict[tag])))
if args.names:
for bookmark in tags_dict[tag]:
print (" {:<4} - {}".format(bookmark["id"], bookmark["title"]))
print()
exit()
while (1):
@@ -103,9 +104,6 @@ Options:
""".format(term))
select = prompt("Enter option: ", valid="stTgGdDfFxXyYwq")
# print("Enter option: ", end='', flush=True)
# select = getch()
# print( select )
if select == 'p':
digin(parent=json_dict["xbrowsersync"]["data"]["bookmarks"], parent_id="", path="/", search_term="", operation="printtree")
@@ -174,20 +172,12 @@ Options:
with io.open(ans, "w", encoding='utf8') as ofile:
json.dump(json_dict, ofile, ensure_ascii=False, indent=2)
elif select == 'q':
exit()
# if not changes:
# exit()
# else:
# if prompt("Exit without saving changes?", valid="yn") == 'y':
# exit()
if prompt("Quit now? (Remember to write any changes first!) ", valid="yn") == 'y':
exit()
else:
print ("Shouldn't have gotten here!")
exit()
# else:
# print ("Invalid option {}".format(select))
def digin(parent, parent_id, path, search_term, operation, commit=False, indent=""):
"""Recurse through the json dictionary bookmark tree, with operation options."""
@@ -195,7 +185,6 @@ def digin(parent, parent_id, path, search_term, operation, commit=False, indent=
global change_cnt
global do_all
global path_dict
# global changes
item_index = -1
ans = 'n'
@@ -218,25 +207,16 @@ def digin(parent, parent_id, path, search_term, operation, commit=False, indent=
ans = 'y'
else:
ans = prompt("Confirm delete for this item ('y'es, 'a'll, or 'q'uit, default 'n'o) ", valid="yaqn\r")
# print("Enter option: ", end='', flush=True)
# select = getch()
# print( select )
if ans == 'a':
do_all = True
ans = 'y'
if ans == 'y':
collect_items (path + parent_id, parent, item_index)
change_cnt += 1
# local_changes = True
if ans == 'q':
if prompt("Discard pending deletes ('y'es, default 'n'o)? ", valid="yn\n") == 'y':
# local_changes = False
path_dict = {}
return -1
# changes = changes or local_changes
if operation == "FolderTags":
if "tags" in item:
@@ -262,7 +242,6 @@ def digin(parent, parent_id, path, search_term, operation, commit=False, indent=
if ans == 'y':
del item["tags"]
change_cnt += 1
# changes = True
if ans == 'q':
return -1
@@ -389,11 +368,8 @@ def delete_items ():
for path in path_dict:
xxx = path_dict[path]["index"]
## print path
## print xxx
xxx.sort(reverse=True)
for _index in xxx:
## print path_dict[path]["parent"]
del path_dict[path]["parent"][_index]
path_dict = {}
@@ -417,7 +393,6 @@ def dup_folders (commit=False):
for folder in folder_dict:
if len(folder_dict[folder]["instance"]) > 1:
print ("-------------------------------------------------\n{}".format(folder))
# for instance in folder_dict[folder]["instance"]:
for instance in sorted(folder_dict[folder]["instance"], key=lambda k: k['id']): # Sort id numbers so that lowest is kept for 'a'll mode
print (" {:>4} - {}".format(instance["id"], instance["path"]))
match_cnt += 1
@@ -459,19 +434,16 @@ def dup_urls (commit=False):
global match_cnt
global change_cnt
global path_dict
# global yes_all
yes_all = False
for url in url_dict:
if len(url_dict[url]["instance"]) > 1:
print ("-------------------------------------------------\n{}".format(url))
# for instance in url_dict[url]["instance"]:
for instance in sorted(url_dict[url]["instance"], key=lambda k: k['id']): # Sort id numbers so that lowest is kept for 'a'll mode
print (" {:>4} - {}".format(instance["id"], instance["path"]))
match_cnt += 1
if commit:
print ("")
first_instance = True
# for instance in url_dict[url]["instance"]:
for instance in sorted(url_dict[url]["instance"], key=lambda k: k['id']):
if first_instance and yes_all:
first_instance = False
@@ -479,10 +451,7 @@ def dup_urls (commit=False):
first_instance = False
if not yes_all:
print (" {:>4} - {}".format(instance["id"], instance["path"]))
# print ("Confirm delete for this item ('y'es, 'q'uit, 's'kip to next URL, 'a'll - default no): ", end='', flush=True)
ans = prompt ("Confirm delete for this item ('y'es, 'q'uit, 's'kip to next URL, 'a'll - default 'n'o) ", valid="yqsan\r")
# ans = getch()
# print (ans)
if ans == 'a':
yes_all = True
if ans == 'y' or yes_all:
@@ -495,10 +464,11 @@ def dup_urls (commit=False):
path_dict = {}
return -1
def prompt_long (prompt_text):
return (input(prompt_text))
def prompt (prompt_text, valid=None):
print(prompt_text, end='', flush=True)
select = getch()
@@ -507,17 +477,10 @@ def prompt (prompt_text, valid=None):
xx = list(valid)
yy = ", ".join(xx).replace("\r", "enter")
print("\nInvalid input - expecting one of <{}>: ".format(yy), end='', flush=True)
# print("\nInvalid input - expecting one of <{}>: ".format(valid.replace("\r","\\r")), end='', flush=True)
# print("\nInvalid input - expecting one of <{}>: ".format(valid.replace("\n","\\n")), end='', flush=True)
select = getch()
# print ("<",ord(select),">")
# print ("<",ord("\n"),">")
print(select)
return select
class _Getch:
"""Gets a single character from standard input. Does not echo to the screen.
"""
@@ -550,7 +513,8 @@ class _GetchWindows:
def __call__(self):
import msvcrt
return msvcrt.getch()
# return msvcrt.getch()
return msvcrt.getch().decode("utf-8")
getch = _Getch()
@@ -602,13 +566,13 @@ getch = _Getch()
if __name__ == '__main__':
parser = argparse.ArgumentParser(description=__doc__, formatter_class=argparse.RawTextHelpFormatter)
parser.add_argument('Infile',
help="json backup file")
help="json backup file.")
parser.add_argument('--print', '-p', action='store_true',
help="Print bookmark hierarchy (redirect to less or a file)")
parser.add_argument('--tags-print', '-t', action='store_true',
help="Print tags list")
parser.add_argument('--tags-count', '-c', default=2, type=int,
help="Filter tags-print for min number of times a tag is used (default 2). =0 prints only single use tags. =-1 prints only count per tag")
help="Print bookmark hierarchy (redirect to less or a file).")
parser.add_argument('--tags', '-t', type=int, default=-1,
help="Print tags list filtered by tags with a minimum <n> number of uses. n=0 prints only single use tags.")
parser.add_argument('--names', '-n', action='store_true',
help="Used with --tags to enable printing the titles/names for each tag.")
parser.add_argument('-V', '--version',
help="Return version number and exit.",
action='version',