Feature request: add custom properties to documents

By supporting custom properties to be set for documents, you could specify e.g. the platform a program belongs to or the name of a team member that added a bunch of new domains.

This could look as follows:

bbrf new example --set platform:intigriti
bbrf domain add 'www.example.com' --set added_by:pieter 'comment:just stumbled across this'

This probably requires some checks on property names to ensure the integrity of the information, e.g. no reserved keywords like id, _id, _rev or bbrf-related fields like domains, ips, url, type, etc. should be allowed.

[0xJeti]

Great idea, this will make bbrf very extensible! Maybe it will be easier to prefix internally all custom fields (e.g added_by will become x_added_by which theoretically should fix the problem of name collisions.

[honoki]

OK, I think found a way to reconcile all of the above by adding the subcommand where which accepts the following syntax:

bbrf domains where <tag_name> is [before | after] <value> [(-p <program> | --all)]

# for example
bbrf domains where added_by is pieter --all
bbrf domains where last_updated is before 1610698911
bbrf domains where last_scan is after 2021-01-01 -p myprogram

This works on domains, ips and urls and will query custom tags based on text-based comparisons as is defined in the Unicode Collation Algorithm as implemented by Couchdb.

Since all values are stored as text, this allows date comparison if you store dates as unix timestamps or in a ISO-8601 format e.g. 2021-01-15T09:02:40.628Z.

That also means, however, that for example "20" comes after "1000", which makes this less suitable for integer comparison. So if you want to store integers, you may want to use padded zeros at the front to ensure that 0020 comes before 1000.