Perceval Connector: Mailing Lists

We are piloting our perceval connector using mailing lists.

Open Daylight Mailing Lists

1. Lists enumerated at: https://lists.opendaylight.org/mailman/listinfo
2. Using perceval, they can be gathered one at a time as so:

 perceval pipermail 'https://lists.opendaylight.org/pipermail/aaa-dev/' -o opendaylight-aaa-dev.json

1. Goals:
   • Iterate through all the mailing lists
   • Pull them down
   • Parse them into message threads stored in a database schema

Other Mailing Lists:

1. Seems as though the parameters for --mboxes-path and -o may simultaneously execute?

perceval pipermail 'http://lists.openstack.org/pipermail/openstack/' -o openstack.json --mboxes-path 'openstack'
perceval pipermail 'http://lists.openstack.org/pipermail/openstack/' -o openstack.json
perceval pipermail 'http://lists.digium.com/pipermail/asterisk-dev/' -o 'asterisk-dev.json' --mboxes-path 'asterisk-dev' --from-date '2004-01-01'
perceval pipermail 'http://lists.digium.com/pipermail/asterisk-users/' -o 'asterisk-users.json' --mboxes-path 'asterisk-users' --from-date '2004-01-01'
perceval pipermail 'http://lists.digium.com/pipermail/asterisk-biz/' -o 'asterisk-biz.json' --mboxes-path 'asterisk-biz' --from-date '2004-01-01'

1. Linux Foundation: https://lists.linuxfoundation.org/mailman/listinfo

[kmn5409]

@sgoggins Okay I understand and I think I have an idea of what I will need to do then, thank you.

[kmn5409]

https://github.com/kmn5409/GSoC_CHAOSS/blob/master/Augur/Perceval/Piper_reader.py