Make it easier to visualize collected data

It would be awesome to have something like this:

make start-crawler-and-elk # or ./crawl.sh all or ./launch.sh all

Or something similar that starts a crawler for containers (in a container), and an ELK stack in a container (use https://github.com/cloudviz/crawler-elk-stack) receiving data from that crawler. The output of that make start-crawler-and-elk should be a URL for where to look at the pretty data (some kibana dashboard).

[ricarkol]

@nadgowdas that’s a great idea. Yes, it will make things easier to query for.

So should we make elk deployment the default output format? –> the default format is whatever looks best when doing stdout (want that to be the easiest example)

In ‘make’ approach you mentioned, so user specify input arguments (eg. features etc.) as input parameters to make ? –> Yes, and also default to container crawling mode. The most important output of that make is having the two containers running in the background (1. crawler container and 2. elk container), and output a URL to see the data in kibana (running in the elk container). Something like this:

$ make launch-all
Starting crawler container.... Done
Starting elk container.... Done

You can see the collected data at http://1.2.3.4/awesome-kibana-dashboard
$

So, now when you start a container, you automagically get the data in that kibana dashboard at http://1.2.3.4/awesome-kibana-dashboard.

[canturkisci]

Thanks Shripad.