W3map

w3map is a distributed system for process OSINT. Open Source Intelligence (OSINT) is an information processing discipline that involves finding, selecting, mining and acquiring information from publicly available sources and analyzing it to produce actionable intelligence/knowledge. The term "open" refers to overt, publicly available sources (as opposed to covert or classified sources); it is not related to open-source software.

w3map is in alpha version. For the time being:

  • you can't configure redis server
  • you can't use your add your processing system
  • you can't use your use your reporting system
  • potentially you can discover bugs

Installation

Install it yourself as:

$ gem install w3map

Usage

WARNING: You must have Redis server started in your localhost.

$ export W3MAP_SESSION=<your-processing-session-name>
$ w3map push http://www.example.com

Start bot:

$ w3map bot # you can start many bots

Session information:

$ w3map queuelen # show queue length
$ w3map queue 5 # show last 5 entries in queue
$ w3map urls # show processing urls list and data store
$ w3map report ResponseCodeReport # execute standard report

Contributing

  1. Fork it
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request