Really Open Source Information Gathering

How to compile the slave

No Comments »

The slave can be compiled on GNU linux distribution only.

Step 1 : Prerequisites

The sources are not available yet

Mandatory Dependencies and package needed

Some package are mandatory to compile and run the slave :

  • build-essential
sudo aptitude install build-essential 

Step 2 : Qt framework install

The slave depend on Qt framework (version 4.6 at least).

Actually, the latest release of Qt framework is the 4.6.3. The packages available on Ubuntu official repository being too old, two solutions may be used :

First Solution: Install Qt SDK.

You can download the 64bit version of Qt SDK at or download it from our local mirror (private link). netglub slave can be used on a 32bit processor too, if you made this choose, you should dowload the Qt SDK 32bit version or dirrectly here (private link)

The SDK take up more disk space than compiling Qt sources, but it contains a inary version of Qt libraries which avoid a complete compile. Furthermore, the compilation is trivial via graphical wizard.

chmod +x qt-sdk-linux-x86_64-opensource-2010.03.bin 

Second solution : Compiling Qt Sources

The first solution is recomended

This solution, more laborious, is to download the Qt source (« -4.6.3.tar.gz ») and to make yourself compile it

Here is a hint :

sudo aptitude install libxq11-dev libxext-dev 
tar xf qt-everywhere-opensource-src-4.6.3.tar.gz 
cd qt-everywhere-opensource-src-4.6.3 cd qt-everywhere-opensource-src-4.6.3
./configure -opensource -fast -nomake examples -nomake demos 
sudo make install 
To compile Qt in debug mode :

 ./configure -opensource -fast -nomake examples -nomake demos -debug -no-separate-debug-info 
Now, Qt is installed, you can begin the slave install.

step 3 : install the slave :

You can now compile the slave :

cd (@netglub location)/slave 
qmake (qmake is locate in the bin directory of Qt)

To install the slave, you should have the root privileges :

cd (@netglub location)/slave
sudo ./

To launch the slave : ./(@netglub_location)/slave/tools/netglub_slave start

The slave will automaticaly start at each boot.
sudo ./slave -h
for help
if you want to change some configuration, you can change the file
(@netglub_location)/slave/tools/slave.conf, and launch again.
Now, the slave is successfully installed.
You may have some problems with transforms that don’t work. please refere to the followings.

step 4 : transforms dependencies.

Netglub is given with some transforms, that have some dependencies :
(This tests are done under linux, ubuntu 9.04)

This transforms are mostly based on python 2.6.2 (at least)
  • DDToIp:
  • DnsNameToWebsite:
  • DnsWebsiteToDomain:
  • DomainEmailToEmailSE:
  • DomainIpToEmailWhois:
  • DomainToDomainExpand:
  • DomainToDomainTLD:
  • DomainToDomainTopLevel:
  • DomainToEmailPGP:
  • DomainToEmailSEDomOnly:
  • DomainToLocationWhois:
  • DomainToMX:
  • DomainToNS:
  • DomainToPersonPGP:
  • DomainToWebsite:
  • EmailIpToWebsiteSE:
  • EmailToDomain:
  • EmailToEmailSamePGP:
  • EmailToPersonPGP:
  • EmailWebsiteToUrlSE:
  • IpBlockToDnsName:
  • IpToAsWhois:
  • IpToDnsName:
  • IpToDomainSharedIp:
  • IpToIpBlock:
  • IpToIpBlockCuts:
  • IpToLocation:
  • IpToWiki:
  • PersonToEmailPGP:
  • PersonToEmailSE:
  • PersonToPersonPGP:
  • PersonToWebsiteSE:
  • PhraseToUrlSE:
  • UrlToEmail:
  • UrlToUrl:
  • UrlToUrlInk:
  • UrlToWebsite:
  • WebsiteToIp:
  • WebsiteToWebsiteInk:
  • None

  • DomainToDnsNameBrute:
  • DomainToDnsNameZN:
  • libnet-ip-perl

  • DomainToDnsNameSE:
  • simplejson
    you can download it from :
    extract the file then run :

      tar -xzvf simplejson-(version) 
      python (@simplejson-(version))/ 
      python (@simplejson-(version))/ build
      sudo python (@simplejson-(version))/ install 
  • IpBlockToIpAddress:
  • IpBlockToPorts:
  • IpToOs:
  • IpToOsNmap:
  • IpToPorts:
  • nmap

  • IpToOsPhp:
  • nmap

  • WebsiteToEntitiesNER:
  • UrlToEntitiesNER:
  • simplejson
    Download PyXML-0.8.4.tar.gz from
    You may need to install python2.6-dev, for example via: sudo apt-get install python2.6-dev
    Use these commands:

    tar xvzf PyXML-0.8.4.tar.gz
      cd PyXML-0.8.4
      patch -p1 < 0001-Patch-for-Python-2.6.patch
      sudo python2.6 install 
  • WebsiteToUrlMirror:
  • WebsiteToWebsiteMirror:
  • WebsiteToEmailMirror:
  • omt

  • WebsiteToPhraseWhatWeb:
  • ruby

    You can use this to install most of them.

    sudo apt-get install libnet-ip-perl libopenssl-ruby ruby-dev ruby omt php5-cli nmap libnet-dns-perl libnet-ip-perl

    Leave a Reply

    You must be logged in to post a comment.