METASEARCH.js

A Search Engine that Searches Search Engines
Peter Hanily : github.com/peaderhanily


Search Engine API's



var bing = {};bing1.url = "https://api.datamarket.azure.com/Bing/Search/Web?" +            "Query=%27"                                         +            bingQuery                                           +            "%27&$format=json"                                  +             "&$top=50";bing1.headers = {
     "Authorization" : "Basic " +     new Buffer(":" + "<BING SEARCH API KEY>")     .toString("base64")		};



var goog = {}
goog.url = 'https://www.googleapis.com/customsearch/v1?' +
           'key=<API KEY>'                               +
           '&cx=<PROJECT KEY>'                           +
           '&q='                                         +
            googleQuery                                  +
           '&alt=json';


Old Blekko

 var blekko = {}; blekko.url = 'http://blekko.com/?q=' +               blekkoQuery            +              '+/json'                +              '+/ps=100'              +              '&auth=<AUTH KEY>';


NEW BLEKKO 

 Here's why: http://help.blekko.com/index.php/does-blekko-have-an-api/

var blekko = {};blekko.url = 'http://blekko.com/?q=' +             blekkoQuery             +             '+/json'                +             '+/ps=20'               +             '&p=0';


Aggregation


Reciprocal Rank fusion (RRF)



  • Reportedly better than all other fusion methods
  • Gives preference to higher ranked results
  • Easiest to implement


Combination Multiply Non-Zero

(Comb MNZ)


  • Consistent top performer in most studies
  • Slightly harder to implement than RRF
  • scores need to be normalized first
  • Gives preferance to results that appear in more search engines



Clustering


K-Means


Steps
  1. Normalise Natural Language
  2. Create tf-idf vectors
  3. Use K-Means to cluster in k groups
  4. Use Silloutte Score to compare iterations
  5. Pick tittle for clusters


Real Time

(*Socket.io)




Suggested Search

(Google's Hidden API)



Calculator

(Another hidden Google API...)



Related Searches



Ip Address

(IP Info Db API)



THESAURUS

(Big Huge Labs API)



Bing related Search API

(Not working recently)


Results



Node.js Design Features



Questions ?