bossman-gem
bossman-gem copied to clipboard
Ruby gem for interacting with Yahoo's BOSS web service. BOSS is kind of moribund, so I'm not really maintaining this anymore.
BOSSMan -- Gem for interaction with the Yahoo BOSS web service
Fork info
This is a fork of the original BOSSMan gem. The form enables SearchMonkey usage. To make this work it parses the XML response coming from Yahoo BOSS (since the JSON response doesn't include the SearchMonkey RDF).
You can now do something like:
boss = BOSSMan::Search.web("yelp restaurant", :count => 5, :filter => "-hate", :view => "searchmonkey_rdf", :format => "xml")
Description
BOSSMan can be used to perform image, web and news searches against Yahoo's index. For more information about BOSS (Build your Own Search Service) please refer to http://developer.yahoo.com/search/boss/.
Bugs, Features, Feedback
Tickets can be submitted by via GitHub issues.
Example Usage
Setup
require 'bossman'
BOSSMan.application_id = [Your Application ID]
Web
boss = BOSSMan::Search.web("prospect park", :count => 5, :filter => "-hate")
puts "Matches:"
puts
boss.results.each { |result| puts "#{result.title} [#{result.url}]" }
=> Matches:
<b>Prospect</b> <b>Park</b> Alliance [http://www.prospectpark.org/]
<b>Prospect</b> <b>Park</b> (Brooklyn) - Wikipedia, the free encyclopedia [http://en.wikipedia.org/wiki/Prospect_Park_(Brooklyn)]
About <b>Prospect</b> <b>Park</b> [http://www.prospectpark.org/about]
<b>Prospect</b> <b>Park</b> Zoo [http://www.prospectparkzoo.com/]
<b>Prospect</b> <b>Park</b> [http://www.prospectpark.net/]
News
boss = BOSSMan::Search.news("brooklyn new york", :age => "1h")
puts boss.results.first.title
puts "-" * 80
puts boss.results.first.abstract
=> Brooklyn Park Helps Homeless
--------------------------------------------------------------------------------
When people lose their homes, they often turn to shelters as a last resort. Now, the City of Broo...
Images
boss = BOSSMan::Search.images("brooklyn dumbo", :dimensions => "large")
boss.results.map { |result| result.url }
=> ["http://static.flickr.com/71/216529430_bf36a6c40b.jpg", "http://static.flickr.com/3215/2771873360_7cf2d7e572.jpg", "http://static.flickr.com/149/360481219_3ab59470cc.jpg", "http://static.flickr.com/3136/2768629082_bc0dcb76a3.jpg", "http://www.wirednewyork.com/brooklyn/dumbo/dumbo_brooklyn_bridge_3march02.jpg", "http://www.wirednewyork.com/brooklyn/dumbo/dumbo_brooklyn_bridge_plymouth_4july03.jpg", "http://static.flickr.com/3611/3538565901_f81eb52825.jpg", "http://static.flickr.com/2145/3539377152_1fd629db12.jpg", "http://static.flickr.com/2082/2340123052_fb8afe43b6.jpg", "http://static.flickr.com/3617/3508763096_ec8c53c061.jpg"]
Spelling
boss = BOSSMan::Search.spelling("Diabretes")
boss.suggestion
=> Diabetes
BOSS Site Explorer
se_inlink can be used to query Yahoo for sites that link to a given URL:
links = BOSSMan::Search.se_inlink("www.wnyc.com")
links.results.map { |result| result.url }
=> ["http://www.wnyc.org/", "http://www.onthemedia.org/", "http://www.wnyc.org/shows/radiolab/", "http://cityroom.blogs.nytimes.com/2008/01/22/actor-heath-ledger-is-found-dead", "http://www.streetsblog.org/", "http://cityroom.blogs.nytimes.com/", "http://www.notmuch.com/", "http://www.williams-syndrome.org/", "http://www.manhattancc.org/", "http://scienceblogs.com/grrlscientist/"]
se_pagedata will return a list of pages underneath a given subdomain:
pages = BOSSMan::Search.se_inlink("www.webmd.com")
pages.results.map { |result| result.url }
=> ["http://www.webmd.com/", "http://www.webmd.com/allergies", "http://www.webmd.com/a-to-z-guides/temporomandibular-disorders", "http://www.webmd.com/oral-health/dental-crowns", "http://www.webmd.com/oral-health/dental-health-bridges", "http://www.webmd.com/oral-health/dental-implants", "http://www.webmd.com/oral-health/guide/canker-sores", "http://www.webmd.com/oral-health/guide/teeth-grinding-bruxism", "http://www.webmd.com/oral-health/guide/gingivitis-periodontal-disease", "http://www.webmd.com/oral-health/guide/plaque-and-your-teeth"]
Output Properties
Common
- search.responsecode : HTTP response code
- search.nextpage : REST URL to next page of search results
- search.count : Number of search results contained in response
- search.start : Search result from which output starts
- search.totalhits : De-duplicated total number of results search yielded
- search.deephits : Total number of results search yielded
- search.results[].clickurl : Tracking URL of result; must be used in user-facing anchor tags by BOSS TOU
- search.results[].url : URL of result
- search.results[].title : Title of item
- search.results[].abstract : Description of item
Web
- search.results[].dispurl : Display URL of result
- search.results[].size : Size of result in bytes
- search.results[].date : Date result was indexed
News
- search.results[].language : Language of news story
- search.results[].date : Last publication date of news story
- search.results[].time : Last publication time of news story
- search.results[].source : Source of news story
- search.results[].sourceurl : URL of source publication
Images
- search.results[].filename : Filename of image
- search.results[].size : Size of image
- search.results[].format : Format of image
- search.results[].height : Height of full-size image
- search.results[].date : Last modification date of image (yyyy/mm/dd)
- search.results[].mimetype : MIME type of image
- search.results[].refererclickurl : Link to page where image was found
- search.results[].refererurl : Link to page where image was found
- search.results[].width : Width of full-size image
- search.results[].thumbnail_url : URL of thumbnail image
- search.results[].thumbnail_height : Height of thumbnail image
- search.results[].thumbnail_width : Width of thumbnail image
Spelling
- search.suggestion : Returns spelling suggestion from BOSS
Other formats
Result sets can be dumped as JSON, XML and YAML by use of to_json, to_xml, to_yaml respectively.
- search.to_xml : dumps XML of the result set
- search.to_json : dumps JSON of the result set
- search.to_yaml : dumps YAML of the result set
- search.results[].to_xml : dumps XML of one search result
- search.results[].to_json : dumps JSON of one search result
- search.results[].to_yaml : dumps YAML of one search result
Installation
jp@populuxe:~$ gem install bossman
Requirements
- FakeWeb = 1.2.6
- RSpec >= 1.2.9
- Active Support >= 2.1
LICENSE:
(The MIT License)
Copyright (c) 2008-2010 John Pignata
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the 'Software'), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED 'AS IS', WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.