rsolr

A Ruby client for Apache Solr

  • Owner: rsolr/rsolr
  • Platform:
  • License:: Other
  • Category::
  • Topic:
  • Like:
    0
      Compare:

Github stars Tracking Chart

=RSolr
{}[https://travis-ci.org/rsolr/rsolr] {}[http://badge.fury.io/rb/rsolr]

A simple, extensible Ruby client for Apache Solr.

==Documentation
The code docs http://www.rubydoc.info/gems/rsolr

== Installation:
gem install rsolr

== Example:
require 'rsolr'

Direct connection

solr = RSolr.connect :url => 'http://solrserver.com'

Connecting over a proxy server

solr = RSolr.connect :url => 'http://solrserver.com', :proxy=>'http://user:pass@proxy.example.com:8080'

Using an alternate Faraday adapter

solr = RSolr.connect :url => 'http://solrserver.com', :adapter => :em_http

Using a custom Faraday connection

conn = Faraday.new do, faraday, faraday.response :logger # log requests to STDOUT
faraday.adapter Faraday.default_adapter # make requests with Net::HTTP
end
solr = RSolr.connect conn, :url => 'http://solrserver.com'

send a request to /select

response = solr.get 'select', :params => {:q => ':'}

send a request to /catalog

response = solr.get 'catalog', :params => {:q => ':'}

When the Solr +:wt+ is +:ruby+, then the response will be a Hash. This Hash is the same object returned by Solr, but evaluated as Ruby. If the +:wt+ is not +:ruby+, then the response will be a String.

The response also exposes 2 attribute readers (for any +:wt+ value), +:request+ and +:response+. Both are Hash objects with symbolized keys.

The +:request+ attribute contains the original request context. You can use this for debugging or logging. Some of the keys this object contains are +:uri+, +:query+, +:method+ etc..

The +:response+ attribute contains the original response. This object contains the +:status+, +:body+ and +:headers+ keys.

== Request formats

By default, RSolr uses the Solr JSON command format for all requests.

RSolr.connect :url => 'http://solrserver.com', update_format: :json # the default

or

RSolr.connect :url => 'http://solrserver.com', update_format: :xml

== Timeouts
The read and connect timeout settings can be set when creating a new instance of RSolr:
solr = RSolr.connect(:read_timeout => 120, :open_timeout => 120)

== Retry 503s
A 503 is usually a temporary error which RSolr may retry if requested. You may specify the number of retry attempts with the +:retry_503+ option.

Only requests which specify a Retry-After header will be retried, after waiting the indicated retry interval, otherwise RSolr will treat the request as a 500. You may specify a maximum Retry-After interval to wait with the +:retry_after_limit+ option (default: one second).
solr = RSolr.connect(:retry_503 => 1, :retry_after_limit => 1)

For additional control, consider using a custom Faraday connection (see above) using its retry middleware.

== Querying
Use the #get / #post method to send search requests to the /select handler:
response = solr.get 'select', :params => {
:q=>'washington',
:start=>0,
:rows=>10
}
response["response"]["docs"].each{, doc, puts doc["id"] }

The +:params+ sent into the method are sent to Solr as-is, which is to say they are converted to Solr url style, but no special mapping is used.
When an array is used, multiple parameters with the same name are generated for the Solr query. Example:

solr.get 'select', :params => {:q=>'roses', :fq=>['red', 'violet']}

The above statement generates this Solr query:

select?q=roses&fq=red&fq=violet

===Pagination
To paginate through a set of Solr documents, use the paginate method:
solr.paginate 1, 10, "select", :params => {:q => "test"}

The first argument is the current page, the second is how many documents to return for each page. In other words, "page" is the "start" Solr param and "per-page" is the "rows" Solr param.

The paginate method returns WillPaginate ready "docs" objects, so for example in a Rails application, paginating is as simple as:
<%= will_paginate @solr_response["response"]["docs"] %>

===Method Missing
The +RSolr::Client+ class also uses +method_missing+ for setting the request handler/path:

solr.paintings :params => {:q=>'roses', :fq=>['red', 'violet']}

This is sent to Solr as:
paintings?q=roses&fq=red&fq=violet

This works with pagination as well:

solr.paginate_paintings 1, 10, {:q=>'roses', :fq=>['red', 'violet']}

===Using POST for Search Queries
There may be cases where the query string is too long for a GET request. RSolr solves this issue by converting hash objects into form-encoded strings:
response = solr.music :data => {:q => ":"}

The +:data+ hash is serialized as a form-encoded query string, and the correct content-type headers are sent along to Solr.

===Sending HEAD Requests
There may be cases where you'd like to send a HEAD request to Solr:
solr.head("admin/ping").response[:status] == 200

==Sending HTTP Headers
Solr responds to the request headers listed here: http://wiki.apache.org/solr/SolrAndHTTPCaches
To send header information to Solr using RSolr, just use the +:headers+ option:
response = solr.head "admin/ping", :headers => {"Cache-Control" => "If-None-Match"}

===Building a Request
+RSolr::Client+ provides a method for building a request context, which can be useful for debugging or logging etc.:
request_context = solr.build_request "select", :data => {:q => ":"}, :method => :post, :headers => {}

To build a paginated request use build_paginated_request:
request_context = solr.build_paginated_request 1, 10, "select", ...

== Updating Solr
Updating is done using native Ruby objects. Hashes are used for single documents and arrays are used for a collection of documents (hashes). These objects get turned into simple XML "messages". Raw XML strings can also be used.

Single document via #add
solr.add :id=>1, :price=>1.00

Multiple documents via #add
documents = [{:id=>1, :price=>1.00}, {:id=>2, :price=>10.50}]
solr.add documents

The optional +:add_attributes+ hash can also be used to set Solr "add" document attributes:
solr.add documents, :add_attributes => {:commitWithin => 10}

Raw commands via #update
solr.update data: '', headers: { 'Content-Type' => 'text/xml' }
solr.update data: { optimize: true }.to_json, headers: { 'Content-Type' => 'application/json' }

When adding, you can also supply "add" xml element attributes and/or a block for manipulating other "add" related elements (docs and fields) by calling the +xml+ method directly:

doc = {:id=>1, :price=>1.00}
add_attributes = {:allowDups=>false, :commitWithin=>10}
add_xml = solr.xml.add(doc, add_attributes) do, doc, # boost each document
doc.attrs[:boost] = 1.5
# boost the price field:
doc.field_by_name(:price).attrs[:boost] = 2.0
end

Now the "add_xml" object can be sent to Solr like:
solr.update :data => add_xml

===Deleting
Delete by id
solr.delete_by_id 1
or an array of ids
solr.delete_by_id [1, 2, 3, 4]

Delete by query:
solr.delete_by_query 'price:1.00'
Delete by array of queries
solr.delete_by_query ['price:1.00', 'price:10.00']

===Commit / Optimize
solr.commit, :commit_attributes => {}
solr.optimize, :optimize_attributes => {}

== Response Formats
The default response format is Ruby. When the +:wt+ param is set to +:ruby+, the response is eval'd resulting in a Hash. You can get a raw response by setting the +:wt+ to +"ruby"+ - notice, the string -- not a symbol. RSolr will eval the Ruby string ONLY if the :wt value is :ruby. All other response formats are available as expected, +:wt=>'xml'+ etc..

===Evaluated Ruby:
solr.get 'select', :params => {:wt => :ruby} # notice :ruby is a Symbol
===Raw Ruby:
solr.get 'select', :params => {:wt => 'ruby'} # notice 'ruby' is a String
===XML:
solr.get 'select', :params => {:wt => :xml}
===JSON (default):
solr.get 'select', :params => {:wt => :json}

==Related Resources & Projects

  • {RSolr Google Group}[http://groups.google.com/group/rsolr] -- The RSolr discussion group
  • {rsolr-ext}[http://github.com/mwmitchell/rsolr-ext] -- An extension kit for RSolr
  • {rsolr-direct}[http://github.com/mwmitchell/rsolr-direct] -- JRuby direct connection for RSolr
  • {rsolr-nokogiri}[http://github.com/mwmitchell/rsolr-nokogiri] -- Gives RSolr Nokogiri for XML generation.
  • {SunSpot}[http://github.com/sunspot/sunspot] -- An awesome Solr DSL, built with RSolr
  • {Blacklight}[http://blacklightopac.org] -- A "next generation" Library OPAC, built with RSolr
  • {java_bin}[http://github.com/kennyj/java_bin] -- Provides javabin/binary parsing for RSolr
  • {Solr}[http://lucene.apache.org/solr/] -- The Apache Solr project
  • {solr-ruby}[http://wiki.apache.org/solr/solr-ruby] -- The original Solr Ruby Gem!

== Note on Patches/Pull Requests

  • Fork the project.
  • Make your feature addition or bug fix.
  • Add tests for it. This is important so I don't break it in a future version unintentionally.
  • Commit, do not mess with rakefile, version, or history
    (if you want to have your own version, that is fine but bump version in a commit by itself I can ignore when I pull)
  • Send me a pull request. Bonus points for topic branches.

==Contributors

  • Nathan Witmer
  • Magnus Bergmark
  • shima
  • Randy Souza
  • Mat Brown
  • Jeremy Hinegardner
  • Denis Goeury
  • shairon toledo
  • Rob Di Marco
  • Peter Kieltyka
  • Mike Perham
  • Lucas Souza
  • Dmitry Lihachev
  • Antoine Latter
  • Naomi Dushay

==Author

Matt Mitchell mailto:goodieboy@gmail.com

==Copyright

Copyright (c) 2008-2010 Matt Mitchell. See LICENSE for details.

Overview

Name With Ownerrsolr/rsolr
Primary LanguageRuby
Program languageRuby (Language Count: 1)
Platform
License:Other
Release Count43
Last Release Namev2.6.0 (Posted on )
First Release Namev0.12.0 (Posted on 2010-02-03 17:10:37)
Created At2008-12-09 20:49:50
Pushed At2024-03-25 21:10:08
Last Commit At2024-03-25 16:10:08
Stargazers Count417
Watchers Count20
Fork Count143
Commits Count843
Has Issues Enabled
Issues Count85
Issue Open Count19
Pull Requests Count111
Pull Requests Open Count3
Pull Requests Close Count41
Has Wiki Enabled
Is Archived
Is Fork
Is Locked
Is Mirror
Is Private
To the top