Sphinx is an open source search engine designed to search text extremely quickly. It can be included in your programs to provide custom search functionality. In this document I am trying to explain you how to set it up in a linux machine and how php programs, that use mysql database, can call the sphinx search engine to provide custom search feature. So let us start with the installation part.<\/p>\n
Download and extract the tarball of sphinx<\/p>\n
[bash]<\/p>\n
$ tar xzvf sphinx-0.9.8.tar.gz
\n$ cd sphinx<\/p>\n
[\/bash]<\/pre>\nRun the configuration program:<\/p>\n
[bash]<\/p>\n
$ .\/configure<\/p>\n
[\/bash]<\/p>\n
We can specify the location where sphinx should be installed by using –prefix option.
\nBuild the binaries.<\/p>\n[bash]<\/p>\n
$ make<\/p>\n
[\/bash]<\/p>\n
Install the binaries.<\/p>\n
[bash]
\n$ make install<\/p>\n[\/bash]<\/p>\n
By default, Sphinx utilities are installed in \/usr\/local\/bin\/. Sphinx has three components: an index generator, a search engine, and a command-line search utility: The index generator is called indexer. It queries your database, indexes each column in each row of the result, and ties each index entry to the row’s primary key. The search engine is a daemon called searchd. The daemon receives search terms and other parameters, scours one or more indices, and returns a result. If a match is made, searchd returns an array of primary keys. Given those keys, an application can run a query against the associated database to find the complete records that comprise the match. Searchd communicates to applications through a socket connection on port 3312. The handy search utility lets you conduct searches from the command line without writing code. If searchd returns a match, search queries the database and displays the rows in the match set. The search utility is useful for debugging your Sphinx configuration.<\/p>\n
To use Sphinx, you will need to create a configuration file. Default configuration file name is sphinx.conf. All Sphinx programs look for this file in current working directory by default. Sample configuration file, sphinx.conf.dist, which has all the options documented, is created by configure. Copy and edit that sample file to make your own configuration.<\/p>\n
[bash]
\n$ cd \/usr\/local\/etc
\n$ cp sphinx.conf.dist sphinx.conf
\n[\/bash]<\/p>\nTo start with sphinx, you must define one or more<\/a> sources and one or more indexes. A source identifies the database to index, provides authentication information, and defines the query to use to construct each row. An index requires a source (that is, a set of rows) and defines how the data extracted from the source should be cataloged. You define your source(s) and index(es) in the sphinx.conf file. Sample configuration file is setup to index documents table from Mysql database test. So there’s example.sql sample data file to populate that table with a few documents for testing purposes.<\/p>\n
[bash]<\/p>\n
$ mysql -u test < \/usr\/local\/sphinx\/etc\/example.sql<\/p>\n
[\/bash]<\/p>\n
We need to specify database information in configuration file like the following.
\n<\/strong><\/p>\n[bash]<\/p>\n
source src1
\n{
\n# data source type. mandatory, no default value
\n# known types are mysql, pgsql, mssql, xmlpipe, xmlpipe2, odbc
\ntype = mysql<\/p>\n#####################################################################
\n## SQL settings (for ‘mysql’ and ‘pgsql’ types)
\n#####################################################################<\/p>\n# some straightforward parameters for SQL source types
\nsql_host = localhost
\nsql_user = test
\nsql_pass = test
\nsql_db = test
\nsql_port = 3306 # optional, default is 3306<\/p>\n[\/bash]<\/p>\n
Next, create a query to produce rows to be indexed. The sql_query must include the primary key you want to use for subsequent lookups, and it must include all the fields you want to index and use as groups. It is specified in the configuration file as the following.<\/p>\n
[bash]
\nsql_query = \\
\nSELECT id, group_id, UNIX_TIMESTAMP(date_added) AS date_added, title, content \\
\nFROM documents
\n[\/bash]<\/p>\nAnd the search utility uses sql_query_info to find the records that match. In the query, $id is replaced with each primary key that searchd returns.<\/p>\n
[bash]
\nsql_query_info = SELECT * FROM documents WHERE id=$id
\n[\/bash]<\/p>\nNext we need to build an index.<\/p>\n
[bash]
\nindex test1
\n{
\n# document source(s) to index
\nsource= src1
\n# index files path and file name, without extension
\n# mandatory, path must be writable, extensions will be auto-appended
\npath = \/var\/test1
\n}
\n[\/bash]<\/p>\nHere source is src1 and path defines where to store the index data. You have to make sure that this directory exists before generating the index. The searchd section at bottom configures the searchd daemon itself.<\/p>\n
[bash]
\nsearchd
\n{
\nport = 3312
\nlog = \/var\/log\/searchd\/searchd.log
\nquery_log = \/var\/log\/searchd\/query.log
\npid_file = \/var\/log\/searchd\/searchd.pid
\n}
\n[\/bash]<\/p>\nWe are now ready to build the index for the database table. Before running indexer program to generate indices you have to make sure that mysql program is running.<\/p>\n
[bash]
\n$\/usr\/local\/bin\/indexer –config \/usr\/local\/etc\/sphinx.conf –all
\nSphinx 0.9.9-release (r2117)
\nCopyright (c) 2001-2009, Andrew Aksyonoff
\nusing config file ‘\/usr\/local\/etc\/sphinx.conf’…
\nindexing index ‘test1’…
\ncollected 6 docs, 0.0 MB
\nsorted 0.0 Mhits, 100.0% done
\ntotal 6 docs, 243 bytes
\ntotal 0.018 sec, 12926 bytes\/sec, 319.16 docs\/sec<\/p>\n[\/bash]<\/p>\n
The -all argument rebuilds all the indexes listed in sphinx.conf. You can use a different argument to rebuild fewer if you don’t need to rebuild every index.<\/p>\n
You can now test the index with the search utility<\/p>\n
[bash]
\n# \/usr\/local\/bin\/search –config \/usr\/local\/etc\/sphinx.conf spark
\nSphinx 0.9.9-release (r2117)
\nCopyright (c) 2001-2009, Andrew Aksyonoff<\/p>\nusing config file ‘\/usr\/local\/etc\/sphinx.conf’…
\nindex ‘test1’: query ‘spark ‘: returned 2 matches of 2 total in 0.006 sec<\/p>\ndisplaying matches:
\n1. document=5, weight=2, group_id=2, date_added=Sun Feb 13 11:50:30 2011
\nid=5
\ngroup_id=2
\ngroup_id2=9
\ndate_added=2011-02-13 11:50:30
\ntitle=spark
\ncontent=spark support
\n2. document=6, weight=2, group_id=2, date_added=Sun Feb 13 11:53:30 2011
\nid=6
\ngroup_id=2
\ngroup_id2=10
\ndate_added=2011-02-13 11:53:30
\ntitle=spark cochin
\ncontent=spark support cochin
\n[\/bash]<\/p>\nTo query the index from your PHP<\/a> scripts, you need to run the search daemon which your script will talk to and Include the API (it’s located in api\/sphinxapi.php) into your own scripts and use it.<\/p>\n
<\/div>\n