glukkkk / sphinxql-query-builder
A PHP query builder for SphinxQL. Uses MySQLi to connect to the Sphinx server.
Requires
- php: ^7.1 || ^8
Requires (Dev)
- phpunit/phpunit: ^7 || ^8 || ^9 || ^10
- dev-master
- 4.0.2
- 4.0.1
- 4.0.0
- 2.0.0
- 1.2.0
- 1.1.1
- 1.1.0
- 1.0.4
- 1.0.3
- 1.0.2
- 1.0.1
- 1.0.0
- 0.9.x-dev
- 0.9.9
- 0.9.8
- 0.9.7
- 0.9.6
- 0.9.5
- 0.9.4
- 0.9.3
- 0.9.2
- 0.9.1
- 0.9.0
- 0.8.6
- 0.8.5
- 0.8.4
- 0.8.3
- 0.8.2
- 0.8.1
- 0.8.0
- 0.2.2-alpha
- 0.2.1-alpha
- 0.2.0-alpha
- 0.1.6-alpha
- 0.1.4-alpha
- 0.1.3-alpha
- 0.1.2-alpha
- 0.1.1-alpha
- dev-glukkkk-patch-2
- dev-fix/float-in-where-compiling
- dev-glukkkk-patch-1
- dev-issue-176
This package is auto-updated.
Last update: 2024-11-28 15:19:59 UTC
README
About
This is a SphinxQL Query Builder used to work with SphinxQL, a SQL dialect used with the Sphinx search engine and it's fork Manticore. It maps most of the functions listed in the SphinxQL reference and is generally faster than the available Sphinx API.
This Query Builder has no dependencies except PHP 7.1 or later, \MySQLi
extension, PDO
, and Sphinx/Manticore.
Missing methods?
SphinxQL evolves very fast.
Most of the new functions are static one liners like SHOW PLUGINS
. We'll avoid trying to keep up with these methods, as they are easy to just call directly ((new SphinxQL($conn))->query($sql)->execute()
). You're free to submit pull requests to support these methods.
If any feature is unreachable through this library, open a new issue or send a pull request.
Code Quality
The majority of the methods in the package have been unit tested.
The only methods that have not been fully tested are the Helpers, which are mostly simple shorthands for SQL strings.
How to Contribute
Pull Requests
- Fork the SphinxQL Query Builder repository
- Create a new branch for each feature or improvement
- Submit a pull request from each branch to the master branch
It is very important to separate new features or improvements into separate feature branches, and to send a pull request for each branch. This allows me to review and pull in new features or improvements individually.
Style Guide
All pull requests must adhere to the PSR-2 standard.
Unit Testing
All pull requests must be accompanied by passing unit tests and complete code coverage. The SphinxQL Query Builder uses
phpunit
for testing.
Installation
This is a Composer package. You can install this package with the following command: composer require foolz/sphinxql-query-builder
Usage
The following examples will omit the namespace.
<?php use Foolz\SphinxQL\SphinxQL; use Foolz\SphinxQL\Drivers\Mysqli\Connection; // create a SphinxQL Connection object to use with SphinxQL $conn = new Connection(); $conn->setParams(array('host' => 'domain.tld', 'port' => 9306)); $query = (new SphinxQL($conn))->select('column_one', 'colume_two') ->from('index_ancient', 'index_main', 'index_delta') ->match('comment', 'my opinion is superior to yours') ->where('banned', '=', 1); $result = $query->execute();
Drivers
We support the following database connection drivers:
- Foolz\SphinxQL\Drivers\Mysqli\Connection
- Foolz\SphinxQL\Drivers\Pdo\Connection
Connection
-
$conn = new Connection()
Create a new Connection instance to be used with the following methods or SphinxQL class.
-
$conn->setParams($params = array('host' => '127.0.0.1', 'port' => 9306))
Sets the connection parameters used to establish a connection to the server. Supported parameters: 'host', 'port', 'socket', 'options'.
-
$conn->query($query)
Performs the query on the server. Returns a
ResultSet
object containing the query results.
More methods are available in the Connection class, but usually not necessary as these are handled automatically.
SphinxQL
-
new SphinxQL($conn)
Creates a SphinxQL instance used for generating queries.
Bypass Query Escaping
Often, you would need to call and run SQL functions that shouldn't be escaped in the query. You can bypass the query escape by wrapping the query in an \Expression
.
-
SphinxQL::expr($string)
Returns the string without being escaped.
Query Escaping
There are cases when an input must be escaped in the SQL statement. The following functions are used to handle any escaping required for the query.
-
$sq->escape($value)
Returns the escaped value. This is processed with the
\MySQLi::real_escape_string()
function. -
$sq->quoteIdentifier($identifier)
Adds backtick quotes to the identifier. For array elements, use
$sq->quoteIdentifierArray($arr)
. -
$sq->quote($value)
Adds quotes to the value and escapes it. For array elements, use
$sq->quoteArr($arr)
. -
$sq->escapeMatch($value)
Escapes the string to be used in
MATCH
. -
$sq->halfEscapeMatch($value)
Escapes the string to be used in
MATCH
. The following characters are allowed:-
,|
, and"
.Refer to
$sq->match()
for more information.
SELECT
-
$sq = (new SphinxQL($conn))->select($column1, $column2, ...)->from($index1, $index2, ...)
Begins a
SELECT
query statement. If no column is specified, the statement defaults to using*
. Both$column1
and$index1
can be arrays.
INSERT, REPLACE
This will return an INT
with the number of rows affected.
-
$sq = (new SphinxQL($conn))->insert()->into($index)
Begins an
INSERT
. -
$sq = (new SphinxQL($conn))->replace()->into($index)
Begins an
REPLACE
. -
$sq->set($associative_array)
Inserts an associative array, with the keys as the columns and values as the value for the respective column.
-
$sq->value($column1, $value1)->value($column2, $value2)->value($column3, $value3)
Sets the value of each column individually.
-
$sq->columns($column1, $column2, $column3)->values($value1, $value2, $value3)->values($value11, $value22, $value33)
Allows the insertion of multiple arrays of values in the specified columns.
Both
$column1
and$index1
can be arrays.
UPDATE
This will return an INT
with the number of rows affected.
-
$sq = (new SphinxQL($conn))->update($index)
Begins an
UPDATE
. -
$sq->value($column1, $value1)->value($column2, $value2)
Updates the selected columns with the respective value.
-
$sq->set($associative_array)
Inserts the associative array, where the keys are the columns and the respective values are the column values.
DELETE
Will return an array with an INT
as first member, the number of rows deleted.
-
$sq = (new SphinxQL($conn))->delete()->from($index)->where(...)
Begins a
DELETE
.
WHERE
-
$sq->where($column, $operator, $value)
Standard WHERE, extended to work with Sphinx filters and full-text.
<?php // WHERE `column` = 'value' $sq->where('column', 'value'); // WHERE `column` = 'value' $sq->where('column', '=', 'value'); // WHERE `column` >= 'value' $sq->where('column', '>=', 'value'); // WHERE `column` IN ('value1', 'value2', 'value3') $sq->where('column', 'IN', array('value1', 'value2', 'value3')); // WHERE `column` NOT IN ('value1', 'value2', 'value3') $sq->where('column', 'NOT IN', array('value1', 'value2', 'value3')); // WHERE `column` BETWEEN 'value1' AND 'value2' // WHERE `example` BETWEEN 10 AND 100 $sq->where('column', 'BETWEEN', array('value1', 'value2'));
It should be noted that
OR
and parenthesis are not supported and implemented in the SphinxQL dialect yet.
MATCH
-
$sq->match($column, $value, $half = false)
Search in full-text fields. Can be used multiple times in the same query. Column can be an array. Value can be an Expression to bypass escaping (and use your own custom solution).
<?php $sq->match('title', 'Otoshimono') ->match('character', 'Nymph') ->match(array('hates', 'despises'), 'Oregano');
By default, all inputs are escaped. The usage of
SphinxQL::expr($value)
is required to bypass the default escaping and quoting function.The
$half
argument, if set totrue
, will not escape and allow the usage of the following characters:-
,|
,"
. If you plan to use this feature and expose it to public interfaces, it is recommended that you wrap the query in atry catch
block as the character order maythrow
a query error.<?php use Foolz\SphinxQL\SphinxQL; try { $result = (new SphinxQL($conn)) ->select() ->from('rt') ->match('title', 'Sora no || Otoshimono', true) ->match('title', SphinxQL::expr('"Otoshimono"/3')) ->match('loves', SphinxQL::expr(custom_escaping_fn('(you | me)'))); ->execute(); } catch (\Foolz\SphinxQL\DatabaseException $e) { // an error is thrown because two `|` one after the other aren't allowed }
GROUP, WITHIN GROUP, ORDER, OFFSET, LIMIT, OPTION
-
$sq->groupBy($column)
GROUP BY $column
-
$sq->withinGroupOrderBy($column, $direction = null)
WITHIN GROUP ORDER BY $column [$direction]
Direction can be omitted with
null
, or beASC
orDESC
case insensitive. -
$sq->orderBy($column, $direction = null)
ORDER BY $column [$direction]
Direction can be omitted with
null
, or beASC
orDESC
case insensitive. -
$sq->offset($offset)
LIMIT $offset, 9999999999999
Set the offset. Since SphinxQL doesn't support the
OFFSET
keyword,LIMIT
has been set at an extremely high number. -
$sq->limit($limit)
LIMIT $limit
-
$sq->limit($offset, $limit)
LIMIT $offset, $limit
-
$sq->option($name, $value)
OPTION $name = $value
Set a SphinxQL option such as
max_matches
orreverse_scan
for the query.
TRANSACTION
-
(new SphinxQL($conn))->transactionBegin()
Begins a transaction.
-
(new SphinxQL($conn))->transactionCommit()
Commits a transaction.
-
(new SphinxQL($conn))->transactionRollback()
Rollbacks a transaction.
Executing and Compiling
-
$sq->execute()
Compiles, executes, and returns a
ResultSet
object containing the query results. -
$sq->executeBatch()
Compiles, executes, and returns a
MultiResultSet
object containing the multi-query results. -
$sq->compile()
Compiles the query.
-
$sq->getCompiled()
Returns the last query compiled.
-
$sq->getResult()
Returns the
ResultSet
orMultiResultSet
object, depending on whether single or multi-query have been executed last.
Multi-Query
-
$sq->enqueue(SphinxQL $next = null)
Queues the query. If a $next is provided, $next is appended and returned, otherwise a new SphinxQL object is returned.
-
$sq->executeBatch()
Returns a
MultiResultSet
object containing the multi-query results.
<?php use Foolz\SphinxQL\SphinxQL; $result = (new SphinxQL($this->conn)) ->select() ->from('rt') ->match('title', 'sora') ->enqueue((new SphinxQL($this->conn))->query('SHOW META')) // this returns the object with SHOW META query ->enqueue() // this returns a new object ->select() ->from('rt') ->match('content', 'nymph') ->executeBatch();
$result
will contain MultiResultSet
object. Sequential calls to the $result->getNext()
method allow you to get a ResultSet
object containing the results of the next enqueued query.
Query results
ResultSet
Contains the results of the query execution.
-
$result->fetchAllAssoc()
Fetches all result rows as an associative array.
-
$result->fetchAllNum()
Fetches all result rows as a numeric array.
-
$result->fetchAssoc()
Fetch a result row as an associative array.
-
$result->fetchNum()
Fetch a result row as a numeric array.
-
$result->getAffectedRows()
Returns the number of affected rows in the case of a DML query.
MultiResultSet
Contains the results of the multi-query execution.
-
$result->getNext()
Returns a
ResultSet
object containing the results of the next query.
Helper
The Helper
class contains useful methods that don't need "query building".
Remember to ->execute()
to get a result.
-
Helper::pairsToAssoc($result)
Takes the pairs from a SHOW command and returns an associative array key=>value
The following methods return a prepared SphinxQL
object. You can also use ->enqueue($next_object)
:
<?php use Foolz\SphinxQL\SphinxQL; $result = (new SphinxQL($this->conn)) ->select() ->from('rt') ->where('gid', 9003) ->enqueue((new Helper($this->conn))->showMeta()) // this returns the object with SHOW META query prepared ->enqueue() // this returns a new object ->select() ->from('rt') ->where('gid', 201) ->executeBatch();
(new Helper($conn))->showMeta() => 'SHOW META'
(new Helper($conn))->showWarnings() => 'SHOW WARNINGS'
(new Helper($conn))->showStatus() => 'SHOW STATUS'
(new Helper($conn))->showTables() => 'SHOW TABLES'
(new Helper($conn))->showVariables() => 'SHOW VARIABLES'
(new Helper($conn))->setVariable($name, $value, $global = false)
(new Helper($conn))->callSnippets($data, $index, $query, $options = array())
(new Helper($conn))->callKeywords($text, $index, $hits = null)
(new Helper($conn))->describe($index)
(new Helper($conn))->createFunction($udf_name, $returns, $soname)
(new Helper($conn))->dropFunction($udf_name)
(new Helper($conn))->attachIndex($disk_index, $rt_index)
(new Helper($conn))->flushRtIndex($index)
(new Helper($conn))->optimizeIndex($index)
(new Helper($conn))->showIndexStatus($index)
(new Helper($conn))->flushRamchunk($index)
Percolate
The Percolate
class provides methods for the "Percolate query" feature of Manticore Search.
For more information about percolate queries refer the Percolate Query documentation.
INSERT
The Percolate class provide a dedicated helper for inserting queries in a percolate
index.
<?php use Foolz\SphinxQL\Percolate; $query = (new Percolate($conn)) ->insert('full text query terms',false) ->into('pq') ->tags(['tag1','tag2']) ->filter('price>3') ->execute();
-
$pq = (new Percolate($conn))->insert($query,$noEscape)
Begins an
INSERT
. A single query is allowed to be added per insert. By default, the query string is escaped. Optional second parameter$noEscape
can be set totrue
for not applying the escape. -
$pq->into($index)
Set the percolate index for insert.
-
$pq->tags($tags)
Set a list of tags per query. Accepts array of strings or string delimited by comma
-
$pq->filter($filter)
Sets an attribute filtering string. The string must look the same as string of an WHERE attribute filters clause -
$pq->execute()
Execute the
INSERT
.
CALLPQ
Searches for stored queries that provide matching for input documents.
<?php use Foolz\SphinxQL\Percolate; $query = (new Percolate($conn)) ->callPQ() ->from('pq') ->documents(['multiple documents', 'go this way']) ->options([ Percolate::OPTION_VERBOSE => 1, Percolate::OPTION_DOCS_JSON => 1 ]) ->execute();
-
$pq = (new Percolate($conn))->callPQ()
Begins a
CALL PQ
-
$pq->from($index)
Set percolate index.
-
$pq->documents($docs)
Set the incoming documents. $docs can be:
- a single plain string (requires
Percolate::OPTION_DOCS_JSON
set to 0) - array of plain strings (requires
Percolate::OPTION_DOCS_JSON
set to 0) - a single JSON document
- an array of JSON documents
- a JSON object containing an array of JSON objects
- a single plain string (requires
-
$pq->options($options)
Set options of
CALL PQ
. Refer the Manticore docs for more information about theCALL PQ
parameters.- Percolate::OPTION_DOCS_JSON (
as docs_json
) default to 1 (docs are json objects). Needs to be set to 0 for plain string documents. Documents added as associative arrays will be converted to JSON when sending the query to Manticore. - Percolate::OPTION_VERBOSE (
as verbose
) more information is printed by followingSHOW META
, default is 0 - Percolate::OPTION_QUERY (
as query
) returns all stored queries fields , default is 0 - Percolate::OPTION_DOCS (
as docs
) provide result set as per document matched (instead of per query), default is 0
- Percolate::OPTION_DOCS_JSON (
-
$pq->execute()
Execute the
CALL PQ
.
Laravel
Laravel's dependency injection and realtime facades brings more convenience to SphinxQL Query Builder usage.
// Register connection: use Foolz\SphinxQL\Drivers\ConnectionInterface; use Foolz\SphinxQL\Drivers\Mysqli\Connection; use Illuminate\Support\ServiceProvider; class AppServiceProvider extends ServiceProvider { public function register() { $this->app->singleton(ConnectionInterface::class, function ($app) { $conn = new Connection(); $conn->setParams(['host' => 'domain.tld', 'port' => 9306]); return $conn; }); } } // In another file: use Facades\Foolz\SphinxQL\SphinxQL; $result = SphinxQL::select('column_one', 'colume_two') ->from('index_ancient', 'index_main', 'index_delta') ->match('comment', 'my opinion is superior to yours') ->where('banned', '=', 1) ->execute();
Facade access also works with Helper
and Percolate
.