javer / sphinx-bundle
Provides integration of Sphinx search engine with Symfony using SphinxQL
Installs: 142 716
Dependents: 1
Suggesters: 0
Security: 0
Stars: 24
Watchers: 8
Forks: 19
Open Issues: 4
Type:symfony-bundle
Requires
- php: >=8.0
- ext-pcntl: *
- ext-pdo: *
- ext-posix: *
Requires (Dev)
- behat/behat: ^3.7
- doctrine/dbal: ^2.12 || ^3.0
- doctrine/orm: ^2.8
- knplabs/knp-components: ^3.0 || ^4.0
- phpstan/phpstan: ^1.0
- phpunit/phpunit: ^9.3
- psr/log: ^1.0 || ^2.0 || ^3.0
- squizlabs/php_codesniffer: 3.7.*
- swivl/php-coding-standard: ^1.4
- symfony/config: ^4.4 || ^5.0 || ^6.0
- symfony/dependency-injection: ^4.4 || ^5.0 || ^6.0
- symfony/event-dispatcher: ^4.4 || ^5.0 || ^6.0
- symfony/http-foundation: ^4.4 || ^5.0 || ^6.0
- symfony/http-kernel: ^4.4 || ^5.0 || ^6.0
Suggests
- behat/behat: to be able to test search
- behat/symfony2-extension: to be able to test search
- doctrine/orm: to allow usage with Doctrine ORM
- friends-of-behat/symfony-extension: to be able to test search
- knplabs/knp-paginator-bundle: to allow usage with Knp Paginator
README
This bundle provides integration of Sphinx search engine with Symfony.
Features:
- SphinxQL Query Builder
- Integration with doctrine/orm
- Integration with knplabs/knp-paginator-bundle
- Symfony Profiler toolbar section with number of executed queries and profiler page with detailed information about executed queries
- Ability to test search using Behat scenarios
Requirements
- PHP 8.0+
- pdo_mysql php extension
Installation
Install the bundle using composer:
composer require javer/sphinx-bundle
Configuration
Add to your app/config/config.yml
the following options:
javer_sphinx: host: 127.0.0.1 port: 9306
Full configuration with default values:
javer_sphinx: host: 127.0.0.1 port: 9306 config_path: "%kernel.project_dir%/config/sphinx.conf" data_dir: "%kernel.cache_dir%/sphinx" searchd_path: searchd
Usage
Synthetic example of SELECT query which returns an array:
$results = $this->container->get('sphinx') ->select('id', 'column1', 'column2', 'WEIGHT() as weight') ->from('index1', 'index2') ->where('column3', 'value1') ->where('column4', '>', 4) ->where('column5', [5, '6']) ->where('column6', 'NOT IN', [7, '8']) ->where('column7', 'BETWEEN', [9, 10]) ->match('column8', 'value2') ->match(['column9', 'column10'], 'value3') ->groupBy('column11') ->groupBy('column12') ->withinGroupOrderBy('column13', 'desc') ->withinGroupOrderBy('column14') ->having('weight', '>', 2) ->orderBy('column15', 'desc') ->orderBy('column16') ->offset(5) ->limit(10) ->option('agent_query_timeout', 10000) ->option('max_matches', 1000) ->option('field_weights', '(column9=10, column10=3)') ->getResults();
Paginate a list of entities fetched from the database using Doctrine ORM QueryBuilder by searching phrase in them using Sphinx:
$queryBuilder = $this->container->get('doctrine.orm.default_entity_manager') ->createQueryBuilder() ->select('p', 'i') ->from('AppBundle:Product', 'p') ->join('AppBundle:Image', 'i') ->where('p.owner = :owner') ->setParameter('owner', $this->getUser()); $query = $this->container->get('sphinx') ->createQuery() ->select('*') ->from('product') ->match(['name', 'description'], $searchQuery) ->where('owner_id', $this->getUser()->getId()) ->orderBy('created', 'desc') ->useQueryBuilder($queryBuilder, 'p'); $paginator = $this->container->get('knp_paginator') ->paginate($query, $request->query->get('page', 1), 20);
Sample shpinx.conf for the given example above:
source product
{
type = mysql
sql_host = localhost
sql_user = user
sql_pass = password
sql_db = database_name
sql_query = \
SELECT p.id, p.owner_id, p.name, p.description, UNIX_TIMESTAMP(p.created) as created, \
FROM product p \
WHERE p.deletedAt IS NULL
sql_attr_uint = owner_id
sql_attr_timestamp = created
}
index product
{
source = product
path = /usr/local/var/data/product
morphology = stem_en
min_stemming_len = 3
}
Behat tests
To be able to test search in Behat scenarios there is built-in behat context SphinxContext.
Installation with behat/symfony2-extension
To use it you should add this context in your behat.yml, for example:
selenium: extensions: Behat\Symfony2Extension: ~ suites: frontend: contexts: - Javer\SphinxBundle\Behat\Context\SphinxContext
Please note that Symfony2Extension Behat extension is required to be able to use this feature.
Installation with friends-of-behat/symfony-extension
Register SphinxDIContext in the container:
#config/services_test.yaml services: Javer\SphinxBundle\Behat\Context\SphinxDIContext: arguments: $container: '@test.service_container'
and then use it in your behat.yml:
default: suites: default: contexts: - Javer\SphinxBundle\Behat\Context\SphinxDIContext
Usage
Then you should add a new step to your scenario:
Given I create search index and run sphinx
This step:
- creates a new configuration for sphinx based on your configuration
- converts all MySQL indexes to real-time indexes
- starts daemon
- loads data from the database to indexes for converted MySQL -> real-time indexes
- stops daemon at the end of the scenario
Please note that you should explicitly declare all text fields in your indexes in the following form:
source product
{
#!sql_field_string = name
}
It is not necessary when you declare fields for MySQL index in sphinx.conf, but it is needed to be able to convert indexes to real-time.
If you use sqlite as the database engine for running tests you should take into account that not all functions of the MySQL are presented in sqlite, so you should use portable analogs for these functions:
IF(condition, true, false)
->CASE WHEN condition THEN true ELSE false END
- and so on
Docker
You can use a docker image to run the daemon in the docker container for the test environment, just add the following configuration option to config/packages/test/javer_sphinx.yaml
:
javer_sphinx: docker_image: javer/sphinx