devgeniem / redipress
RediPress
Installs: 25 697
Dependents: 0
Suggesters: 0
Security: 0
Stars: 33
Watchers: 27
Forks: 5
Open Issues: 41
Type:wordpress-plugin
Requires
- php: >=7.3
- phpoffice/phpword: ^0.18
- predis/predis: ^1.1
- smalot/pdfparser: ^0.19.0
Requires (Dev)
- php-stubs/wp-cli-stubs: dev-master
Conflicts
- devgeniem/acf-codifier: <1.36.0
- johnpbloch/wordpress: <5.0
- dev-master
- 2.0.x-dev
- 2.0.11
- 2.0.10
- 2.0.9
- 2.0.8
- 2.0.7
- 2.0.6
- 2.0.5
- 2.0.4
- 2.0.3
- 2.0.2
- 2.0.1
- 2.0.0
- v1.x-dev
- 1.16.3
- 1.16.2
- 1.16.1
- 1.16.0
- 1.15.0
- 1.14.0
- 1.13.0
- 1.12.0
- 1.11.0
- 1.9.1
- 1.9.0
- 1.8.4
- 1.8.3
- 1.8.2
- 1.8.1
- 1.8.0
- 1.7.1
- 1.7.0
- 1.6.1
- 1.6.0
- 1.5.4
- 1.5.3
- 1.5.2
- 1.5.1
- 1.5.0
- 1.4.1
- 1.4.0
- 1.3.1
- 1.3.0
- 1.2.1
- 1.2.0
- 1.1.5
- 1.1.4
- 1.1.3
- 1.1.2
- 1.1.1
- 1.1.0
- v1.0.x-dev
- v1.0.2.x-dev
- 1.0.2
- 1.0.1
- 1.0.0
- 0.2.0
- 0.1.0
- 0.0.12
- 0.0.11
- 0.0.10
- 0.0.9
- 0.0.8
- 0.0.7
- 0.0.6
- 0.0.5
- 0.0.4
- 0.0.3
- 0.0.2
- 0.0.1
- dev-not-exists-fix
- dev-hotfix-escapefloatvalues
- dev-update-pdfparser
- dev-enhance-groupby-reduce
- dev-indexing-filters-fix
- dev-taxonomy-query-operator-and-hotfix
- dev-rp-1-operator-fix
- dev-fix-orderby-meta-value
- dev-dependabot/npm_and_yarn/minimist-and-minimist-and-mkdirp-1.2.8
- dev-php81-v1.x
- dev-php81
- dev-php81-usort-fix
- dev-dependabot/npm_and_yarn/tar-and-node-sass-6.1.13
- dev-dependabot/npm_and_yarn/yargs-parser-and-yargs-and-webpack-5.0.1
- dev-dependabot/npm_and_yarn/postcss-and-autoprefixer-and-css-loader-and-postcss-loader-8.4.21
- dev-dependabot/npm_and_yarn/ini-1.3.8
- dev-dependabot/npm_and_yarn/qs-6.5.3
- dev-2.0-api-require-fix
- dev-2.0-check-redisearch-no-init
- dev-dependabot/npm_and_yarn/decode-uri-component-0.2.2
- dev-dependabot/npm_and_yarn/loader-utils-1.4.2
- dev-2.0-multisite-search-docs
- dev-2.0-distance-hotfix
- dev-2.0-fixes
- dev-password
- dev-dependabot/npm_and_yarn/async-2.6.4
- dev-redipress-weighting-debugger
- dev-dependabot/npm_and_yarn/ajv-6.12.3
- dev-meta-compare-fix
- dev-empty-taxonomy-fix
- dev-RED-6-ui
- dev-recency-weights
- dev-admin-index-all-fix
- dev-relevance-fix
- dev-intport
- dev-210622-tax-query-fix
- dev-brackets-fix
- dev-210615-update
- dev-post-content-remove-tabs
- dev-groupby
- dev-delete-by-post-type
- dev-array-merge-fix
- dev-readme-update-201228
- dev-disable-pdf-indexing
- dev-gutenberg
- dev-add-array-check
- dev-tax_dash_fix
- dev-maxtextfields
- dev-groupby-fix
- dev-double-save-fix
- dev-search-post-author
- dev-taxonomy-query
- dev-no-filter-indexing
- dev-no-singular
- dev-post_types
- dev-rest-api-fix
- dev-main-query-polylang-hotfix
- dev-search-instance
- dev-voikko-support-fix
- dev-util-function-delete-doc
- dev-ftsearch
- dev-pll-multisite-query-fix
- dev-escape-dashes-fix
- dev-fix-404
- dev-escape-terms-fix
- dev-cli-fix
- dev-groupby-filter
- dev-force-tax-query
- dev-fix-offset-handling
- dev-pll-main-query-fix
- dev-asterisk-fix
- dev-return-fields
- dev-dates
- dev-cli-args
- dev-wp4
- dev-term-slug
- dev-date-query
- dev-users
- dev-v1.0-release
- dev-meta-tax-queries
- dev-multisite
- dev-dev-term-slug
- dev-wanted-taxonomies-fix
- dev-admin-panel-index
- dev-parse-files
- dev-admin-panel
- dev-fuzzysearch
- dev-fixes
- dev-weights
- dev-remove-post-object
- dev-fix-string-escaping
- dev-decrease-init-priority
- dev-serialize-additions
- dev-dash-fix
- dev-no-results-filter
- dev-fixes-190619
- dev-update_value
- dev-polylang
- dev-hotfix-orderby
- dev-hotfix-tax-query
- dev-query-var-post-parent
- dev-hotfix-190502
- dev-tax-query-operator
- dev-orderby-default
- dev-fixes-190409
- dev-post__not_in
- dev-meta_query_fix
- dev-release
- dev-tax-query
- dev-sortby
- dev-meta_query
This package is auto-updated.
Last update: 2024-09-06 05:09:30 UTC
README
A WordPress plugin that provides a blazing fast search engine and WP Query performance enhancements.
RediPress utilizes popular in-memory key-value database Redis as well as its RediSearch module, which provides a very performant full text search engine and secondary index on top of Redis.
The plugin hooks to various WordPress APIs, hooks and filters to create a replica of WordPress' posts database table in RediSearch and to keep it up-to-date. It also hooks into WP_Query
and diverts all suitable queries into RediSearch instead of MySQL, which makes the queries a lot faster, in many cases almost instant.
RediPress also provides advanced searching features that are lacking from the original WordPress search, like weighted search terms and fuzzy search.
RediPress is also built with extensive amount of hooks and filters to customize its functionalities to suit the needs of the developer. In addition to just optimizing the queries, RediPress also brings some completely new features to the table with the ability to include non-WordPress-posts in the search results or adding and querying location data within the index.
Table of Contents
- Requirements
- Installation and initialization
- Usage
- Expanding
- Third party plugins
- Troubleshooting
- WP-CLI
Requirements
- Redis + RediSearch module. At least version 2.2.1 of RediSearch is required. The plugin is tested up to version 2.6.8.
- WordPress version 5.9.0 or later. The plugin could work with earlier versions as well, but it has not been tested.
Installation and initialization
- Install Redis with RediSearch and ensure it can be connected from the WordPress installation.
- Install and activate the RediPress plugin. For now the only available installation method is through Composer.
- Define the connection parameters either in the admin panel or as constants in your code (recommended).
- If you are planning to include custom posts or additional fields in the search index, it should be done now.
- Create the index schema to RediSearch. It can be done either in the admin panel or through WP-CLI with command
wp redipress create posts
. - Run the actual indexing. It can as well be done either in the admin panel or through WP-CLI. Running the command
wp redipress index posts
is a recommended way to run the initial indexing. If the indexing stops you can continue indexing by running the commandwp redipress index posts missing
.
Indexing multisite installations
You can use the same commands with multisite: wp redipress create posts
and wp redipress index posts
. For multisite you have to specify site url with the --url
parameter in order for RediPress to function properly. Example wp redipress index --url=subsite.domain.test
.
Usage
The basic usage of RediPress goes through the WP_Query
class. You can use the class and functions that depend on it (such as get_posts()
) like you normally would, and RediPress hooks into the queries and runs them against the RediSearch database instead of the normal MySQL resulting in much lower latencies and query times.
Unlike some other similar query-speeding plugins, you don't need to add any parameters to the queries as RediPress knows what it is capable of doing and handles all queries automatically. If there is a query it can't handle, it automatically falls back to MySQL.
Extra parameters
There are some extra parameters that can be used alongside the regular parameters.
Geolocation
If you have defined geolocation fields for your index, you can query them easily with WP_Query
. The query should be placed on the root level of the WP_Query
arguments array, and look like this:
'geolocation' => [ 'field' => 'location', 'compare' => '<', 'lat' => 59.6, 'lng' => 16.5, 'distance' => 100000, ],
field
is the name of the field you have defined in the index.compare
is either<
or>
depending on whether you want to have results closer to or farther away from your reference point.lat
andlng
are the coordinates of the reference point to which the distance is calculated.distance
is the distance in meters from the reference point to which the values are compared.
Sorting
If you want to sort the WP_Query
results by a distance to certain coordinates, you can do so by defining the WP_Query
orderby
parameter like this:
'orderby' => [ [ 'orderby' => 'location', 'order' => 'ASC', 'compare' => [ 'lat' => 59.6, 'lng' => 16.5, ] ] ]
This will sort the query results by the distance to the given coordinates.
Weights
If no ordering parameters are set with a search query or if orderby
is set to relevance
, RediPress uses RediSearch's default relevance calculations for ordering the results. By default it weighs post_title
field with score 5.0
, post_excerpt
with 2.0
and other fields with 1.0
. These can all by changed by filters.
There is also a possibility to give custom weights to certain values when doing the query.
Post types
Custom weights can be given to different post types either in the admin panel or in code. In code it is done by adding a custom weight
parameter to the WP_Query
parameters with post_type
as a key and another array as its value containing the post types and their weights as key-value pairs.
new WP_Query([ 'post_type' => 'any', 'orderby' => 'relevance', 'weight' => [ 'post_type' => [ 'post' => 1.5, 'page' => 3.0, 'custom_post_type' => 7.0, ], ], ]);
Authors
You can also weigh different post authors differently. So far there is no admin functionality for this and it must be done in code.
new WP_Query([ 'post_type' => 'any', 'orderby' => 'relevance', 'weight' => [ 'author' => [ 'admin' => 1.5, 'jane_doe' => 2.0, 'john_smith' => 5.0, ], ], ]);
Taxonomy terms
It is also possible to weigh posts with certain taxonomy terms higher than others. In this case the first level inside the taxonomy
parameter is the taxonomy name with another associative array as its value with terms and their weights as key-value pairs.
new WP_Query([ 'post_type' => 'any', 'orderby' => 'relevance', 'weight' => [ 'taxonomy' => [ 'category' => [ 'news' => 3.0, 'announcements' => 5.0, ], 'post_tag' => [ 'some_tag' => 4.25, 'another_tag' => 6.0, ], ], ], ]);
Meta values
Weights can also be defined for meta values. Obviously the meta keys should be added to the RediPress index and also set to be queryable
. In this case the first level inside the meta
is the meta key with another associative array as its value with values and their weights as key-value pairs.
new WP_Query([ 'post_type' => 'any', 'orderby' => 'relevance', 'weight' => [ 'meta' => [ 'meta_key1' => [ 'foo' => 2.0, 'bar' => 3.0, ], 'another_key' => [ 'fizz' => 1.25, 'buzz' => 3.0, ], ], ], ]);
Fuzzy matching
RediPress supports fuzzy matching of search terms with the s
parameter. The setting for the Levenshtein distance can be either 1
, 2
or 3
. This can also be set in the admin panel.
new WP_Query([ 's' => 'foobar', 'post_type' => 'any', 'fuzzy' => 2, ]);
Multisite search
RediPress supports searching from multiple sites with one query by using special blog
query parameter. Set site IDs in an array to specify which sites should be targeted. You can use string 'all'
to search all sites, or omit the value to search only current site (default).
new WP_Query([ 's' => 'foobar', 'post_type' => 'any', 'blog' => [ get_main_site_id(), 2, 3 ], ]);
By default RediPress does not include the blog ID within the result objects, but you can add it by using redipress/return_fields
filter.
add_filter( 'redipress/return_fields', function ( $return_fields ) { $return_fields[] = 'blog_id'; return $return_fields; } );
After that you can use the blog_id
f. ex. in redipress/formatted_search_results
filter.
add_filter( 'redipress/formatted_search_results', function ( $results, $raw_results ) { // Format the raw results into associative array. $formatted_raw_results = array_map( function ( $result ) { return \Geniem\RediPress\Utility::format( $result ); }, $raw_results ); foreach ( $results as $key => $result ) { $raw = $formatted_raw_results[ $key ] ?? []; $result->blog_id = (int) $raw['blog_id'] ?? 0; } return $results; }, 10, 2, );
Filters
Query parts
To customize the RediSearch query, you can filter individual query parts with the following filters:
redipress/sortby
redipress/applies
redipress/filters
redipress/groupby
redipress/reduce_functions
redipress/load
Expanding
RediPress is built to be as developer-friendly as possible. Nearly everything can be filtered and there are a lot of actions to work with.
Adding custom fields
To add custom fields into the RediPress index, two things must be done: register a new field into the table schema, and add a filter which provides the data for the field during the indexing and on post save.
Adding a new schema field works with the redipress/index/posts/schema_fields
filter. (And similarly with the redipress/index/users/schema_fields
filter) It filters an array of objects that extend Geniem\RediPress\Entity\SchemaField
. For now the options are a numeric field, a text field a and tag field. The differences on these can be read from the official RediSearch documentation.
add_filter( 'redipress/index/posts/schema_fields', function( $fields ) { $fields[] = new \Geniem\RediPress\Entity\TextField([ 'name' => 'my_field_name', 'weight' => 1.5, 'sortable' => true, ]); return $fields; }, 10, 1 );
Notice The index needs to be re-created if new fields are created. This happens with the wp redipress drop posts
command, which - unlike the 1.x versions - does not empty the index but rather drops only the schema which can then be re-created using the create
command.
When the custom field is created and in the schema, the next is step to provide a function that populates the data for the field. This is done via the redipress/additional_field/{field_name}
filter. The filter gets called every time the post is indexed, regardless of whether it is done on save post action, on a complete re-index or for example via WP-CLI command.
add_filter( 'redipress/additional_field/my_field_name', function( $data, $post_id, $post ) { return get_post_meta( $post_id, 'my_field_name', true ); }, 10, 1 );
Modifying the post object
RediPress stores the post object serialized in its index. It can be modified before saving which allows the developer to store additional data for the post to be used after it's retrieved from the database.
This happens with the redipress/post_object
filter. In the example below, all ACF fields of the post are included in the object.
add_filter( 'redipress/post_object', function( $post ) { $post->fields = \get_fields( $post->ID ); return $post; }, 10, 1 );
Third party plugins
Advanced Custom Fields
There is a lot of functionality in ACF Codifier for working with RediPress. Without Codifier, ACF fields should be included in the index via filters.
Polylang
RediPress supports Polylang out of the box. Other multi-language plugins may require some coding to work.
Troubleshooting
If you run into problems you can try dropping all indexes by running wp redipress drop posts
. You can also delete all posts adding --delete-data
flag for the command. After this re-index.
WP-CLI
command: wp redipress delete
description: Delete posts from the index by the arguments. arguments:
document field:
Any field from the document that should match the given value.limit:
If not defined the default value is 100.
example usage:
wp redipress delete --blog_id=1 --post_type=article --limit=500