code711 / solrtools
A set of CLI tools to manage Solr indexes for multi site setups
Installs: 2 930
Dependents: 0
Suggesters: 0
Security: 0
Stars: 1
Watchers: 1
Forks: 0
Open Issues: 0
Type:typo3-cms-extension
Requires
- php: 8.0.*||8.1.*||8.2.*||8.3.*
- apache-solr-for-typo3/solr: ^11.5||^12
- typo3/cms-core: 11.5.*||12.4.*
Requires (Dev)
- friendsoftypo3/phpstan-typo3: ^0.9
- helhum/typo3-console: *
- hmmh/solr-file-indexer: ^2.5
- typo3/cms-backend: ^11.5||^12.4
- typo3/cms-frontend: ^11.5||^12.4
- typo3/cms-install: ^11.5||^12.4
- typo3/cms-lowlevel: ^11.5||^12.4
- typo3/cms-tstemplate: ^11.5||^12.4
- typo3/coding-standards: ^0.5
- vimeo/psalm: ^4.10
Suggests
- hmmh/solr-file-indexer: ^2.5
README
This Extension provides CLI Tools to initialize the EXT:solr index queues from the command line, and to scan for file-references in the content to add the corresponding sites to the sys_file metadata where a file is being used.
The tools are aimed for installations with multiple sites. They will not do anything what could not be done in the TYPO3 Backend, but might save some time, or might be usefull in certain CI/CD Situations.
Additionally, a SolrEntityInterface is available for Extbase Models to update the solr index of a record if it has been changed through extbase in the frontend (similar to EXT:slug_extbase )
Changelog
2.0.1
- Support of TYPO3 v11-v12
- SolrfilemetaCommand.php does not set 'enable_indexing' for files on hidden pages or pages with restricted FE user access anymore
2.0.0
- Support of TYPO3 v11-v12
- SolrfilemetaCommand.php does not set 'enable_indexing' for files on hidden pages or pages with restricted FE user access anymore
1.2.0
- better handling of non-solr-configured sites
- added possibility to use the keyword 'all' with option -w/--what to create indexes for all configured tables in a site
1.1.1
- better identifier for events
1.1.0
- added
Code711\SolrTools\Interfaces\SolrEntityInterface
to enable Extbase models to update its index when persisted through extbase
1.0.2
- added promised but missing scan for file-references in tt_content:header_link
1.0.1
- Updated TER Description
1.0.0
- Initial release
Code711\SolrTools\Interfaces\SolrEntityInterface
To enable this feature for your models simply add to the models class definition of your model, for example:
class MyModel extends TYPO3\CMS\Extbase\DomainObject\AbstractEntity implements \Code711\SolrTools\Interfaces\SolrEntityInterface
now when persisting an object of this class, it will check if it is indexed in solr and if yes that its index will be added or updated through the normal scheduler process. The Interface itself has no further requirements and is only used as a marker to identify the models to watch out for.
solr:tools:createindex
./vendor/bin/typo3 solr:tools:createindex --help Description: This tool creates (re)index tasks for solr per table and site or all sites Usage: solr:tools:createindex [options] [--] ... Arguments: site Site identifier or ALL for all sites Options: -w, --what=WHAT what to index (eq pages) (multiple values allowed). Enter "all" to index all configured pages -c, --cleanup clean the solr index per site -h, --help Display help for the given command. When no command is given display help for the list command -q, --quiet Do not output any message -V, --version Display this application version --ansi|--no-ansi Force (or disable --no-ansi) ANSI output -n, --no-interaction Do not ask any interactive question -v|vv|vvv, --verbose Increase the verbosity of messages: 1 for normal output, 2 for more verbose output and 3 for debug
This tool expects EXT:solr to be set up and configured in TYPO3.
Examples
This will create index-tasks for the table pages in all Sites and it will run cleanup before that
./vendor/bin/typo3 solr:tools:createindex -w pages --cleanup ALL
This will create index-tasks for the tables tx_news and sys_file_metadata in the sites with the identifiers customer1 and customer3
./vendor/bin/typo3 solr:tools:createindex -w tx_news -w sys_file_metadata customer1 customer3
The following will create index tasks for all tables in all sites
./vendor/bin/typo3 solr:tools:createindex -w all all
solr:tools:filemeta
This tool will search the file references table and the header_link and bodytext fields for files which match the given file extensions. It will then look up the corresponding site based on the page-id associated with the record and add that site id to the enable_indexing field provided by EXT:solr_file_indexer.
The tool will check if the element is visible (deleted=0, hidden=0) and if the page and its parent pages are visible, to ensure only 'active' files are added to the solr index.
./vendor/bin/typo3 solr:tools:filemeta --help Description: This tool searches for relations of files in the database and adds the correct site reference in the Files metadata, in order for EXT:solr to index those files correctly Usage: solr:tools:filemeta [options] Options: --ext[=EXT] File extensions to allow [default: ["doc","docx","pdf"]] (multiple values allowed) -c, --cleanup clean the site field in all meta data -h, --help Display help for the given command. When no command is given display help for the list command -q, --quiet Do not output any message -V, --version Display this application version --ansi|--no-ansi Force (or disable --no-ansi) ANSI output -n, --no-interaction Do not ask any interactive question -v|vv|vvv, --verbose Increase the verbosity of messages: 1 for normal output, 2 for more verbose output and 3 for debug