juanantoniodelgado/stopwords

A stopwords removal library

1.3 2022-02-28 21:17 UTC

Requires

• php: >=7.3
• ext-json: *
• ext-mbstring: *

Requires (Dev)

• phpunit/phpunit: ^9
• squizlabs/php_codesniffer: 3.*

CC-BY-4.0

• Juan Antonio Delgado

• stop words
• stop-words
• stopwords

README

PHP StopWords removal library with support for multiple languages.

Installation

composer require juanantoniodelgado/stopwords

Usage

use StopWords/StopWords;

$stopwords = new StopWords('en');
$stopwords->clean('your text to clean');

Supported languages

Arabic, Armenian, Basque, Bulgarian, Catalan, Cebuano, Chinese, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Gujarati, Hebrew, Hindi, Hungarian, Indonesian, Italian, Japanese, Latvian, Malay, Norwegian, Persian, Portuguese, Romanian, Russian, Slovak, Spanish, Swedish, Thai, Turkish, Ukrainian, and Vietnamese.

Notes

Language files are set according to ISO 639-2.

Sources

Language	Source
Arabic	https://github.com/Alir3z4/stop-words/blob/master/arabic.txt
Armenian	https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OmM1NzgyOTk3NDA4NGJhZQ
Basque	http://www.ranks.nl/stopwords/basque
Bulgarian	https://github.com/Alir3z4/stop-words/blob/master/bulgarian.txt
Catalan	http://www.ranks.nl/stopwords/catalan http://latel.upf.edu/morgana/altres/pub/ca_stop.htm
Cebuano	https://github.com/digitalheir/cebuano-dictionary-js/blob/master/stop-words/stop-words.ts
Chinese	https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OjRmZjlhYTNkNWZjMTc3NWI
Czech	https://github.com/Alir3z4/stop-words/blob/master/czech.txt
Danish	https://github.com/Alir3z4/stop-words/blob/master/danish.txt
Dutch	https://github.com/Alir3z4/stop-words/blob/master/dutch.txt
English	http://www.ranks.nl/stopwords
Estonian	https://github.com/stopwords-iso/stopwords-et
Finnish	https://github.com/Alir3z4/stop-words/blob/master/finnish.txt
French	http://www.ranks.nl/stopwords/french https://github.com/Alir3z4/stop-words/blob/master/french.txt
German	https://github.com/Alir3z4/stop-words/blob/master/german.txt
Greek	https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OjI5MzI4MDRjMzk3M2Y2OWU
Gujarati	https://github.com/Alir3z4/stop-words/blob/master/gujarati.txt
Hebrew	https://github.com/Alir3z4/stop-words/blob/master/hebrew.txt
Hindi	https://github.com/Alir3z4/stop-words/blob/master/hindi.txt
Hungarian	https://github.com/Alir3z4/stop-words/blob/master/hungarian.txt
Indonesian	https://github.com/Alir3z4/stop-words/blob/master/indonesian.txt
Italian	https://raw.githubusercontent.com/Alir3z4/stop-words/master/italian.txt
Japanese	https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OjdhNWQxZGQwOTE3ZjVkY2M
Latvian	https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OjNiNGI5YTVmYjkxOWEwYmQ
Malay	https://github.com/Alir3z4/stop-words/blob/master/malaysian.txt
Norwegian	https://raw.githubusercontent.com/Alir3z4/stop-words/master/norwegian.txt
Persian	https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxrZXZpbmJvdWdlfGd4OjY0MWMxMDBjZTc2Y2ZmZjk
Portuguese	https://raw.githubusercontent.com/Alir3z4/stop-words/master/portuguese.txt
Romanian	https://raw.githubusercontent.com/Alir3z4/stop-words/master/romanian.txt
Russian	https://raw.githubusercontent.com/Alir3z4/stop-words/master/russian.txt
Slovak	https://github.com/Alir3z4/stop-words/blob/master/slovak.txt
Spanish	http://www.ranks.nl/stopwords/spanish http://snowball.tartarus.org/algorithms/spanish/stop.txt https://github.com/Alir3z4/stop-words/blob/master/spanish.txt
Swedish	https://raw.githubusercontent.com/Alir3z4/stop-words/master/swedish.txt
Tagalog	https://github.com/stopwords-iso/stopwords-tl
Thai	https://github.com/stopwords-iso/stopwords-th
Turkish	https://raw.githubusercontent.com/Alir3z4/stop-words/master/turkish.txt
Ukrainian	https://raw.githubusercontent.com/Alir3z4/stop-words/master/ukrainian.txt
Vietnamese	https://github.com/Alir3z4/stop-words/blob/master/vietnamese.txt

License

Contents of this repository are available under Attribution 4.0 International (CC BY 4.0).