File tree Expand file tree Collapse file tree
custom-recipes/nlp-preparation-spell-checker Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -4,8 +4,6 @@ symspellpy==6.7.0
44spacy == 2.3.2
55spacy-lookups-data == 0.3.2
66jieba == 0.42.1
7- SudachiPy == 0.4.9
8- SudachiDict-core == 20200722
97natto-py == 0.9.2
108pymorphy2 == 0.9.1
119pymorphy2-dicts == 2.4.393442.3710985
Original file line number Diff line number Diff line change 11{
22 "meta" : {
33 "label" : " Spell Checking" ,
4- "description" : " Identify and correct misspellings in a text column for 36 languages" ,
4+ "description" : " Identify and correct misspellings in a text column for 35 languages" ,
55 "icon" : " icon-strikethrough" ,
66 "displayOrderRank" : 2
77 },
Original file line number Diff line number Diff line change 11{
22 "id" : " nlp-preparation" ,
3- "version" : " 1.0.0 " ,
3+ "version" : " 1.0.1 " ,
44 "meta" : {
55 "label" : " Text preparation" ,
66 "category" : " Natural Language Processing" ,
Original file line number Diff line number Diff line change 166166 "id" : "Indonesian" ,
167167 "is" : "Icelandic" ,
168168 "it" : "Italian" ,
169- "ja" : "Japanese" ,
170169 "lt" : "Lithuanian" ,
171170 "lv" : "Latvian" ,
172171 "nl" : "Dutch" ,
216215 "id" : "Indonesian" ,
217216 "is" : "Icelandic" ,
218217 "it" : "Italian" ,
219- "ja" : "Japanese" ,
220218 "kn" : "Kannada" ,
221219 "lb" : "Luxembourgish" ,
222220 "lt" : "Lithuanian" ,
249247"""dict: Languages supported by spaCy: https://spacy.io/usage/models#languages
250248
251249Dictionary with ISO 639-1 language code (key) and language name (value).
252- Korean and Ukrainian not included because they require system-level package installations
250+ Japanese, Korean and Ukrainian not included because they require system-level operations
253251"""
254252
255253SPACY_LANGUAGE_MODELS = {
You can’t perform that action at this time.
0 commit comments