Skip to content

Commit 987b449

Browse files
committed
Remove Japanese support because of UIF issue
1 parent 38552ef commit 987b449

5 files changed

Lines changed: 3 additions & 50008 deletions

File tree

code-env/python/spec/requirements.txt

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,8 +4,6 @@ symspellpy==6.7.0
44
spacy==2.3.2
55
spacy-lookups-data==0.3.2
66
jieba==0.42.1
7-
SudachiPy==0.4.9
8-
SudachiDict-core==20200722
97
natto-py==0.9.2
108
pymorphy2==0.9.1
119
pymorphy2-dicts==2.4.393442.3710985

custom-recipes/nlp-preparation-spell-checker/recipe.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"meta": {
33
"label": "Spell Checking",
4-
"description": "Identify and correct misspellings in a text column for 36 languages",
4+
"description": "Identify and correct misspellings in a text column for 35 languages",
55
"icon": "icon-strikethrough",
66
"displayOrderRank": 2
77
},

plugin.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
{
22
"id": "nlp-preparation",
3-
"version": "1.0.0",
3+
"version": "1.0.1",
44
"meta": {
55
"label": "Text preparation",
66
"category": "Natural Language Processing",

python-lib/language_dict.py

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -166,7 +166,6 @@
166166
"id": "Indonesian",
167167
"is": "Icelandic",
168168
"it": "Italian",
169-
"ja": "Japanese",
170169
"lt": "Lithuanian",
171170
"lv": "Latvian",
172171
"nl": "Dutch",
@@ -216,7 +215,6 @@
216215
"id": "Indonesian",
217216
"is": "Icelandic",
218217
"it": "Italian",
219-
"ja": "Japanese",
220218
"kn": "Kannada",
221219
"lb": "Luxembourgish",
222220
"lt": "Lithuanian",
@@ -249,7 +247,7 @@
249247
"""dict: Languages supported by spaCy: https://spacy.io/usage/models#languages
250248
251249
Dictionary with ISO 639-1 language code (key) and language name (value).
252-
Korean and Ukrainian not included because they require system-level package installations
250+
Japanese, Korean and Ukrainian not included because they require system-level operations
253251
"""
254252

255253
SPACY_LANGUAGE_MODELS = {

0 commit comments

Comments
 (0)