Because of a lapse in government funding, the information on this website may not be up to date, transactions submitted via the website may not be processed, and the agency may not be able to respond to inquiries until appropriations are enacted. The NIH Clinical Center (the research hospital of NIH) is open. For more details about its operating status, please visit cc.nih.gov. Updates regarding government operating status and resumption of normal operations can be found at OPM.gov
Non-word Split
I. Introduction
This page describes the processes for non-word split detection and correction.
II. Processes
NonWordDetector.java
SplitCandidates.java
CS_CAN_NW_MAX_SPLIT_NO
)
RankNonWordByMode.java
,
CS_NW_SPLIT_CONTEXT_RADIUS
)
SplitCorrector.java
III. Development Test
Id | Source | Original Word | Split Word |
---|---|---|---|
TP-1 | 10225 | aftercareemail | aftercare email |
TP-2 | 10225 | facebookshare | facebook share |
TP-3 | 10225 | friendshare | friend share |
TP-4 | 12616 | leftside | left side |
TP-5 | 13090 | viceversa | vice versa |
TP-6 | 13509 | inthis | in this |
TP-7 | 14849 | shuntfrom2007.How | shunt from 2007. How |
TP-8 | 14849 | oftendo | often do |
TP-9 | 14 | knowabout | know about |
TP-10 | 16928 | thankyou | thank you |
TP-11 | 17942 | everytime | every time |
TP-12 | 18175 | ofcourse | of course |
TP-13 | 18611 | aquestion | a question |
TP-14 | 18855 | backalso | back also |
TP-15 | 26 | diseaseany | disease any |
TP-16 | 7 | saythis | say this |
TP-17 | 88 | ilost | i lost |
Id | Source | Original Word | Split Word | Correct Words |
---|---|---|---|---|
FP-1 | 12235 | counterindicative | counter indicative | contraindicated |
FP-2 | 12271 | earthmovers | earth movers | earthmovers |
FP-3 | 13014 | orthopaedician | orthopaedic ian | orthopaedician |
FP-4 | 13165 | iam | i am | iam (error?) |
FP-5 | 13922 | shoudice | shou dice | shouldice |
FP-6 | 1 | nonething | none thing | nothing |
FP-7 | 4 | disear | dis ear | disease |
FP-8 | 61 | metoptic | met optic | metopic |
FP-9 | 7 | chromezone | chrome zone | chromosome |
FP-10 | 12574 | biletan | bile tan | biletan |
Id | Source | Original Word | Corrected Word | Correct Word |
---|---|---|---|---|
FN-1 | 10025 | u-creatinine | creatinine | urine creatinine |
FN-2 | 11186 | tbinthe | tbinthe | tb in the |
FN-3 | 11243 | menimgtisneef | menimgtisneef | meningitis needs |
FN-4 | 12271 | area!unfortionatly | area! unfortionatly | area! unfortunately |
FN-5 | 12616 | camedown | came down | came down |
FN-6 | 14514 | ihave | have | i have |
FN-7 | 14 | alot | alot | a lot |
FN-8 | 16519 | eye-doctor | eye-doctor | eye doctor |
FN-9 | 18203 | pthrpeptide | pthrpeptide | pthr peptide |
FN-10 | 88 | polipsremoved | polipsremoved | polyps removed |