Because of a lapse in government funding, the information on this website may not be up to date, transactions submitted via the website may not be processed, and the agency may not be able to respond to inquiries until appropriations are enacted. The NIH Clinical Center (the research hospital of NIH) is open. For more details about its operating status, please visit cc.nih.gov. Updates regarding government operating status and resumption of normal operations can be found at OPM.gov

CSpell

Performance Tests on Other Test Sets

I. MEDLINE Title

  • Informally tested to correct spelling errors in MEDLINE titles
  • Test file includes 2585 MEDLINE titles with errors
  • The preliminary results are similar to those on the consumer health questions
  • Indicating that CSpell might potentially be used for other biomedical spelling error corrections.
  • Initial result for correction (10 instances):
    PrecisionRecallF1
    1.000.600.75

II. CSpell Test Set on the important terms

  • Data: Test Set
  • Evaluated its performance on only those terms that are important for question understanding.
  • The important terms were identified during manual annotation.
  • The results on the important terms are very close to the overall results.

    TestsPrecisionRecallF1
    Non-word Detection0.89370.82590.8585
    Non-word Correction0.73430.67860.7053
    Real-word Detection0.91790.74220.8207
    Real-word Correction0.75360.60940.6739