PlumX Metrics
Embed PlumX Metrics

A pragmatic model for new Chinese word extraction

Proceedings of the 6th International Conference on Natural Language Processing and Knowledge Engineering, NLP-KE 2010, Page: 1-8
2010
  • 5
    Citations
  • 0
    Usage
  • 3
    Captures
  • 0
    Mentions
  • 0
    Social Media
Metric Options:   Counts1 Year3 Year

Metrics Details

  • Citations
    5
    • Citation Indexes
      5
      • CrossRef
        3
      • Academic Citation Index (ACI) - airiti
        1
  • Captures
    3

Conference Paper Description

This paper proposed a pragmatic model for repeat-based Chinese New Word Extraction (NWE). It contains two innovations. The first is a formal description for the process of NWE, which gives instructions on feature selection in theory. On the basis of this, the Conditional Random Fields model (CRF) is selected as statistical framework to solve the formal description. The second is an improved algorithm for left (right) entropy to improve the efficiency of NWE. By comparing with baseline algorithm, the improved algorithm can enhance the computational speed of entropy remarkably. On the whole, experiments show that the model this paper proposed is very effective, and the F score is 49.72% in open test and 69.83% in word extraction respectively, which is an evident improvement over previous similar works. © 2010 IEEE.

Bibliographic Details

Provide Feedback

Have ideas for a new metric? Would you like to see something else here?Let us know