Chinese Parse

I'm segmenting word from chinese sentences. But I find 1M data need 20min... Maybe I should rewrite my tools...

Chinese Parse:
http://blog.csdn.net/gisfarmer/archive/2009/02/06/3865599.aspx

http://hi.baidu.com/yhustc/blog/item/a8aa334bdcfba0f383025cb1.html/cmtid/e4ff63fa9ef0a1dbb58f31f4

-Katrina

Processes to initate training data

After download html, shtml or htm pages, I have to pick out the content of the pages.  After that, I  initate the tarining data because HTK have certain input format.

1. convert html/shtml/htm pages into txt.  ----shtml2txt

    Although I wrote this program, it's not that suitable to RMRB. To RMRB,I have rewrite a new one specially.

2. sentence segmentation. ----init_text

    Init_text is a useful tool which which convert number into characther and delete useless symbols. Also, at the begining and end of the sentence, "" "" is needed. Because in HTK, these two symbols are the signal for one sentence.

    I wrote this program last year for XWLB. But it have some bugs. First, when encounter long numbers which is very long like 12345556667778, my program will stop because it's too long. Second, I delete all the files which have is very small and have no useful information in them firstly. I will write another effectively initatial program...

-Katrina

Hello world!

Hi, everybody! This is the first passage I write on this blog. You may see another article, it's publised by my darling boyfriend. The cute naughty boy is so excited for my new blog that wrote the first article here,ha..
Ok. My new English name is Katrina and from now on I'll love it as much as myself. I look the new name for a long time. I just got this blog today to record my life, of course mainly about my study and work, our research progress and so on. I hope I'll be able to remember most part of what I'll learn, experice and feel with the help of this blog. Also, I'll use English as much as possible.
Thx for coming~!

-Katrina