ToolGood.Words
支持 繁体简体转化, 支持全角 半角转化, 获取拼音首字母, 获取 拼音字母 , 非法词(敏感词)查询。
繁体简体互换、全角半角、数字转成中文大写
//转成简体
WordsHelper.ToSimplifiedChinese("壹佰贰拾叁億肆仟伍佰陆拾柒萬捌仟玖佰零壹元壹角贰分");
//转成繁体
WordsHelper.ToTraditionalChinese("壹佰贰拾叁亿肆仟伍佰陆拾柒万捌仟玖佰零壹元壹角贰分");
//转成全角
WordsHelper.ToSBC("abcABC123");
//转成半角
WordsHelper.ToDBC("abcABC123");
//数字转成中文大写
WordsHelper.ToChineseRMB(12345678901.12);
拼音操作
//获取全拼
var py = WordsHelper.GetPinYin("我爱中国");
Assert.AreEqual("WoAiZhongGuo", py);
//获取首字母
py = WordsHelper.GetFirstPinYin("我爱中国");
Assert.AreEqual("WAZG", py);
//获取全部拼音
var pys = WordsHelper.GetAllPinYin('传');
Assert.AreEqual("Chuan", pys[0]);
Assert.AreEqual("Zhuan", pys[1]);
字符串搜索
StringSearch和WordsSearch类都是搜索字符串的类,区别是:WordsSearch的FindFirst,FindAll返回的类型有关键字所在位置。
string s = "中国|国人|zg人";
string test = "我是中国人";
StringSearch iwords = new StringSearch();
iwords.SetKeywords(s.Split('|'));
var b = iwords.ContainsAny(test);
Assert.AreEqual(true, b);
var f = iwords.FindFirst(test);
Assert.AreEqual("中国", f);
var all = iwords.FindAll(test);
Assert.AreEqual("中国", all[0]);
Assert.AreEqual("国人", all[1]);
Assert.AreEqual(2, all.Count);
WordsSearch iwords = new WordsSearch();
iwords.SetKeywords(s.Split('|'));
b = iwords.ContainsAny(test);
Assert.AreEqual(true, b);
f = iwords.FindFirst(test);
Assert.AreEqual("中国", f.Keyword);
var alls = iwords.FindAll(test);
Assert.AreEqual("中国", alls[0].Keyword);
Assert.AreEqual(2, alls[0].Start);
Assert.AreEqual(3, alls[0].End);
Assert.AreEqual(0, alls[0].Index);//返回索引Index,默认从0开始
Assert.AreEqual("国人", alls[1].Keyword);
Assert.AreEqual(2, alls.Count);
查找非法词(敏感词)
string s = "中国|国人|zg人|fuck|all|as|19|http://|ToolGood";
string test = "我是中国人";
IllegalWordsSearch iwords = new IllegalWordsSearch( 2);
iwords.SetKeywords(s.Split('|'));
var b = iwords.ContainsAny(test);
Assert.AreEqual(true, b);
var f = iwords.FindFirst(test);
Assert.AreEqual(true, f.Success);
Assert.AreEqual("中国", f.Keyword);
Assert.AreEqual("中国", f.SrcString);
Assert.AreEqual(2, f.Start);
Assert.AreEqual(3, f.End);
var all = iwords.FindAll(test);
Assert.AreEqual("中国", all[0].SrcString);
Assert.AreEqual("国人", all[1].SrcString);
test = "我是中国zg人";
all = iwords.FindAll(test);
Assert.AreEqual("中国", all[0].SrcString);
Assert.AreEqual("zg人", all[1].SrcString);
test = "中间国zg人";
all = iwords.FindAll(test);
Assert.AreEqual("zg人", all[0].SrcString);
test = "fuck al.l";
all = iwords.FindAll(test);
Assert.AreEqual("fuck", all[0].SrcString);
Assert.AreEqual("al.l", all[1].SrcString);
Assert.AreEqual(2, all.Count);
test = "ht@tp://ToolGood.com";
all = iwords.FindAll(test);
Assert.AreEqual("toolgood", all[0].Keyword);
Assert.AreEqual("ToolGood", all[0].SrcString);
Assert.AreEqual(1, all.Count);
test = "asssert all";
all = iwords.FindAll(test);//搜索时,排除英文截断,如asssert,不会匹配as
Assert.AreEqual("all", all[0].SrcString);
Assert.AreEqual(1, all.Count);
test = "19w 1919 all";
all = iwords.FindAll(test);//搜索时,排除数字截断,如1919,不会匹配19
Assert.AreEqual("19", all[0].SrcString);
Assert.AreEqual("all", all[1].SrcString);
test = "我是【中]国【人";
all = iwords.FindAll(test);
Assert.AreEqual("中]国", all[0].SrcString);
Assert.AreEqual("国【人", all[1].SrcString);
test = "我是【中国【人";
all = iwords.FindAll(test);
Assert.AreEqual("中国", all[0].SrcString);
Assert.AreEqual(1, all.Count);
性能对比
设备:DELL,系统:windows 10,CPU:i5-5200U,内存:12G,每种方法执行 10万次,结果如下:
TrieFilter : 151ms
FastFilter : 106ms
StringSearch(ContainsAny) : 31ms
StringSearch(FindFirst) : 47ms
WordsSearch(ContainsAny) : 31ms
WordsSearch(FindFirst) : 84ms
IllegalWordsSearch(FindFirst) : 68ms
IllegalWordsSearch(ContainsAny) : 47ms
TrieFilter(FindAll) : 1,281ms
FastFilter(FindAll) : 305ms
StringSearch(FindAll) : 364ms
WordsSearch(FindAll) : 438ms
IllegalWordsSearch(FindAll) : 1,175ms
注:TrieFilter,FastFilter来源: http://www.cnblogs.com/yeerh/archive/2011/10/20/2219035.html
注: 在 Find All测试中,FastFilter只能检测出7个:
[0]: "主席"
[1]: "赵洪祝"
[2]: "中国"
[3]: "铁道部"
[4]: "党"
[5]: "胡锦涛"
[6]: "倒台"
StringSearch检测出14个:
[0]: "党"
[1]: "党委"
[2]: "西藏"
[3]: "党"
[4]: "党委"
[5]: "主席"
[6]: "赵洪祝"
[7]: "中国"
[8]: "铁道部"
[9]: "党"
[10]: "胡锦涛"
[11]: "锦涛"
[12]: "倒台"
[13]: "黑社会"
IllegalWordsSearch检出15个:
[0]: {63|党}
[1]: {63|党委}
[2]: {81|西藏}
[3]: {83|党}
[4]: {83|党委}
[5]: {143|主席}
[6]: {185|赵洪祝}
[7]: {204|中国}
[8]: {221|铁道部}
[9]: {235|党}
[10]: {244|胡锦涛}
[11]: {245|锦涛}
[12]: {323|倒台}
[13]: {324|台}
[14]: {364|黑社会}
注:IllegalWordsSearch比StringSearch多一个台,原因:关键字繁体转简体