Lucene中對(duì)document的CURD操作:為分布式全文檢索設(shè)計(jì)
Lucene.net是.net環(huán)境中比較強(qiáng)的全文檢索工具,它是從JAVA中轉(zhuǎn)過(guò)來(lái)的,.net版本的lucene在功能上也豪不遜色于java版的lucene。今天主要來(lái)說(shuō)一下lucene索引文件在更新時(shí)的一些方式。
一、整個(gè)索引文件?。╟fs文件)覆蓋更新;優(yōu)點(diǎn):簡(jiǎn)單,缺點(diǎn):與服務(wù)器沒(méi)有交互,但在生成索引文件時(shí)對(duì)IO影響比較大,前臺(tái)lucene信息顯示與數(shù)據(jù)庫(kù)不同步。
二、索引文件按需要更新(對(duì)document記錄進(jìn)行curd操作),優(yōu)點(diǎn):與數(shù)據(jù)庫(kù)同步,缺點(diǎn):與服務(wù)器交互多,對(duì)于curd的安全性要重視起來(lái),但這樣做是必須的。
下面主要說(shuō)一下第二種索引文件按需要更新的情況:
追加document(記錄):當(dāng)數(shù)據(jù)庫(kù)表中有insert操作時(shí),這時(shí)lucene也應(yīng)該進(jìn)行相應(yīng)的insert操作,這就是追加,在IndexWriter中有AddDocument方法,它沒(méi)什么好說(shuō)的,按著方法簽名轉(zhuǎn)值即可,注意操作完成后要對(duì)IndexWriter進(jìn)行Optimize和Close
- [WebMethod]
- public int AppendLuceneDocument(string primaryKey, string id, string name, string info, string categoryName, string propertyName, string module, string passKey)
- {
- int flag = 0;
- try
- {
- dirInfo = Directory.CreateDirectory(this.GetIndexPath(ConfigurationManager.AppSettings[module]));
- directory = LuceneIO.FSDirectory.Open(dirInfo);
- IndexWriter writer = new IndexWriter(directory, new StandardAnalyzer(Lucene.Net.Util.Version.LUCENE_29), false, IndexWriter.MaxFieldLength.UNLIMITED);
- Document doc = new Document();
- doc.Add(new Field("PrimaryKey", primaryKey, Field.Store.YES, Field.Index.ANALYZED));
- doc.Add(new Field("ID", id, Field.Store.YES, Field.Index.NO));
- doc.Add(new Field("Name", name, Field.Store.YES, Field.Index.ANALYZED));
- doc.Add(new Field("Info", info, Field.Store.YES, Field.Index.ANALYZED));
- doc.Add(new Field("CategoryName", categoryName, Field.Store.YES, Field.Index.ANALYZED));
- doc.Add(new Field("PropertyName", propertyName, Field.Store.YES, Field.Index.ANALYZED));
- writer.AddDocument(doc);
- writer.Optimize();
- writer.Close();
- flag = 1;
- }
- catch (Exception)
- {
- throw;
- }
- return flag;
- }
刪除記錄(document):這個(gè)操作需要我們注意幾點(diǎn):
1、要?jiǎng)h除的記錄的依據(jù)應(yīng)該具有唯一性,這樣刪除才有意義,并且這個(gè)字段在lucene存儲(chǔ)時(shí)需要是ANALYZED,即可以被檢索到
2、刪除時(shí)的條件***使用Query,而不要使用Term,我做過(guò)很多測(cè)試,結(jié)果證明Term條件總是不要使。
對(duì)于刪除的代碼如下:
- [WebMethod]
- public int DeleteLuceneDocument(string primaryKey, string module, string passKey)
- {
- int flag = 0;
- try
- {
- dirInfo = Directory.CreateDirectory(this.GetIndexPath(ConfigurationManager.AppSettings[module]));
- directory = LuceneIO.FSDirectory.Open(dirInfo);
- IndexWriter writer = new IndexWriter(directory, standardAnalyzer, false, IndexWriter.MaxFieldLength.UNLIMITED);
- QueryParser parser = new QueryParser(Lucene.Net.Util.Version.LUCENE_29, "PrimaryKey", new StandardAnalyzer(Lucene.Net.Util.Version.LUCENE_29));
- Query query = parser.Parse(primaryKey);
- writer.DeleteDocuments(query);
- writer.Commit();
- writer.Optimize();
- writer.Close();
- flag = 1;
- }
- catch (Exception)
- {
- throw;
- }
- return flag;
- }
而更新操作事實(shí)上就是先把記錄刪除,再追加一條新的記錄即可,而IndexWriter為我們提供的UpdateDocuments感覺(jué)更向是在復(fù)制一個(gè),所以不建議使用它,
而是手動(dòng)刪除和追加來(lái)完成這個(gè)update操作。
- [WebMethod]
- public int UpdateLuceneDocument(string primaryKey, string id, string name, string info, string categoryName, string propertyName, string module, string passKey)
- {
- int flag = 0;
- try
- {
- dirInfo = Directory.CreateDirectory(this.GetIndexPath(ConfigurationManager.AppSettings[module]));
- directory = LuceneIO.FSDirectory.Open(dirInfo);
- IndexWriter writer = new IndexWriter(directory, new StandardAnalyzer(Lucene.Net.Util.Version.LUCENE_29), false, IndexWriter.MaxFieldLength.UNLIMITED);
- Document doc = new Document();
- doc.Add(new Field("PrimaryKey", primaryKey, Field.Store.YES, Field.Index.ANALYZED));
- doc.Add(new Field("ID", id, Field.Store.YES, Field.Index.NO));
- doc.Add(new Field("Name", name, Field.Store.YES, Field.Index.ANALYZED));
- doc.Add(new Field("Info", info, Field.Store.YES, Field.Index.ANALYZED));
- doc.Add(new Field("CategoryName", categoryName, Field.Store.YES, Field.Index.ANALYZED));
- doc.Add(new Field("PropertyName", propertyName, Field.Store.YES, Field.Index.ANALYZED));
- QueryParser parser = new QueryParser(Lucene.Net.Util.Version.LUCENE_29, "PrimaryKey", new StandardAnalyzer(Lucene.Net.Util.Version.LUCENE_29));
- Query query = parser.Parse(primaryKey);
- writer.DeleteDocuments(query);
- writer.Commit();
- writer.AddDocument(doc);
- writer.Optimize();
- writer.Close();
- flag = 1;
- }
- catch (Exception)
- {
- throw;
- }
- return flag;
- }
OK,這就是對(duì)索引文件進(jìn)行按需的操作,以后我會(huì)把我的lucene架構(gòu)整理成文章,供大家討論。
原文鏈接:http://www.cnblogs.com/lori/archive/2012/08/24/2654275.html