Recreating Search Index

[Migrated From Jforum.net]

I'm having an issue recreating the Lucene Search index. I have tried creating it using ID and with date and neither seem to work. I'm using jforum 2.1.8 on OC4J 10.1.3 and an oracle 10g database. When I redeploy the application I lose my entire search index and I need to have the ability to recreate it.

I have updated the oracle.sql file to have the correct syntac for the SearchModel.firstPostIdByDate

SearchModel.firstPostIdByDate = SELECT * FROM (SELECT post_id, ROW_NUMBER() OVER(ORDER BY post_id DESC)-1 AS LINENUM  FROM jforum_posts WHERE post_time > ? ) WHERE LINENUM = 0

When I go to do the reindex, I get post results back and to the list on line 154 of net.jforum.search.LuceneReindexer

List l = dao.getPostsToIndex(firstPostId, toPostId);

But it seems like the results never get put into the index.

When I create a new post it does get put into the index.

Any input would be great.

[originally posted on jforum.net by bmcguire]

[Migrated From Jforum.net]

Also I forgot to mention that I'm running on java 5. I was able to solve the issue I was having. When the batchCreate method in net.jforum.search.LuceneIndexer is called the added documents were never being commited to the IndeWriter (ramWriter). I ended up updating the batchCreate and createRAMWriter methods.

I updated batchCreate to do a flush after the document was added to the ramWriter

public void batchCreate(Post post)
	{
		synchronized (MUTEX) {
			try {
				Document document = this.createDocument(post);
				this.ramWriter.addDocument(document);
				this.ramWriter.flush();
				this.flushRAMDirectoryIfNecessary();
			}
			catch (IOException e) {
				throw new SearchException(e);
			}
		}
	}

Also I updated the createRAMWriter method to create the IndexWriter with a different Constructor that sets autocommit to true (JavaDoc)

private void createRAMWriter()
	{
		try {
			if (this.ramWriter != null) {
				this.ramWriter.close();
			}
			
			this.ramDirectory = new RAMDirectory();
			//this.ramWriter = new IndexWriter(this.ramDirectory, this.settings.analyzer(), true);
			this.ramWriter = new IndexWriter(this.ramDirectory, true, this.settings.analyzer());
			this.ramNumDocs = SystemGlobals.getIntValue(ConfigKeys.LUCENE_INDEXER_RAM_NUMDOCS);
		}
		catch (IOException e) {
			throw new SearchException(e);
		}
	}

[originally posted on jforum.net by bmcguire]

[Coande Li]

SearchModel.firstPostIdByDate = SELECT * FROM (SELECT post_id, ROW_NUMBER() OVER(ORDER BY post_id DESC)-1 AS LINENUM  FROM jforum_posts WHERE post_time > ? ) WHERE LINENUM = 0

should be:

SearchModel.firstPostIdByDate = SELECT * FROM (SELECT post_id, ROW_NUMBER() OVER(ORDER BY post_id ASC)-1 AS LINENUM  FROM jforum_posts WHERE post_time > ? ) WHERE LINENUM = 0

[Tim Moores]

The current version of JForum uses a very different query. Which JForum version are you looking at? If you're using an older version, you should upgrade to the latest one available from https://sourceforge.net/projects/jforum2/files/?source=navbar