CODEWITHSUNDEEP
solrdataimporthandler
illvm
illvm

Reputation: 1346

Getting IDs of added documents after import operation is complete

I'm trying to setup a Solr dataimport.EventListener to call a SOAP service with the IDs of the documents which have been added in the update event. I have a class which implements org.apache.solr.handler.dataimport.EventListener and I thought that the result of getAllEntityFields() would yield a collection of document IDs. Unfortunately, the result of the method yields an empty list. Even more confusing is that context.getSolrCore().getName() yields an empty string rather than the actual core name. So it seems I am not quite on the right path here.

The current setup is the following: Whenever a certain sproc is called in SQL, it puts a message in a queue. This queue has a listener on it which initiates a program which reads the queue and calls other sprocs. After the sprocs are complete, a delta or full import operation is performed on Solr. Immediately after, a method is called to update a cache. However, because the import operation on Solr may not have yet been completed before this update method is called the cache may be updated with "stale" data.

I was hoping to use a dataimport EventListener to call the method which updates the cache since my other options seem far too complex (e.g. polling the dataimport URL to determine when to call the update method or using a queue to list document IDs which need to be updated and have the EventListener call a method on a service to receive this queue and update the cache). I'm having a bit of a hard time finding documentation or examples. Does anyone have any ideas on how I should approach the problem?

Upvotes: 4

Views: 585

Answers (1)

Karthick
Karthick

Reputation: 2882

From what i understand, you are trying to update your cache as and when the documents are added. Depending on what version of solr you are running, you can do one of the following.

Solr 4.0 provides script transformer that lets you do this. http://wiki.apache.org/solr/DataImportHandler#ScriptTransformer

With prior versions of solr, you can chain one handler on top of other as answered in the following post. Solr and custom update handler

Upvotes: 2

Related Questions