Sunday, April 1, 2018

FW: Determining replication status

-----Original Message-----
From: Jeff Wartes [mailto:jwartes@whitepages.com]
Sent: 02 April 2018 10:13
To: solr-user@lucene.apache.org
Subject: Re: Determining replication status

There're some edge cases around the response based on the timing. In case it's useful:

Here's the bit from solrcloud-haft: (java)
https://github.com/bloomreach/solrcloud-haft/blob/d357476daafc4cff5f30dc726de6a2b38f37dd0d/src/main/java/com/bloomreach/bstore/highavailability/utils/SolrInteractionUtils.java#L289
This mostly uses the flag you're looking at, but the comments describe the various cases to watch for in Solr 4.7, at least.

Here's the bit from solrcloud_manager: (scala)
https://github.com/whitepages/solrcloud_manager/blob/d0aea3e2f8b9aefd2d931eb394a3a434a67be96c/src/main/scala/com/whitepages/cloudmanager/client/SolrRequestHelpers.scala#L133
It uses both "isReplicating" and "timeRemaining", but that still had some edge cases as well. I can confirm this works with the half-dozen Solr versions I've tried between 4.9-7.2, but the timing estimate stopped working somewhere. I think in the early 5.x, and I've yet to bother figuring out why. This does a followup check on doc count to verify, (using the admin/luke handler) but that naturally requires a static index to work consistently.



On 4/1/18, 8:31 AM, "Erick Erickson" <erickerickson@gmail.com> wrote:

what does "not accurate" mean? Specifically, what test are you doing
to see if it's accurate?

In particular, if you're querying for some number of documents or some
specific document, your slave searcher may still be autowarming. If
that's the case, then it should be fine if you wait a bit and try
again.

If that's not the case we need to know how you're measuring "not accurate".

Best,
Erick

On Sat, Mar 31, 2018 at 7:04 PM, shefalid <shefalid@vmware.com> wrote:
> I am trying to copy contents of one core to other core by using fetchIndex
> command
> (/solr/CORE_NAME/replication?command=fetchindex&masterUrl=MASTER_URL).
>
> How can I determine if the copy is actually complete?
>
> I am using replication details command
> (/solr/CORE_NAME/replication?command=details) to check. I use isReplicating
> field & if its false, I consider the operation to be complete. But this
> approach is not giving me accurate results some time.
>
>
>
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

No comments:

Post a Comment