Some Data over Publisher not Syncing

[mihairosu]

For some reason, during this particular time period, the data is not syncing.

Data Source:
MangoES
core 3.34

Data Destination:
Mango Enterprise
core 3.34

Data is sent through Mango Persistent TCP Sync.

Source Prior To Sync:

Destination Prior to Sync:

Syncing:

Log from Source:

INFO  2018-04-20T09:12:02,021 (com.serotonin.m2m2.persistent.pub.PersistentSenderRT.raiseSyncCompletionEvent:301) - Points: 159, sent 773 requests, synced 383631 records, target overcounts: 9, response errors: 0, elapsed time: 1m15s

Source Post Sync (I added more points):

Destination Post Sync:

[phildunlap]

Hmm. My first suspicion is the "Sync history prior to" setting - but I suspect you know to check that. A sync will only run unto that time, though, so if it was set to 12 or 14 hours it would appear similar to what you have shown.

The only thing that can store a series from sync'ing are errors and overcounts. I see in your 'Log from Source' that you have 9 target overcounts, meaning there is more data on the receiver than the sender and it don't trust itself to overwrite the receiver's data should the receiver have more data. Usually this is caused by transmitting real time data while storing an interval value on the publisher side (generally receiver points are all set to 'All data' for logging). Are all your series experiencing this gap, or only those shown displayed?

[mihairosu]

Synchronize history prior to is set at 1 minute.

I've taken a representative sample of points, and checked again today. It looks like all points are affected.

Here's the data again as of today, but with a lot more points.. Well if we cannot resolve this by May 3, it will be purged from the source. It's not the end of the world, but if you are interested in investigating it, it might help you find issues. I don't know if this is a problem on our end either.

Still at source:

Still missing: