P.S. I also purged the /work directory, just to eliminate variables

MangoGT unit that had previously run out of memory (see MangoGT running out of memory? restarted, but the UI failed to present a login page. After several attempts, I moved the databases directory and recovered from a recent backup. I have tried this several times now, going further back in the backup history, but with no success.

Then I noticed a very unexpected behavior: one browser window which was logged in to do the SQL restore DID let me log in, somehow, and I am able to operate normally in that browser, for now. However, other browsers just hang on a /ui/ URL; or if I access the device using a different URL (e.g. IP address) it hangs similarly.

I am sending the URL separately so you can try for yourselves, see the HTTP conversation.

Catching a few MangoGT units hanging, to find Out Of Memory errors in the logs:

Dec 06 01:00:43 mangoGT5176 start-mango.sh[529]: Exception in thread "high-pool-2-thread-5894" com.infiniteautomation.tsdb.IasTsdbException: java.io.IOException: Map failed
Dec 06 01:00:43 mangoGT5176 start-mango.sh[529]:         at com.infiniteautomation.tsdb.impl.IasTsdbImpl.count(IasTsdbImpl.java:1124)
Dec 06 01:00:43 mangoGT5176 start-mango.sh[529]:         at com.infiniteautomation.nosql.InternalGenericDao.rangeCount(InternalGenericDao.java:393)
Dec 06 01:00:43 mangoGT5176 start-mango.sh[529]:         at 
[snipped]
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.serotonin.m2m2.persistent.pub.SyncHandler$PointSync.checkRangeImpl(SyncHandler.java:514)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.serotonin.m2m2.persistent.pub.SyncHandler$PointSync.checkRange(SyncHandler.java:345)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.serotonin.m2m2.persistent.pub.SyncHandler$PointSync.checkPoint(SyncHandler.java:326)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.serotonin.m2m2.persistent.pub.SyncHandler$PointSync.run(SyncHandler.java:276)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.serotonin.timer.sync.Synchronizer$TaskWrapper.run(Synchronizer.java:150)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.serotonin.timer.Task.runTask(Task.java:179)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.serotonin.timer.TaskWrapper.run(TaskWrapper.java:23)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at java.base/java.lang.Thread.run(Thread.java:830)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]: Caused by: java.io.IOException: Map failed
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at java.base/sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:1017)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.infiniteautomation.tsdb.impl.ChecksumMappedByteBufferInputStream.<init>(ChecksumMappedByteBufferInputStream.java:41)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.infiniteautomation.tsdb.impl.ReversibleShard.openDataIn(ReversibleShard.java:250)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.infiniteautomation.tsdb.impl.Shard.query(Shard.java:473)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.infiniteautomation.tsdb.impl.CompressibleShard.query(CompressibleShard.java:391)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.infiniteautomation.tsdb.impl.Series.query(Series.java:532)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at com.infiniteautomation.tsdb.impl.IasTsdbImpl.count(IasTsdbImpl.java:1095)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         ... 48 more
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]: Caused by: java.lang.OutOfMemoryError: Map failed
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at java.base/sun.nio.ch.FileChannelImpl.map0(Native Method)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         at java.base/sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:1014)
Dec 06 01:02:22 mangoGT5176 start-mango.sh[529]:         ... 54 more

Suggestions? Adjust thread pools? Swap?

Has anyone been able to duplicate this? Any other thoughts or theories? Suggestions, what should I try?

Here is the original datapoint on the MangoGT, reading from a meter via MODBUS (stripped down):

{
   "dataPoints":[
      {
         "dataSourceXid":"DS_MODBUS_RS485",
                "enabled":true,
         "xid":"DP_CW_flow_inlet",
         "textRenderer":{
            "useUnitAsSuffix":true,
            "format":"0.0",
            "type":"ANALOG"
         },
         "loggingType":"ON_CHANGE_INTERVAL",
         "overrideIntervalLoggingSamples":false,
         "defaultCacheSize":1,
         "renderedUnit":"gal\/min",
         "setPermission":"",
         "tags":{
            "varName":"flowIn",
            "systemID":"115",
            "system":"Creekwood",
            "chart":"true",
            "flow":"true"
         },
         "unit":"m³\/h",
         "pointLocator":{
            "charset":"ASCII",
            "writeType":"NOT_SETTABLE",
            "offset":0,
            "slaveId":2,
            "slaveMonitor":false,
            "multiplier":1,
            "multistateNumeric":false,
            "registerCount":0,
            "range":"HOLDING_REGISTER",
            "modbusDataType":"FOUR_BYTE_FLOAT_SWAPPED",
            "bit":0,
            "additive":0
         },
         "name":"Flow Rate (Inlet)",
      }
   ]
}

And here is the data point on the cloud instance (Intel), also stripped:

{
   "dataPoints":[
      {
         "intervalLoggingType":"INSTANT",
         "dataSourceXid":"DS_persistent_TCP",
         "enabled":true,
         "xid":"115DP_CW_flow_inlet",
         "textRenderer":{
            "useUnitAsSuffix":true,
            "format":"0.0",
            "type":"ANALOG"
         },
         "loggingType":"ALL",
         "renderedUnit":"gal\/min",
         "tags":{
            "varName":"flowIn",
            "systemID":"115",
            "system":"Creekwood",
            "EdgeServerID":"115",
            "chart":"true",
            "flow":"true"
         },
         "unit":"m³\/h",
         "pointLocator":{
            "settable":false,
            "dataTypeId":3
         },
         "name":"Flow Rate (Inlet)",
      }
   ]
}

After some more experience, going through this several more times, I seem to have found a pattern.

Apparently, this kind of problem arises when I reboot the MangoGT without explicitly stopping Mango first.

Having examined the output from systemctl show mango.service -p TimeoutStopUSec which shows TimeoutStopUSec=1min 30s it appears the service file is correctly configured; however, my experience suggests there is a failure somewhere in there. Additionally, a reboot command seems to execute immediately, too soon to properly shut down.

What do you think?

The obvious question is that the MangoGT has an ARM processor, while the cloud has an Intel processor. Is the Java math off on the ARM processor?

This should be easy to duplicate, just a data point with the units as I've described, with a manually-entered point value.

I don't quite follow your question/suggestion.

Let me reiterate that the data point is configured as m³/h with the display unit as gal/min

On the MangoGT, the display unit is off, both in comparison to the device as well as according to the math. However, it is published to the cloud, where the configuration is identical, the display unit is correct, matching the device and the math.

I have come across an odd situation with unit conversion. We have flow meters which report in m³/h, and Mango is configured to convert to gal/min for display. The meter itself can be configured to display in gal/min, even though the data cannot be reported in any other units. This was previously addressed in another post (https://forum.mango-os.com/topic/4388/are-values-in-converted-unit-available-to-scripts), and the workaround provided by @phildunlap has been working fine, until recently when we replaced the unit with a MangoGT. Then we noticed the display (and more critically, our scripts) was off.

The result is the local display is wrong, along with scripts which use the converted units. However, the data is published (persistent TCP) and the receiving unit (cloud instance) is displaying the gal/min correctly, in agreement with the display on the device.

For example, as I debug one of the scripts, it reads the metric flow at 2.2167255878448486 m³/h; the device and the Mango instance receiving the published data display an accurate 9.76 gal/min. However, Mango's rendered value is a mysterious 8.1 gal/min.

FWIW the gateway device is a MangoGT running version 3.7.7
The cloud instance is also running Mango version 3.7.7

Any other details that might be useful?

Aldo

@MattFox actually, that brings to mind a very important question: how do I restore from the H2 backup? Easy to do with MySQL/MariaDB, but how does one import data into H2?

Update:
Never mind; I found this: https://docs-v3.mango-os.com/how-to-restore-a-h2-database-backup

Hadn't used that before; didn't realize that was an option.

Restoring now.

@MattFox Unfortunately not; migrated from a previous installation, and been running for a month.

I'll try restoring from backup.

Aldo

@mattfox That's what it looked like to me, but I haven't upgraded Mango since installing this MangoES (MangoGT). Comparing with other units I've deployed, there are no updates I could have applied. Nor does anything show up in the logs directory indicating upgrades or attempts.

In the past, with MySQL/MariaDB I have been able to undo partial changes to the schema resulting from an unsuccessful upgrade, but that's not the type of error logged here; is this a partitioning command?

I appear to have an error in my H2 database, on a MangoES (MangoGT).

Mango dies shortly after launching, with the following entry in the log:

INFO  2020-10-20T12:55:44,259 (com.serotonin.m2m2.db.H2Proxy.initializeImpl:64) - Initializing H2 connection manager 
INFO  2020-10-20T12:55:48,090 (com.serotonin.m2m2.db.upgrade.DBUpgrade.checkUpgrade:38) - Starting instance with core version 3.7.7, schema v29 
INFO  2020-10-20T12:55:48,093 (com.infiniteautomation.nosql.MangoNoSqlProxy.initialize:77) - Starting MangoNoSql Database 
INFO  2020-10-20T12:55:48,282 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:144) - Database at /opt/mango/databases/mangoTSDB started 
INFO  2020-10-20T12:55:48,386 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:173) - Empty dir delete for database at /opt/mango/databases/mangoTSDB took 58ms 
INFO  2020-10-20T12:55:48,444 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:144) - Database at /opt/mango/databases/mangoTSDBAux started 
INFO  2020-10-20T12:55:48,475 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:173) - Empty dir delete for database at /opt/mango/databases/mangoTSDBAux took 0ms 
ERROR 2020-10-20T12:56:01,722 (com.serotonin.m2m2.Main.main:162) - Error during initialization 
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'emailAddressVerificationService': Invocation of init method failed; nested exception is org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [select settingValue from systemSettings where settingName=?]; SQL state [HY000]; error code [50000]; General error: "java.lang.RuntimeException: rowCount expected 9222 got 9594 LOBS.INDEX_LOB_TABLE"; SQL statement:
INSERT INTO INFORMATION_SCHEMA.LOBS(ID, BYTE_COUNT, `TABLE`) SELECT ?, BYTE_COUNT, ? FROM INFORMATION_SCHEMA.LOBS WHERE ID = ? [50000-199]; nested exception is org.h2.jdbc.JdbcSQLNonTransientException: General error: "java.lang.RuntimeException: rowCount expected 9222 got 9594 LOBS.INDEX_LOB_TABLE"; SQL statement:
INSERT INTO INFORMATION_SCHEMA.LOBS(ID, BYTE_COUNT, `TABLE`) SELECT ?, BYTE_COUNT, ? FROM INFORMATION_SCHEMA.LOBS WHERE ID = ? [50000-199]
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:139) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1770) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:843) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877) ~[spring-context-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549) ~[spring-context-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at com.serotonin.m2m2.Lifecycle.springRuntimeContextInitialize(Lifecycle.java:385) ~[ma-priv-3.7.7.jar:?]
	at com.serotonin.m2m2.Lifecycle.initialize(Lifecycle.java:288) ~[ma-priv-3.7.7.jar:?]
	at com.serotonin.m2m2.Main.main(Main.java:159) ~[ma-priv-3.7.7.jar:?]
Caused by: org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [select settingValue from systemSettings where settingName=?]; SQL state [HY000]; error code [50000]; General error: "java.lang.RuntimeException: rowCount expected 9222 got 9594 LOBS.INDEX_LOB_TABLE"; SQL statement:
INSERT INTO INFORMATION_SCHEMA.LOBS(ID, BYTE_COUNT, `TABLE`) SELECT ?, BYTE_COUNT, ? FROM INFORMATION_SCHEMA.LOBS WHERE ID = ? [50000-199]; nested exception is org.h2.jdbc.JdbcSQLNonTransientException: General error: "java.lang.RuntimeException: rowCount expected 9222 got 9594 LOBS.INDEX_LOB_TABLE"; SQL statement:
INSERT INTO INFORMATION_SCHEMA.LOBS(ID, BYTE_COUNT, `TABLE`) SELECT ?, BYTE_COUNT, ? FROM INFORMATION_SCHEMA.LOBS WHERE ID = ? [50000-199]
	at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:89) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1442) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:632) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:668) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:699) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:711) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at com.serotonin.db.spring.ExtendedJdbcTemplate.queryForObject(ExtendedJdbcTemplate.java:39) ~[mango-3.7.7.jar:?]
	at com.serotonin.db.spring.ExtendedJdbcTemplate.queryForObject(ExtendedJdbcTemplate.java:63) ~[mango-3.7.7.jar:?]
	at com.serotonin.db.DaoUtils.queryForObject(DaoUtils.java:278) ~[mango-3.7.7.jar:?]
	at com.serotonin.m2m2.db.dao.SystemSettingsDao.lambda$getValue$0(SystemSettingsDao.java:276) ~[mango-3.7.7.jar:?]
	at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1705) ~[?:?]
	at com.serotonin.m2m2.db.dao.SystemSettingsDao.getValue(SystemSettingsDao.java:275) ~[mango-3.7.7.jar:?]
	at com.serotonin.m2m2.db.dao.SystemSettingsDao.getValue(SystemSettingsDao.java:259) ~[mango-3.7.7.jar:?]
	at com.infiniteautomation.mango.spring.components.EmailAddressVerificationService.loadKeyPair(EmailAddressVerificationService.java:107) ~[mango-3.7.7.jar:?]
	at com.infiniteautomation.mango.jwt.JwtSignerVerifier.postConstruct(JwtSignerVerifier.java:62) ~[mango-3.7.7.jar:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:567) ~[?:?]
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	... 14 more
Caused by: org.h2.jdbc.JdbcSQLNonTransientException: General error: "java.lang.RuntimeException: rowCount expected 9222 got 9594 LOBS.INDEX_LOB_TABLE"; SQL statement:
INSERT INTO INFORMATION_SCHEMA.LOBS(ID, BYTE_COUNT, `TABLE`) SELECT ?, BYTE_COUNT, ? FROM INFORMATION_SCHEMA.LOBS WHERE ID = ? [50000-199]
	at org.h2.message.DbException.getJdbcSQLException(DbException.java:502) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.message.DbException.getJdbcSQLException(DbException.java:427) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.message.DbException.get(DbException.java:194) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.message.DbException.convert(DbException.java:347) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.table.PageStoreTable.addRow(PageStoreTable.java:112) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Insert.addRowImpl(Insert.java:251) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Insert.insertRows(Insert.java:207) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Insert.update(Insert.java:132) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.CommandContainer.update(CommandContainer.java:133) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.Command.executeUpdate(Command.java:267) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.jdbc.JdbcPreparedStatement.executeUpdateInternal(JdbcPreparedStatement.java:200) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.jdbc.JdbcPreparedStatement.executeUpdate(JdbcPreparedStatement.java:154) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.store.LobStorageBackend.copyLob(LobStorageBackend.java:466) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.value.ValueLobDb.copyToResult(ValueLobDb.java:554) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.value.ValueLobDb.copyToResult(ValueLobDb.java:40) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.result.LocalResultImpl.cloneLobs(LocalResultImpl.java:280) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.result.LocalResultImpl.addRow(LocalResultImpl.java:315) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Select.queryFlat(Select.java:744) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Select.queryWithoutCache(Select.java:884) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Query.queryWithoutCacheLazyCheck(Query.java:151) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Query.query(Query.java:435) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Query.query(Query.java:397) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.CommandContainer.query(CommandContainer.java:145) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.Command.executeQuery(Command.java:202) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.jdbc.JdbcPreparedStatement.executeQuery(JdbcPreparedStatement.java:115) ~[h2-1.4.199.jar:1.4.199]
	at org.springframework.jdbc.core.JdbcTemplate$1.doInPreparedStatement(JdbcTemplate.java:677) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:616) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:668) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:699) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:711) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at com.serotonin.db.spring.ExtendedJdbcTemplate.queryForObject(ExtendedJdbcTemplate.java:39) ~[mango-3.7.7.jar:?]
	at com.serotonin.db.spring.ExtendedJdbcTemplate.queryForObject(ExtendedJdbcTemplate.java:63) ~[mango-3.7.7.jar:?]
	at com.serotonin.db.DaoUtils.queryForObject(DaoUtils.java:278) ~[mango-3.7.7.jar:?]
	at com.serotonin.m2m2.db.dao.SystemSettingsDao.lambda$getValue$0(SystemSettingsDao.java:276) ~[mango-3.7.7.jar:?]
	at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1705) ~[?:?]
	at com.serotonin.m2m2.db.dao.SystemSettingsDao.getValue(SystemSettingsDao.java:275) ~[mango-3.7.7.jar:?]
	at com.serotonin.m2m2.db.dao.SystemSettingsDao.getValue(SystemSettingsDao.java:259) ~[mango-3.7.7.jar:?]
	at com.infiniteautomation.mango.spring.components.EmailAddressVerificationService.loadKeyPair(EmailAddressVerificationService.java:107) ~[mango-3.7.7.jar:?]
	at com.infiniteautomation.mango.jwt.JwtSignerVerifier.postConstruct(JwtSignerVerifier.java:62) ~[mango-3.7.7.jar:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:567) ~[?:?]
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	... 14 more
Caused by: java.lang.RuntimeException: rowCount expected 9222 got 9594 LOBS.INDEX_LOB_TABLE
	at org.h2.message.DbException.throwInternalError(DbException.java:293) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.table.PageStoreTable.checkRowCount(PageStoreTable.java:122) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.table.PageStoreTable.addRow(PageStoreTable.java:95) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Insert.addRowImpl(Insert.java:251) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Insert.insertRows(Insert.java:207) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Insert.update(Insert.java:132) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.CommandContainer.update(CommandContainer.java:133) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.Command.executeUpdate(Command.java:267) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.jdbc.JdbcPreparedStatement.executeUpdateInternal(JdbcPreparedStatement.java:200) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.jdbc.JdbcPreparedStatement.executeUpdate(JdbcPreparedStatement.java:154) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.store.LobStorageBackend.copyLob(LobStorageBackend.java:466) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.value.ValueLobDb.copyToResult(ValueLobDb.java:554) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.value.ValueLobDb.copyToResult(ValueLobDb.java:40) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.result.LocalResultImpl.cloneLobs(LocalResultImpl.java:280) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.result.LocalResultImpl.addRow(LocalResultImpl.java:315) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Select.queryFlat(Select.java:744) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Select.queryWithoutCache(Select.java:884) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Query.queryWithoutCacheLazyCheck(Query.java:151) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Query.query(Query.java:435) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.dml.Query.query(Query.java:397) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.CommandContainer.query(CommandContainer.java:145) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.command.Command.executeQuery(Command.java:202) ~[h2-1.4.199.jar:1.4.199]
	at org.h2.jdbc.JdbcPreparedStatement.executeQuery(JdbcPreparedStatement.java:115) ~[h2-1.4.199.jar:1.4.199]
	at org.springframework.jdbc.core.JdbcTemplate$1.doInPreparedStatement(JdbcTemplate.java:677) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:616) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:668) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:699) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:711) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at com.serotonin.db.spring.ExtendedJdbcTemplate.queryForObject(ExtendedJdbcTemplate.java:39) ~[mango-3.7.7.jar:?]
	at com.serotonin.db.spring.ExtendedJdbcTemplate.queryForObject(ExtendedJdbcTemplate.java:63) ~[mango-3.7.7.jar:?]
	at com.serotonin.db.DaoUtils.queryForObject(DaoUtils.java:278) ~[mango-3.7.7.jar:?]
	at com.serotonin.m2m2.db.dao.SystemSettingsDao.lambda$getValue$0(SystemSettingsDao.java:276) ~[mango-3.7.7.jar:?]
	at java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1705) ~[?:?]
	at com.serotonin.m2m2.db.dao.SystemSettingsDao.getValue(SystemSettingsDao.java:275) ~[mango-3.7.7.jar:?]
	at com.serotonin.m2m2.db.dao.SystemSettingsDao.getValue(SystemSettingsDao.java:259) ~[mango-3.7.7.jar:?]
	at com.infiniteautomation.mango.spring.components.EmailAddressVerificationService.loadKeyPair(EmailAddressVerificationService.java:107) ~[mango-3.7.7.jar:?]
	at com.infiniteautomation.mango.jwt.JwtSignerVerifier.postConstruct(JwtSignerVerifier.java:62) ~[mango-3.7.7.jar:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:567) ~[?:?]
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136) ~[spring-beans-5.1.7.RELEASE.jar:5.1.7.RELEASE]
	... 14 more
INFO  2020-10-20T12:56:01,724 (com.serotonin.m2m2.Lifecycle.terminate:400) - Mango Lifecycle terminating... 
INFO  2020-10-20T12:56:01,796 (com.serotonin.m2m2.db.H2Proxy.terminateImpl:406) - Terminating database. 
INFO  2020-10-20T12:56:02,744 (com.infiniteautomation.nosql.MangoNoSqlProxy.shutdown:116) - Terminating NoSQL Batch Write Manager. 
INFO  2020-10-20T12:56:02,766 (com.infiniteautomation.nosql.MangoNoSqlProxy.shutdown:124) - Closing NoSQL Database: Point Values 
INFO  2020-10-20T12:56:02,813 (com.infiniteautomation.nosql.MangoNoSqlProxy.shutdown:132) - Closing NoSQL Database: Point Data 
INFO  2020-10-20T12:56:02,822 (com.serotonin.m2m2.Lifecycle.terminate:550) - Mango Lifecycle terminated.

How can I correct this?

Thanks,

Aldo

I purged the work directory, and the 302 error went away. Turns out the fact that it was the last message didn't connect it to the cause of the crash.

I have sent the database and log files separately. Hopefully we can learn what's going on.

Aldo

Mango is suddenly crashing at startup, with the following log message:

ERROR 2020-09-30T14:06:03,185 (com.serotonin.m2m2.rt.maint.UpgradeCheck.run:65) - Invalid response code 302, reason=Found:
org.apache.http.HttpException: Invalid response code 302, reason=Found:
        at com.serotonin.web.http.HttpUtils4.getTextContent(HttpUtils4.java:136) ~[mango-3.6.6.jar:?]
        at com.serotonin.m2m2.web.dwr.ModulesDwr.getAvailableUpgrades(ModulesDwr.java:420) ~[mango-3.6.6.jar:?]
        at com.serotonin.m2m2.web.dwr.ModulesDwr.upgradesAvailable(ModulesDwr.java:298) ~[mango-3.6.6.jar:?]
        at com.serotonin.m2m2.rt.maint.UpgradeCheck.run(UpgradeCheck.java:53) ~[mango-3.6.6.jar:?]
        at com.serotonin.timer.Task.runTask(Task.java:179) ~[mango-3.6.6.jar:?]
        at com.serotonin.timer.TaskWrapper.run(TaskWrapper.java:23) ~[mango-3.6.6.jar:?]
        at com.serotonin.timer.OrderedThreadPoolExecutor$OrderedTaskCollection.run(OrderedThreadPoolExecutor.java:336) ~[mango-3.6.6.jar:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_131]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_131]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_131]

This is running version 3.6.6 and was running fine on Monday. Is it that unhappy about a 302?

Thanks in advance,

Aldo

Looking for more documentation or tutorials on MangoNOSQL. The information on the help site (and help in the settings) is thorough, but very technical. I am hoping for some more practical, simplified tips, examples.

Specifically, I am looking for pointers on managing disk space while balancing data retention.

Also, one question that keeps coming to mind stems from the warning on the “System Settings” section for NoSQL:
Caution, when using incremental backups make sure enough versions are kept to retain the data you desire.

If I keep only 60 incremental backups (run daily) am I limited to only being able to restore from those 60 days? If I want to retain, say a year, I need to retain all 365 incremental backups? Or is it possible to run a full backup monthly, to retain all historical data? (meaning, somewhat automated; I realize I can do that manually)

Thanks in advance!

That's about what I expected. Glad it was simple and isolated.

This is a MangoGT running Mango 3.7.4

I stripped down the JSON to determine it was not the contents of the scripts causing the issue:

{
   "sstGlobalScripts":[
      {
         "xid":"GS_script1",
         "name":"script1",
         "script":"var script1 = {\n    name:	'script1'\n}"
      },
      {
         "xid":"GS_script2",
         "name":"script2",
         "script":"var script2 =\n{\n    name:	'script2'\n}"
      }
   ]
}

I have 2 Global Scripts, and while migrating to a new system I included global scripts in the export, but the imported system showed failures due to the 2nd script being missing.

Manually importing the scripts confirms the same issue, the import page only shows 1 script imported.

The obvious work-around is to import them one at a time, but it is a shock to get such unexpected results.

I was attempting to create a Mango Persistent TCP publisher on a MangoGT, and I got an error. The transient banner went away, but kept repeating. I attempted to restart the Mango instance, but now it fails to come up.

Here is the log:

ERROR 2020-03-11T15:40:48,147 (com.serotonin.m2m2.Main.main:162) - Error during initialization
org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [select e.id, e.typeName, e.subtypeName, e.typeRef1, e.typeRef2, e.activeTs, e.rtnApplicable, e.rtnTs,   e.rtnCause, e.alar
mLevel, e.message, e.ackTs, e.ackUserId, u.username, e.alternateAckSource,   (select count(1) from userComments where commentType=1     and typeKey=e.id) as cnt from events e   left join users u on e.ackUserId=u.id where e.rtnApplicable=
? and e.rtnTs is null]; SQL state [HY000]; error code [50000]; General error: "java.lang.RuntimeException: page[49090] data leaf table:103 EVENTS entries:12 parent:46488 keys:[264424, 264425, 264426, 264427, 264428, 264429, 264430, 26443
1, 264432, 264433, 264434, 264435] offsets:[3897, 3696, 3502, 3308, 3112, 3038, 2836, 2636, 2434, 2234, 2031, 1823] parent 46488 expected 50476"; SQL statement:
select e.id, e.typeName, e.subtypeName, e.typeRef1, e.typeRef2, e.activeTs, e.rtnApplicable, e.rtnTs,   e.rtnCause, e.alarmLevel, e.message, e.ackTs, e.ackUserId, u.username, e.alternateAckSource,   (select count(1) from userComments where commentType=1     and typeKey=e.id) as cnt from events e   left join users u on e.ackUserId=u.id where e.rtnApplicable=? and e.rtnTs is null [50000-199]; nested exception is org.h2.jdbc.JdbcSQLNonTransientException: General error: "java.lang.RuntimeException: page[49090] data leaf table:103 EVENTS entries:12 parent:46488 keys:[264424, 264425, 264426, 264427, 264428, 264429, 264430, 264431, 264432, 264433, 264434, 264435] offsets:[3897, 3696, 3502, 3308, 3112, 3038, 2836, 2636, 2434, 2234, 2031, 1823] parent 46488 expected 50476"; SQL statement:
select e.id, e.typeName, e.subtypeName, e.typeRef1, e.typeRef2, e.activeTs, e.rtnApplicable, e.rtnTs,   e.rtnCause, e.alarmLevel, e.message, e.ackTs, e.ackUserId, u.username, e.alternateAckSource,   (select count(1) from userComments where commentType=1     and typeKey=e.id) as cnt from events e   left join users u on e.ackUserId=u.id where e.rtnApplicable=? and e.rtnTs is null [50000-199]
        at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:89) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:81) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1442) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:632) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:668) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:699) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:711) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplate.java:762) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at com.serotonin.db.DaoUtils.query(DaoUtils.java:250) ~[mango-3.7.4.jar:?]
        at com.serotonin.m2m2.db.dao.EventDao.getActiveEvents(EventDao.java:198) ~[mango-3.7.4.jar:?]
        at com.serotonin.m2m2.rt.EventManagerImpl.initialize(EventManagerImpl.java:865) ~[mango-3.7.4.jar:?]
        at com.serotonin.m2m2.Lifecycle.eventManagerInitialize(Lifecycle.java:762) ~[ma-priv-3.7.4.jar:?]
        at com.serotonin.m2m2.Lifecycle.initialize(Lifecycle.java:322) ~[ma-priv-3.7.4.jar:?]
        at com.serotonin.m2m2.Main.main(Main.java:159) ~[ma-priv-3.7.4.jar:?]
Caused by: org.h2.jdbc.JdbcSQLNonTransientException: General error: "java.lang.RuntimeException: page[49090] data leaf table:103 EVENTS entries:12 parent:46488 keys:[264424, 264425, 264426, 264427, 264428, 264429, 264430, 264431, 264432, 264433, 264434, 264435] offsets:[3897, 3696, 3502, 3308, 3112, 3038, 2836, 2636, 2434, 2234, 2031, 1823] parent 46488 expected 50476"; SQL statement:
select e.id, e.typeName, e.subtypeName, e.typeRef1, e.typeRef2, e.activeTs, e.rtnApplicable, e.rtnTs,   e.rtnCause, e.alarmLevel, e.message, e.ackTs, e.ackUserId, u.username, e.alternateAckSource,   (select count(1) from userComments where commentType=1     and typeKey=e.id) as cnt from events e   left join users u on e.ackUserId=u.id where e.rtnApplicable=? and e.rtnTs is null [50000-199]
        at org.h2.message.DbException.getJdbcSQLException(DbException.java:502) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.message.DbException.getJdbcSQLException(DbException.java:427) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.message.DbException.get(DbException.java:194) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.message.DbException.convert(DbException.java:347) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.command.Command.executeQuery(Command.java:219) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.jdbc.JdbcPreparedStatement.executeQuery(JdbcPreparedStatement.java:115) ~[h2-1.4.199.jar:1.4.199]
        at org.springframework.jdbc.core.JdbcTemplate$1.doInPreparedStatement(JdbcTemplate.java:677) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:616) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        ... 10 more
Caused by: java.lang.RuntimeException: page[49090] data leaf table:103 EVENTS entries:12 parent:46488 keys:[264424, 264425, 264426, 264427, 264428, 264429, 264430, 264431, 264432, 264433, 264434, 264435] offsets:[3897, 3696, 3502, 3308, 3112, 3038, 2836, 2636, 2434, 2234, 2031, 1823] parent 46488 expected 50476
        at org.h2.message.DbException.throwInternalError(DbException.java:293) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.PageDataIndex.getPage(PageDataIndex.java:219) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.PageDataNode.getRowWithKey(PageDataNode.java:278) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.PageDataNode.getRowWithKey(PageDataNode.java:279) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.PageDataIndex.getRowWithKey(PageDataIndex.java:387) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.PageDataIndex.getRow(PageDataIndex.java:376) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.table.PageStoreTable.getRow(PageStoreTable.java:84) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.PageBtreeIndex.getRow(PageBtreeIndex.java:303) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.PageBtreeCursor.get(PageBtreeCursor.java:45) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.IndexCursor.get(IndexCursor.java:274) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.table.TableFilter.getValue(TableFilter.java:1092) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.expression.ExpressionColumn.getValue(ExpressionColumn.java:215) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.IndexCondition.getCurrentValue(IndexCondition.java:138) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.IndexCursor.prepare(IndexCursor.java:108) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.index.IndexCursor.find(IndexCursor.java:154) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.table.TableFilter.next(TableFilter.java:475) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.table.TableFilter.next(TableFilter.java:545) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.command.dml.Select$LazyResultQueryFlat.fetchNextRow(Select.java:1882) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.result.LazyResult.hasNext(LazyResult.java:101) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.result.LazyResult.next(LazyResult.java:60) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.command.dml.Select.queryFlat(Select.java:742) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.command.dml.Select.queryWithoutCache(Select.java:884) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.command.dml.Query.queryWithoutCacheLazyCheck(Query.java:151) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.command.dml.Query.query(Query.java:435) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.command.dml.Query.query(Query.java:397) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.command.CommandContainer.query(CommandContainer.java:145) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.command.Command.executeQuery(Command.java:202) ~[h2-1.4.199.jar:1.4.199]
        at org.h2.jdbc.JdbcPreparedStatement.executeQuery(JdbcPreparedStatement.java:115) ~[h2-1.4.199.jar:1.4.199]
        at org.springframework.jdbc.core.JdbcTemplate$1.doInPreparedStatement(JdbcTemplate.java:677) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:616) ~[spring-jdbc-5.1.7.RELEASE.jar:5.1.7.RELEASE]
        ... 10 more
INFO  2020-03-11T15:40:48,149 (com.serotonin.m2m2.Lifecycle.terminate:400) - Mango Lifecycle terminating...
INFO  2020-03-11T15:40:48,226 (com.serotonin.m2m2.rt.maint.BackgroundProcessingImpl.joinTermination:550) - All high priority tasks exited gracefully.
INFO  2020-03-11T15:40:48,228 (com.serotonin.m2m2.rt.maint.BackgroundProcessingImpl.joinTermination:556) - All medium priority tasks exited gracefully.
INFO  2020-03-11T15:40:48,229 (com.serotonin.m2m2.rt.maint.BackgroundProcessingImpl.joinTermination:561) - All low priority tasks exited gracefully.
INFO  2020-03-11T15:40:48,267 (com.infiniteautomation.mango.spring.components.executors.MangoExecutors.destroy:71) - Shutting down shared executor and scheduled exectutor
INFO  2020-03-11T15:40:48,271 (com.infiniteautomation.mango.spring.components.executors.MangoExecutors.awaitTermination:129) - Executors shutdown successfully
INFO  2020-03-11T15:40:48,284 (com.serotonin.m2m2.db.H2Proxy.terminateImpl:406) - Terminating database.
INFO  2020-03-11T15:40:48,575 (com.infiniteautomation.nosql.MangoNoSqlProxy.shutdown:116) - Terminating NoSQL Batch Write Manager.
INFO  2020-03-11T15:40:48,577 (com.infiniteautomation.nosql.MangoNoSqlBatchWriteBehindManager.terminate:241) - Terminating NoSQL Point Value Mover.
INFO  2020-03-11T15:40:48,580 (com.infiniteautomation.nosql.MangoNoSqlBatchWriteBehindManager.terminate:266) - Terminating NoSQL Stale Point Cleaner.
INFO  2020-03-11T15:40:48,582 (com.infiniteautomation.nosql.MangoNoSqlBatchWriteBehindManager.terminate:269) - Terminating NoSQL Status Provider.
INFO  2020-03-11T15:40:48,584 (com.infiniteautomation.nosql.MangoNoSqlProxy.shutdown:124) - Closing NoSQL Database: Point Values
INFO  2020-03-11T15:40:48,625 (com.infiniteautomation.nosql.MangoNoSqlProxy.shutdown:132) - Closing NoSQL Database: Point Data
INFO  2020-03-11T15:40:48,635 (com.serotonin.m2m2.Lifecycle.terminate:550) - Mango Lifecycle terminated.

Unfortunately, it seems the logs may not have captured the original error I briefly saw during the attempt to create the publisher. Is there another place I could look? Or is this log enough for you to identify the problem?

Aldo