Please Note This forum exists for community support for the Mango product family and the Radix IoT Platform. Although Radix IoT employees participate in this forum from time to time, there is no guarantee of a response to anything posted here, nor can Radix IoT, LLC guarantee the accuracy of any information expressed or conveyed. Specific project questions from customers with active support contracts are asked to send requests to support@radixiot.com.
Easiest way to move data from one instance of Mango to another
-
Hi,
I have a new installation of Mango (3.5) and I'd like to move a number of data sources, their points and all of their saved historic data off of another existing Mango server (3.4) into the new one.
I've spent some time reading other posts in this forum dealing with a similar question, but I can't find a clear answer.
https://forum.infiniteautomation.com/topic/3247/data-import-flexibility
https://forum.infiniteautomation.com/topic/2514/data-importI know I can easily export and import the data sources I want and their points using the Configuration Import/Export feature in the emport.shtm page, and this works great.
However I'm looking to move all their respective saved history data as well. I also know I can do a data point history export under the data_point_details.shtm and importing them in the dataImport.shtm page - but this can be tedious when dealing with a total of thousands of data points.
Is there another easy way to achieve this WITHOUT having to duplicate/replicate the entire old Mango server (3.4) AND without having to manually do a CSV/Excel export and import for each one of the data points we care about?
Thanks.
-
Hi ddiezperez,
Yes, there is such a tool! I'm not sure what you mean,
WITHOUT having to duplicate/replicate the entire old Mango server
but with an H2 backup restored into a database (see this post for instructions on doing a restore at the command line) and the old Mango/databases/mangoTSDB, the "Mergration" tool on the /mango_no_sql.shtm page will do this. It relies on matching the XIDs from your current database to the restored database, and then imports data from the mangoTSDB it's pointed at (also the restored TSDB) into the running Mango. This is the correct course of action if you wish to restore data into a system that has been created through a JSON import, as the IDs may have changed and a simple NoSQL merge is not sufficient. So,
- Import JSON configuration
- Use Mergration tab on /mango_no_sql.shtm to point at the old H2 database and the old mangoTSDB directory
-
Hi Phil - thanks for the response. I ran into an issue.
I exported a small subset of the data sources and their points and imported their JSON configuration into the new Mango server.
I copied the entire Mango/databases/MangoTSDB directory from the old Mango server into a Mango/databases/MangoTSDB_fromDot41 in my new Mango server.
Then I went ahead and used the "Merge TSDB Data Into Mango" tool in the /mango_no_sql.shtm page. I pointed the Source TSDB location to the MangoTSBB_fromDot41 directory I mentioned above and left all the other settings at default value.
I got the following error within a few seconds: Merge failed, you need 6248 available file descriptors but only have 3422
Latest ma.log file is pasted below.
WARN 2018-10-09T00:32:59,100 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 2380 polls since it started. WARN 2018-10-09T00:36:04,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 1633 polls since it started. WARN 2018-10-09T01:32:59,100 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 2650 polls since it started. WARN 2018-10-09T01:36:04,100 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 1825 polls since it started. WARN 2018-10-09T02:33:09,100 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 2921 polls since it started. WARN 2018-10-09T02:36:04,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 2017 polls since it started. INFO 2018-10-09T03:05:00,006 (com.serotonin.m2m2.rt.maint.DataPurge.executeImpl:68) - Data purge started INFO 2018-10-09T03:05:00,158 (com.serotonin.m2m2.rt.maint.DataPurge.executeImpl:91) - Data purge ended, 0 point samples deleted INFO 2018-10-09T03:05:00,196 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:147) - Database at /Mango/databases/reports started INFO 2018-10-09T03:05:00,222 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:178) - Empty dir delete for database at /Mango/databases/reports took 0ms INFO 2018-10-09T03:05:00,228 (com.infiniteautomation.nosql.MangoNoSqlProxy.createNoSQLDao:259) - Starting New NoSQL Database for reports WARN 2018-10-09T03:33:09,100 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 3192 polls since it started. WARN 2018-10-09T03:36:19,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 2210 polls since it started. WARN 2018-10-09T04:33:09,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 3462 polls since it started. WARN 2018-10-09T04:36:34,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 2403 polls since it started. INFO 2018-10-09T05:00:00,008 (com.infiniteautomation.nosql.maint.MangoNoSqlBackupWorkItem.execute:130) - Starting Mango NoSQL Backup WorkItem. WARN 2018-10-09T05:33:09,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 3732 polls since it started. WARN 2018-10-09T05:36:34,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 2595 polls since it started. WARN 2018-10-09T06:33:09,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 4002 polls since it started. WARN 2018-10-09T06:36:34,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 2787 polls since it started. WARN 2018-10-09T07:33:09,100 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 4272 polls since it started. WARN 2018-10-09T07:36:49,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 2980 polls since it started. WARN 2018-10-09T07:57:59,331 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source Mango Internal aborted 4 polls since it started. WARN 2018-10-09T08:33:09,100 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 4544 polls since it started. WARN 2018-10-09T08:36:49,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 3173 polls since it started. WARN 2018-10-09T08:59:59,107 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source Mango Internal aborted 8 polls since it started. WARN 2018-10-09T09:33:09,100 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 4814 polls since it started. WARN 2018-10-09T09:36:49,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 3365 polls since it started. WARN 2018-10-09T10:33:19,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 5085 polls since it started. WARN 2018-10-09T10:36:49,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 3557 polls since it started. WARN 2018-10-09T11:03:53,668 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source Mango Internal aborted 9 polls since it started. WARN 2018-10-09T11:33:19,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 5356 polls since it started. WARN 2018-10-09T11:37:04,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 3750 polls since it started. WARN 2018-10-09T12:33:19,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 5626 polls since it started. WARN 2018-10-09T12:37:19,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 3943 polls since it started. INFO 2018-10-09T12:40:27,056 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:147) - Database at /Mango/databases/mangoTSDB_fromDot41 started INFO 2018-10-09T12:40:28,013 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:178) - Empty dir delete for database at /Mango/databases/mangoTSDB_fromDot41 took 928ms INFO 2018-10-09T12:40:35,231 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:239) - Corruption scan for database at /Mango/databases/mangoTSDB_fromDot41 skipped because the database is configured not to run scan. INFO 2018-10-09T12:40:35,241 (com.infiniteautomation.nosql.maint.MangoNoSqlMergeWorkItem.execute:48) - Starting Data Merge, please wait... ERROR 2018-10-09T12:40:35,278 (com.infiniteautomation.nosql.maint.MangoNoSqlMergeWorkItem.execute:60) - Merge failed, you need 6248 available file descriptors but only have 3756 INFO 2018-10-09T12:50:22,834 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'NC, Charlotte Simple Agent ESB' initialized INFO 2018-10-09T12:50:22,834 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'NC, Charlotte Simple Agent ESB' took 5.642374ms to start INFO 2018-10-09T12:53:09,636 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'VT, Burlington Simple Agent KW Meter' initialized INFO 2018-10-09T12:53:09,637 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'VT, Burlington Simple Agent KW Meter' took 2.32869ms to start INFO 2018-10-09T12:53:18,534 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'VT, Burlington Simple Agent ESB' initialized INFO 2018-10-09T12:53:18,534 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'VT, Burlington Simple Agent ESB' took 1.812003ms to start INFO 2018-10-09T12:53:35,505 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'VA, Alexandria Simple Agent KW Meter' initialized INFO 2018-10-09T12:53:35,506 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'VA, Alexandria Simple Agent KW Meter' took 5.406502ms to start WARN 2018-10-09T12:54:09,637 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source VT, Burlington Simple Agent KW Meter aborted 1 polls since it started. INFO 2018-10-09T12:54:12,521 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'VA, Alexandria Simple Agent ESB' initialized INFO 2018-10-09T12:54:12,521 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'VA, Alexandria Simple Agent ESB' took 3.732791ms to start INFO 2018-10-09T12:55:10,248 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'UT, Salt Lake Simple Agent KW Meter' initialized INFO 2018-10-09T12:55:10,249 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'UT, Salt Lake Simple Agent KW Meter' took 28.103625ms to start INFO 2018-10-09T12:55:36,236 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'UT, Salt Lake Simple Agent ESB' initialized INFO 2018-10-09T12:55:36,236 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'UT, Salt Lake Simple Agent ESB' took 12.221891ms to start INFO 2018-10-09T12:55:54,944 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'TN, Nashville Simple Agent KW Meter' initialized INFO 2018-10-09T12:55:54,945 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'TN, Nashville Simple Agent KW Meter' took 2.518504ms to start WARN 2018-10-09T12:56:10,249 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source UT, Salt Lake Simple Agent KW Meter aborted 1 polls since it started. INFO 2018-10-09T12:56:13,435 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'TN, Nashville Simple Agent ESB' initialized INFO 2018-10-09T12:56:13,436 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'TN, Nashville Simple Agent ESB' took 3.186461ms to start WARN 2018-10-09T12:56:54,948 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source TN, Nashville Simple Agent KW Meter aborted 1 polls since it started. WARN 2018-10-09T13:02:09,623 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source Mango Internal aborted 11 polls since it started. INFO 2018-10-09T13:02:33,968 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:147) - Database at /Mango/databases/mangoTSDB_fromDot41 started INFO 2018-10-09T13:02:34,389 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:178) - Empty dir delete for database at /Mango/databases/mangoTSDB_fromDot41 took 394ms INFO 2018-10-09T13:02:40,730 (com.infiniteautomation.nosql.maint.MangoNoSqlMergeWorkItem.execute:48) - Starting Data Merge, please wait... ERROR 2018-10-09T13:02:40,782 (com.infiniteautomation.nosql.maint.MangoNoSqlMergeWorkItem.execute:60) - Merge failed, you need 6248 available file descriptors but only have 3422 -
@phildunlap said in Easiest way to move data from one instance of Mango to another:
Yes, there is such a tool! I'm not sure what you mean,
WITHOUT having to duplicate/replicate the entire old Mango server
What I meant was: the intention of the new Mango server is not to be a replica of our existing Mango server - I don't want to move all the datasources and datapoints - I only want a select subset. Hence why I don't want to restore the entire database of the old Mango server into the new Mango server, I only want the datasources and points I care for and their history.
-
Merge or Mergration ? You need to do a Mergration if you restored the configuration from the JSON import. Not Merge.
I got the following error within a few seconds: Merge failed, you need 6248 available file descriptors but only have 3422
Ah, dreaded file descriptors! One solution is to adjust the /etc/security/limits.conf file for the user on the operating system that is launching Mango to have a line like,
Username hard nofile 50000You can use a larger value, or 'unlimited' if you want. Then you'll need to log out of SSH and back in (if you're starting Mango as that user) and have a script in Mango/bin/ext-enabled like,
#!/bin/bash #fdLimits.sh case "$1" in init) ulimit -Hn 50000 ;; esacThen stop, and start Mango for that to get applied. If you are launching Mango in the same SSH session you're logging in as, you can just run the ulimit command, but you'll want it as an ext-enabled script so that whatever session invokes Mango (like maybe a service kicking off Mango under an appropriate user) will have the limit for file descriptors appropriately raised.
-
@phildunlap said in Easiest way to move data from one instance of Mango to another:
Merge or Mergration ? You need to do a Mergration if you restored the configuration from the JSON import. Not Merge.
I used the "Merge TSDB Data into Mango" tab. You are saying I should have used the "Migrate NoSQL Data Into Mango" - correct? Just want to be clear as I'm unsure of what the "Mergreation" tool is ..
-
Oh, look at that, someone must have changed the tab names and I hadn't noticed. Yes, you want the "Migrate NoSQL Data Into Mango" tab. That should have inputs for an SQL database and a NoSQL database. Originally there was Migration (from SQL) and Merge (from a same-point-ids NoSQL) and so I called the 'both' type a Mergration. I guess that didn't stick!
Edit: It looks like ten months ago Mergration became NoSQL Migration - sorry for my confusion.
-
Oh, look at that, someone must have changed the tab names and I hadn't noticed. Yes, you want the "Migrate NoSQL Data Into Mango" tab. That should have inputs for an SQL database and a NoSQL database. I guess someone else didn't like 'Mergration' either. Originally there was Migration (from SQL) and Merge (from a same-point-ids NoSQL) and so I called the 'both' type a Mergration. I guess that didn't stick!
Ha gotcha - Thanks for the clarification.
I just gave it a try and looks like having the Mango Internal data source in both servers is a problem when trying to migrate NoSQL data into Mango.
-
Are you getting an error? That should work fine, the only issues will arise if you have XIDs that exist in both SQL databases but are not the same data types.
-
Getting this ... even after renaming the XID of the Mango Internal data source
org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196]That shouldn't prevent the rest of the data migration to complete though - correct?
-
Check to make sure your connection string is good. One interesting behavior of H2 is that if you point your connection string at a location that doesn't have a database and try to log into it with credentials, it will create a new, empty H2 database there. That would then not have a dataPoints table to query upon!
Should be something like,
jdbc:h2:/path/to/old-databases/mah2and probably the best connection string for H2 may also have the arguments added on the db.url normally in H2Proxy, which would be
jdbc:h2:/path/to/old-databases/mah2;DB_CLOSE_ON_EXIT=FALSE;MV_STORE=FALSE;IGNORECASE=TRUEAnd you can optionally add
;IFEXISTS=TRUEto the end to ensure it won't just create a new, empty H2 database if the connection string isn't quite right.I will make the change in this issue to this type of migration as well: https://github.com/infiniteautomation/ma-core-public/issues/631
-
Thanks for the help Phil - it is processing right now .. Keeping the fingers crossed.
If this works correctly then I'll go back and do a JSON config import of the rest of the data sources and points I care about and repeat the process.
This will be really helpful when integrating sites/controllers for clients on a dev/test Mango server first and then migrating the data and polling to the client's production environment.
I'll report back after it is done processing ..
UPDATE: status went to IDLE and it seems to be frozen at Run Time of 67 seconds. What can I check?0_1539109844073_Data_Migration.PNG
-
Log file. I saw something like that recently where corruption exceptions were killing the merge task I tried to run. Was quite irritating. A shame we haven't released 3.5.1 of NoSQL yet, as I put retries into the Merge and the NoSQL Migration should there be corruption in a shard in the NoSQL. Maybe I can email you a pre-release of that....
-
Connection string is pointing to the right directory and file, and I used the suggested arguments as well. It is pasted below:
jdbc:h2:file:/Mango/databases/_fromDot41/mah2;DB_CLOSE_ON_EXIT=FALSE;MV_STORE=FALSE;IGNORECASE=TRUE;IFEXISTS=TRUELatest ma.log file pasted below. Sorry I keep pasting the entire file within the post, if there's a better way to share it please let me know.
INFO 2018-10-09T13:55:59,424 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:147) - Database at /Mango/databases/mangoTSDB_fromDot41 started INFO 2018-10-09T13:55:59,852 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:178) - Empty dir delete for database at /Mango/databases/mangoTSDB_fromDot41 took 399ms INFO 2018-10-09T13:56:06,508 (com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute:40) - Starting Data Mergration, please wait... ERROR 2018-10-09T13:56:06,521 (com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId:88) - Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] at org.h2.message.DbException.getJdbcSQLException(DbException.java:345) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:179) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:155) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableOrView(Parser.java:5552) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableFilter(Parser.java:1266) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimpleFromPart(Parser.java:1946) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimple(Parser.java:2095) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSub(Parser.java:1940) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectUnion(Parser.java:1755) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelect(Parser.java:1743) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parsePrepared(Parser.java:449) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:321) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:293) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.prepareCommand(Parser.java:258) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareLocal(Session.java:578) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareCommand(Session.java:519) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcConnection.prepareCommand(JdbcConnection.java:1204) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:73) ~[h2-1.4.196.jar:1.4.196] at com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId(GenericSqlPointValueDao.java:78) ~[?:?] at com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute(MangoNoSqlMergrationWorkItem.java:52) ~[?:?] at com.serotonin.m2m2.rt.maint.BackgroundProcessingImpl$RejectableWorkItemRunnable.run(BackgroundProcessingImpl.java:632) ~[mango-3.5.0.jar:?] at com.serotonin.timer.Task.runTask(Task.java:179) ~[mango-3.5.0.jar:?] at com.serotonin.timer.TaskWrapper.run(TaskWrapper.java:23) ~[mango-3.5.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_181] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_181] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181] ERROR 2018-10-09T13:56:06,522 (com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute:102) - org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] com.serotonin.ShouldNeverHappenException: org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] at com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId(GenericSqlPointValueDao.java:89) ~[?:?] at com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute(MangoNoSqlMergrationWorkItem.java:52) ~[?:?] at com.serotonin.m2m2.rt.maint.BackgroundProcessingImpl$RejectableWorkItemRunnable.run(BackgroundProcessingImpl.java:632) ~[mango-3.5.0.jar:?] at com.serotonin.timer.Task.runTask(Task.java:179) ~[mango-3.5.0.jar:?] at com.serotonin.timer.TaskWrapper.run(TaskWrapper.java:23) ~[mango-3.5.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_181] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_181] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181] Caused by: org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] at org.h2.message.DbException.getJdbcSQLException(DbException.java:345) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:179) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:155) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableOrView(Parser.java:5552) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableFilter(Parser.java:1266) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimpleFromPart(Parser.java:1946) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimple(Parser.java:2095) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSub(Parser.java:1940) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectUnion(Parser.java:1755) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelect(Parser.java:1743) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parsePrepared(Parser.java:449) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:321) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:293) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.prepareCommand(Parser.java:258) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareLocal(Session.java:578) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareCommand(Session.java:519) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcConnection.prepareCommand(JdbcConnection.java:1204) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:73) ~[h2-1.4.196.jar:1.4.196] at com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId(GenericSqlPointValueDao.java:78) ~[?:?] ... 7 more WARN 2018-10-09T13:56:10,249 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source UT, Salt Lake Simple Agent KW Meter aborted 61 polls since it started. WARN 2018-10-09T13:57:24,948 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source TN, Nashville Simple Agent KW Meter aborted 62 polls since it started. INFO 2018-10-09T13:58:54,227 (com.serotonin.m2m2.rt.RuntimeManagerImpl.stopDataSourceShutdown:423) - Data source 'Mango Internal' stopped INFO 2018-10-09T13:58:54,317 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'Mango Internal' initialized INFO 2018-10-09T13:58:54,318 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'Mango Internal' took 79.100375ms to start INFO 2018-10-09T13:59:26,616 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:147) - Database at /Mango/databases/mangoTSDB_fromDot41 started INFO 2018-10-09T13:59:27,018 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:178) - Empty dir delete for database at /Mango/databases/mangoTSDB_fromDot41 took 375ms INFO 2018-10-09T13:59:32,963 (com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute:40) - Starting Data Mergration, please wait... ERROR 2018-10-09T13:59:32,965 (com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId:88) - Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] at org.h2.message.DbException.getJdbcSQLException(DbException.java:345) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:179) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:155) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableOrView(Parser.java:5552) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableFilter(Parser.java:1266) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimpleFromPart(Parser.java:1946) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimple(Parser.java:2095) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSub(Parser.java:1940) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectUnion(Parser.java:1755) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelect(Parser.java:1743) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parsePrepared(Parser.java:449) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:321) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:293) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.prepareCommand(Parser.java:258) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareLocal(Session.java:578) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareCommand(Session.java:519) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcConnection.prepareCommand(JdbcConnection.java:1204) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:73) ~[h2-1.4.196.jar:1.4.196] at com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId(GenericSqlPointValueDao.java:78) ~[?:?] at com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute(MangoNoSqlMergrationWorkItem.java:52) ~[?:?] at com.serotonin.m2m2.rt.maint.BackgroundProcessingImpl$RejectableWorkItemRunnable.run(BackgroundProcessingImpl.java:632) ~[mango-3.5.0.jar:?] at com.serotonin.timer.Task.runTask(Task.java:179) ~[mango-3.5.0.jar:?] at com.serotonin.timer.TaskWrapper.run(TaskWrapper.java:23) ~[mango-3.5.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_181] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_181] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181] ERROR 2018-10-09T13:59:32,965 (com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute:102) - org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] com.serotonin.ShouldNeverHappenException: org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] at com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId(GenericSqlPointValueDao.java:89) ~[?:?] at com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute(MangoNoSqlMergrationWorkItem.java:52) ~[?:?] at com.serotonin.m2m2.rt.maint.BackgroundProcessingImpl$RejectableWorkItemRunnable.run(BackgroundProcessingImpl.java:632) ~[mango-3.5.0.jar:?] at com.serotonin.timer.Task.runTask(Task.java:179) ~[mango-3.5.0.jar:?] at com.serotonin.timer.TaskWrapper.run(TaskWrapper.java:23) ~[mango-3.5.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_181] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_181] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181] Caused by: org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] at org.h2.message.DbException.getJdbcSQLException(DbException.java:345) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:179) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:155) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableOrView(Parser.java:5552) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableFilter(Parser.java:1266) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimpleFromPart(Parser.java:1946) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimple(Parser.java:2095) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSub(Parser.java:1940) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectUnion(Parser.java:1755) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelect(Parser.java:1743) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parsePrepared(Parser.java:449) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:321) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:293) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.prepareCommand(Parser.java:258) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareLocal(Session.java:578) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareCommand(Session.java:519) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcConnection.prepareCommand(JdbcConnection.java:1204) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:73) ~[h2-1.4.196.jar:1.4.196] at com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId(GenericSqlPointValueDao.java:78) ~[?:?] ... 7 more INFO 2018-10-09T14:05:13,766 (com.serotonin.m2m2.rt.RuntimeManagerImpl.stopDataSourceShutdown:423) - Data source 'Mango Internal' stopped INFO 2018-10-09T14:05:13,777 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:380) - Data source 'Mango Internal' initialized INFO 2018-10-09T14:05:13,778 (com.serotonin.m2m2.rt.RuntimeManagerImpl.initializeDataSourceStartup:385) - Data source 'Mango Internal' took 9.333323ms to start INFO 2018-10-09T14:05:38,690 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:147) - Database at /Mango/databases/mangoTSDB_fromDot41 started INFO 2018-10-09T14:05:39,127 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:178) - Empty dir delete for database at /Mango/databases/mangoTSDB_fromDot41 took 411ms INFO 2018-10-09T14:05:45,359 (com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute:40) - Starting Data Mergration, please wait... ERROR 2018-10-09T14:05:45,360 (com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId:88) - Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] at org.h2.message.DbException.getJdbcSQLException(DbException.java:345) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:179) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:155) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableOrView(Parser.java:5552) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableFilter(Parser.java:1266) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimpleFromPart(Parser.java:1946) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimple(Parser.java:2095) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSub(Parser.java:1940) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectUnion(Parser.java:1755) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelect(Parser.java:1743) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parsePrepared(Parser.java:449) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:321) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:293) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.prepareCommand(Parser.java:258) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareLocal(Session.java:578) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareCommand(Session.java:519) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcConnection.prepareCommand(JdbcConnection.java:1204) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:73) ~[h2-1.4.196.jar:1.4.196] at com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId(GenericSqlPointValueDao.java:78) ~[?:?] at com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute(MangoNoSqlMergrationWorkItem.java:52) ~[?:?] at com.serotonin.m2m2.rt.maint.BackgroundProcessingImpl$RejectableWorkItemRunnable.run(BackgroundProcessingImpl.java:632) ~[mango-3.5.0.jar:?] at com.serotonin.timer.Task.runTask(Task.java:179) ~[mango-3.5.0.jar:?] at com.serotonin.timer.TaskWrapper.run(TaskWrapper.java:23) ~[mango-3.5.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_181] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_181] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181] ERROR 2018-10-09T14:05:45,360 (com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute:102) - org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] com.serotonin.ShouldNeverHappenException: org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] at com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId(GenericSqlPointValueDao.java:89) ~[?:?] at com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute(MangoNoSqlMergrationWorkItem.java:52) ~[?:?] at com.serotonin.m2m2.rt.maint.BackgroundProcessingImpl$RejectableWorkItemRunnable.run(BackgroundProcessingImpl.java:632) ~[mango-3.5.0.jar:?] at com.serotonin.timer.Task.runTask(Task.java:179) ~[mango-3.5.0.jar:?] at com.serotonin.timer.TaskWrapper.run(TaskWrapper.java:23) ~[mango-3.5.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_181] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_181] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181] Caused by: org.h2.jdbc.JdbcSQLException: Table "DATAPOINTS" not found; SQL statement: select id from dataPoints where xid = 'internal_mango_num_active_user_sessions' [42102-196] at org.h2.message.DbException.getJdbcSQLException(DbException.java:345) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:179) ~[h2-1.4.196.jar:1.4.196] at org.h2.message.DbException.get(DbException.java:155) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableOrView(Parser.java:5552) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.readTableFilter(Parser.java:1266) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimpleFromPart(Parser.java:1946) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSimple(Parser.java:2095) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectSub(Parser.java:1940) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelectUnion(Parser.java:1755) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parseSelect(Parser.java:1743) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parsePrepared(Parser.java:449) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:321) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.parse(Parser.java:293) ~[h2-1.4.196.jar:1.4.196] at org.h2.command.Parser.prepareCommand(Parser.java:258) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareLocal(Session.java:578) ~[h2-1.4.196.jar:1.4.196] at org.h2.engine.Session.prepareCommand(Session.java:519) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcConnection.prepareCommand(JdbcConnection.java:1204) ~[h2-1.4.196.jar:1.4.196] at org.h2.jdbc.JdbcStatement.executeQuery(JdbcStatement.java:73) ~[h2-1.4.196.jar:1.4.196] at com.infiniteautomation.nosql.maint.GenericSqlPointValueDao.getDataPointId(GenericSqlPointValueDao.java:78) ~[?:?] ... 7 more INFO 2018-10-09T14:16:06,885 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:147) - Database at /Mango/databases/mangoTSDB_fromDot41 started INFO 2018-10-09T14:16:07,308 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:178) - Empty dir delete for database at /Mango/databases/mangoTSDB_fromDot41 took 396ms INFO 2018-10-09T14:16:14,018 (com.infiniteautomation.nosql.maint.MangoNoSqlMergeWorkItem.execute:48) - Starting Data Merge, please wait... ERROR 2018-10-09T14:16:14,057 (com.infiniteautomation.nosql.maint.MangoNoSqlMergeWorkItem.execute:60) - Merge failed, you need 6248 available file descriptors but only have 3350 INFO 2018-10-09T14:23:03,466 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:147) - Database at /Mango/databases/mangoTSDB_fromDot41 started INFO 2018-10-09T14:23:03,903 (com.infiniteautomation.tsdb.impl.IasTsdbImpl.<init>:178) - Empty dir delete for database at /Mango/databases/mangoTSDB_fromDot41 took 410ms INFO 2018-10-09T14:23:11,280 (com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute:40) - Starting Data Mergration, please wait... WARN 2018-10-09T14:23:27,522 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source Mango Internal aborted 1 polls since it started. ERROR 2018-10-09T14:24:10,653 (com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute:102) - null java.nio.BufferOverflowException: null at com.infiniteautomation.tsdb.ByteArrayBuilder.ensureAvailable(ByteArrayBuilder.java:405) ~[?:?] at com.infiniteautomation.tsdb.ByteArrayBuilder.getString(ByteArrayBuilder.java:315) ~[?:?] at com.infiniteautomation.nosql.PointValueTimeSerializer.fromByteArray(PointValueTimeSerializer.java:81) ~[?:?] at com.infiniteautomation.nosql.PointValueTimeSerializer.fromByteArray(PointValueTimeSerializer.java:36) ~[?:?] at com.infiniteautomation.tsdb.impl.IasTsdbImpl$CallbackWrapper.sample(IasTsdbImpl.java:955) ~[?:?] at com.infiniteautomation.tsdb.impl.Shard.query(Shard.java:483) ~[?:?] at com.infiniteautomation.tsdb.impl.CompressibleShard.query(CompressibleShard.java:391) ~[?:?] at com.infiniteautomation.tsdb.impl.Series.query(Series.java:532) ~[?:?] at com.infiniteautomation.tsdb.impl.IasTsdbImpl.query(IasTsdbImpl.java:518) ~[?:?] at com.infiniteautomation.tsdb.impl.IasTsdbImpl.query(IasTsdbImpl.java:505) ~[?:?] at com.infiniteautomation.tsdb.impl.IasTsdbImpl.query(IasTsdbImpl.java:485) ~[?:?] at com.infiniteautomation.tsdb.impl.IasTsdbImpl.query(IasTsdbImpl.java:470) ~[?:?] at com.infiniteautomation.nosql.maint.MangoNoSqlMergrationWorkItem.execute(MangoNoSqlMergrationWorkItem.java:63) ~[?:?] at com.serotonin.m2m2.rt.maint.BackgroundProcessingImpl$RejectableWorkItemRunnable.run(BackgroundProcessingImpl.java:632) ~[mango-3.5.0.jar:?] at com.serotonin.timer.Task.runTask(Task.java:179) ~[mango-3.5.0.jar:?] at com.serotonin.timer.TaskWrapper.run(TaskWrapper.java:23) ~[mango-3.5.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_181] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_181] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181] WARN 2018-10-09T14:33:29,100 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source NC, Charlotte Simple Agent KW Meter aborted 6172 polls since it started. WARN 2018-10-09T14:37:19,099 (com.serotonin.m2m2.rt.dataSource.PollingDataSource.incrementUnsuccessfulPolls:157) - Data Source AL, Montgomery Simple Agent KW Meter aborted 4330 polls since it started. -
We moved to email, but the next version of MangoNoSql, 3.5.1, will improve the handling of corruption in the database that is to be merged. This is what caused the buffer overflow exception at the end of the log, and the returning to IDLE state before finishing all the data points.
Sorry I keep pasting the entire file within the post, if there's a better way to share it please let me know.
Tis better to log the whole log than no log at all!
