I deleted mah2.h2.db and did a backup to January 9, (before I added any new sources, points etc) database is now down to ~320MB. No server timeout issues anymore.
Though, at first, I did a backup to January 22 (yesterday), it fell down to ~550MB, but it went into timeout again when I tried to access data sources page. Did a restart, it jumped up to 2.5GB after restart. Note: PC with Mango server is currently without internet connection though it polls its sources via TCP.
Any suggestions for me on how to determine why is my H2 database so large?
Hi Phil,
Had some obligations to fulfill so I was away from my PC.
I have deleted the Mango/work/jsp directory. Also purged all events and checked system settings for backup and purge policies. Currently, the policy is to purge all point data older than 1 year, all events older than 1 day and discard future dated values more than 24h.
NoSql is doing backups every day and keeps 365 versions.
Since I have NoSql backing up everything daily, is it safe to assume that I can actually purge point data much more frequently?
@mattfox Well, this has been working for some two years or so, and we do need to keep all the data for at least the last one year
Just to clarify, I didn't state my H2 database size till now, I stated that my NoSql has 6GB. H2 database took forever to show that info on system settings page, actually I stopped waiting for it to show it, I checked properties on the H2 database inside the file system.
Hi, everyone.
I have a very simple SCADA system with Mango 2.7.10:
-360 data sources in two groups of 180.
-One group has 72 data points per source that update once every 5 minutes.
-The other has 327 data points per source that update once every 24h.
-There is 1 virtual source with 1620 virtual points.
-There is 1 meta source with ~182 meta points
-180 meta points use a simple script that compares certain data point values and returns 0, 1, 2, 3 or 4.
-1 meta point uses a simple script that adds 180 data point values together and divides them by 180 to find the average.
-1 meta point uses a simple script that adds certain data point values together.
-There are 180 hierarchy folders.
-There are ~180 watch lists.
-There are no events and no alarms.
-Server with Mango installed has no other application than Mango
Now, this has all worked well until recently when I added a further 120 data sources with their respective data points, hierarchy folders and watch lists, to make the current total of 360 data sources. After adding this, I've experienced Server Timeouts, but only on data sources page. I am able to check every other page as much as I want, but when I open the data sources page, it starts loading data sources into the list, but stops with the last data point before the timeout being always the same one. It does manage to load them all after some, long, time, but usually it never does and Mango needs to be restarted. If it does manage to load all the sources, it may also go into timeout while waiting to open the edit page for some source. As with the previous case, it can also manage to load it after some long time, but usually it never does and Mango needs to be restarted. I am using the embedded H2 database that has 8.8GB. When Mango goes into timeout, Memory is only 27% used, but all 8 CPU cores go into ~100% usage.
I have all the licences,
Are there too much data points now ~75 000, or too much data sources~180? Is the database too large, if so how large it should be at max? Why is Mango going into timeout like this?
Regards, Stefan Radunovic
Yeah, I've tried to upload it here with the "Upload File" option but it says I have no permission to do that. I've sent logs to the support address.
Hi phil,
It happened again. There is nothing on logs page about this event, the read tools do work. My thread pool size is 100, I'll increase it to 200 and see what happens. It has eaten up all the RAM again. What's your email, so I can send you log files?
Nope, haven't done anything to mango externally. So, I'll increase it on Monday and update you with the results.
Hi Phil,
Well, my Mango core is 2.7.10.
We were somewhat lucky and unlucky at the same time, it didn't happen again since the last time I turned those sources off and on some 10 days ago, but it will happen again. I'll notify you then, and provide you with answer to your questions.
I've checked the logging page and I see a lot of this
This is my OS (Ubuntu) log, Mango has eaten all the RAM
It seems to me that this is the same issue like in this thread https://forum.infiniteautomation.com/topic/2483/high-cpu-usage/27
I can't send you the log file here, says I don't have permissions to do that. Can you give me your email so I could send it there?
I'm using 2.x version of Mango SCADA with enterprise license + DGLux 2.5.
The system has 240 Modbus I/P sources created, in two different groups of 120 each. The first group has 348 points per source and a polling frequency of 24 hours, and the second one has 62 points per source and a polling frequency of 5 minutes. 120 devices with 120 different IP addresses are connected to Mango and each device has one source from both groups polling it for data. 60 devices are connected to the internet with cable and the other 60 are connected with 2G GPRS. Along with that, I have one Meta source with 120 points that calculate something every minute for each of those devices using their data. That's the setup.
Here's the problem. every now and then some Mango source stops poling some of these devices (not discriminating them by their internet connection type) even though they are available and responsive. If I turn off that source and turn it on again, it'll start working immediately. It also happens for Meta points, some of those points would just stop doing new calculations. If I turn the Meta source off and on, they'll start working orderly.
Best regards, Stefan Radunovic
Hi, all
I'm editing a DGlux dashboard (for mango enterprise) from a remote PC through a VPN, On several occasions my DGlux dashboard file got corrupted after saving and ended up completely empty, even without the 'main' object in the outline box. Does DGlux keep any backups of previous older dashboard saves?
Thx, Stefan.
Hi,
I was wondering if there's some tutorial or a video explaining how to make different types of users in Mango and Dglux. If I make a user in Mango, does it automatically appear in Dglux too? Also can I make a user type, or a template, with permissions set, so that anyone can just register a user and just pick a type with preset permissions?
Thx, Stefan
Well, I've downloaded 2.7.10 enterprise demo version since it has noSQL, and started all over again, so my database is empty now, and it still took 3 minutes per IP source while my VPN was off, haven't tried it with VPN on though.
By the way, can you please tell me what does ''demo'' mean in this case, what's the difference between the full install and this enterprise demo version and what does a nondemo version look like? We've bought a license for the Enterprise version, haven't updated the license yet, how will the license change the Enterprise demo version, will it be less demo, will I get full options when I update it? Can I put this license in the full version, and if I can do that, how will it change things there?
Thx, Stefan
Thx for your answer phil. I've tried to empty the database, and it took the same to start mango with this configuration. I've also tried the simple thing of turning off all of those Modbus IP sources and it cut down the starting time to an instant. Since I'm connected via VPN to all of those devices, and VPN is off when I restart my computer, it makes sense to me that Mango is trying to connect to all of those sources, with timeout of 3 minutes. Is Mango trying to connect to each Modbus IP source on startup?
Thx, Stefan.
Hi there,
I have 60 Modbus IP data sources, around 400 points each, one Virtual data source with 360 points and a Meta data source with some 300 points, and it takes some 3 minutes for each Modbus IP source to initialize, while only 0.4 seconds for a Virtual source, for example. Operating system is ubuntu 14. Does this look like a regular regular Modbus IP source initializing time for this situation?
Thx, Stefan.
This new query you gave me, phil, completed instantly, the old one still takes ages to complete. I've tried them both in the Mango's SQL console.
Well I don't think it's a too strange thing to do. I just wanna display latest alarms on a dashboard so a user could see it in DGLux instead of switching between mango alarms page and DGLux dashboard. After all, this was the solution phil or you gave me.
Do you have any other suggestions on how to display latest alarm messages in DGLux?
Thx, Stefan.
Hi Joel, Have I been too vague with my question? I've tried to solve this problem since, and haven't been able to. The only thing occurring to me as the reason for this was the size of the table and message field, but my message fields don't contain too many characters, and I think 2000 inputs in a table ain't too much data to order. Have you got any ideas?
Thx, Stefan.