• Recent
    • Tags
    • Popular
    • Register
    • Login

    Please Note This forum exists for community support for the Mango product family and the Radix IoT Platform. Although Radix IoT employees participate in this forum from time to time, there is no guarantee of a response to anything posted here, nor can Radix IoT, LLC guarantee the accuracy of any information expressed or conveyed. Specific project questions from customers with active support contracts are asked to send requests to support@radixiot.com.

    Radix IoT Website Mango 3 Documentation Website Mango 4 Documentation Website Mango 5 Documentation Website

    Mango ES web server goes out!

    MangoES Hardware
    mangoes
    2
    7
    2.9k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • L
      logicaltools
      last edited by

      Hi,

      we started to use a Mango ES in our company to collect few data point but without a logic reason and randomly the web server of Mango Es goes out. We can touch the Mango Es via SSH and we noted that the java service is down. We detected in ma.log several strange "fatal error" but we can't determine the cause.

      ERROR 2016-10-02 16:37:27,235 (org.apache.taglibs.log.LoggerTag.doStartTag:97) - java.lang.IncompatibleClassChangeError
      at org.directwebremoting.convert.MapConverter.convertOutbound(MapConverter.java:182)
      at com.serotonin.m2m2.web.dwr.util.BlabberConverterManager.convertOutbound(BlabberConverterManager.java:192)
      at org.directwebremoting.extend.ScriptBufferUtil.createOutput(ScriptBufferUtil.java:56)
      at org.directwebremoting.dwrp.BaseCallMarshaller$CallScriptConduit.addScript(BaseCallMarshaller.java:512)
      at org.directwebremoting.extend.EnginePrivate.remoteHandleCallback(EnginePrivate.java:56)
      at org.directwebremoting.dwrp.BaseCallMarshaller.marshallOutbound(BaseCallMarshaller.java:330)
      at org.directwebremoting.servlet.PlainCallHandler.handle(PlainCallHandler.java:53)
      at org.directwebremoting.servlet.UrlProcessor.handle(UrlProcessor.java:101)
      at org.directwebremoting.servlet.DwrServlet.doPost(DwrServlet.java:146)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
      at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:808)
      at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669)
      at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
      at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)
      at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
      at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
      at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
      at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
      at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
      at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
      at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
      at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
      at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
      at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
      at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
      at org.eclipse.jetty.server.Server.handle(Server.java:499)
      at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
      at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
      at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
      at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
      at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
      at java.lang.Thread.run(Thread.java:745)

      ERROR 2016-10-02 20:38:57,075 (com.serotonin.m2m2.rt.maint.BackgroundProcessing$1.run:57) - Error in work item
      java.lang.InternalError: a fault occurred in a recent unsafe memory access operation in compiled Java code
      at java.lang.Integer.toString(Integer.java:401)
      at com.infiniteautomation.nosql.MangoNoSqlPointValueDao.savePointValueSync(MangoNoSqlPointValueDao.java:65)
      at com.infiniteautomation.nosql.MangoNoSqlBatchWriteBehind.execute(MangoNoSqlBatchWriteBehind.java:96)
      at com.serotonin.m2m2.rt.maint.BackgroundProcessing$1.run(BackgroundProcessing.java:54)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      at java.lang.Thread.run(Thread.java:745)
      FATAL 2016-10-02 20:38:57,155 (com.serotonin.timer.TimerThread.run:41) - TimerThread failed
      java.lang.InternalError: a fault occurred in a recent unsafe memory access operation in compiled Java code
      at java.util.concurrent.SynchronousQueue.offer(SynchronousQueue.java:913)
      at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1361)
      at com.serotonin.timer.OrderedThreadPoolExecutor.execute(OrderedThreadPoolExecutor.java:179)
      at com.serotonin.timer.OrderedTimerThread.executeTask(OrderedTimerThread.java:28)
      at com.serotonin.timer.TimerThread.mainLoop(TimerThread.java:127)
      at com.serotonin.timer.TimerThread.run(TimerThread.java:38)

      ERROR 2016-10-03 14:26:44,950 (com.serotonin.m2m2.web.dwr.util.ExceptionDetectionFilter.doFilter:38) - DWR invocation exception

      java.lang.IllegalStateException: Timer already cancelled.
      at com.serotonin.timer.RealTimeTimer.scheduleImpl(RealTimeTimer.java:129)
      at com.serotonin.timer.AbstractTimer.schedule(AbstractTimer.java:35)
      at com.serotonin.m2m2.util.timeout.TimeoutTask.<init>(TimeoutTask.java:63)
      at com.serotonin.m2m2.rt.dataSource.PollingDataSource.beginPolling(PollingDataSource.java:289)
      at com.serotonin.m2m2.rt.RuntimeManager.startDataSourcePolling(RuntimeManager.java:359)
      at com.serotonin.m2m2.rt.RuntimeManager.saveDataSource(RuntimeManager.java:273)
      at com.serotonin.m2m2.rt.dataSource.DataSourceRTM.save(DataSourceRTM.java:54)
      at com.serotonin.m2m2.rt.dataSource.DataSourceRTM.save(DataSourceRTM.java:23)
      at com.serotonin.m2m2.web.dwr.AbstractRTDwr.toggle(AbstractRTDwr.java:53)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:483)
      at org.directwebremoting.impl.ExecuteAjaxFilter.doFilter(ExecuteAjaxFilter.java:34)
      at org.directwebremoting.impl.DefaultRemoter$1.doFilter(DefaultRemoter.java:428)
      at com.serotonin.m2m2.web.dwr.util.TranslationsFilter.doFilter(TranslationsFilter.java:37)
      at org.directwebremoting.impl.DefaultRemoter$1.doFilter(DefaultRemoter.java:428)

      0_1475572350474_ma.log
      Can somebody help us? We attach the last ma.log file with hopeful that it will be useful. Thanks in advance.

      1 Reply Last reply Reply Quote 0
      • phildunlapP
        phildunlap
        last edited by phildunlap

        Hi logicaltools,

        Those are very unusual errors! I would advise reinstalling Mango, as perhaps a JAR is corrupt or modified. Have you overridden any classes? Do you have remaining disk space? Are there any hs_err files in /opt/mango/ ?

        I would follow the manual upgrade instructions to do the reinstall: http://help.infiniteautomation.com/support/solutions/articles/14000022648-how-to-upgrade-mango

        1 Reply Last reply Reply Quote 0
        • phildunlapP
          phildunlap
          last edited by phildunlap

          I also see in your log that the HW clock on your device doesn't seem to be correct. While you're ssh'ed into it and you notice the time is right (run "date"), you can run "sudo hwclock -w"

          1 Reply Last reply Reply Quote 0
          • L
            logicaltools
            last edited by

            Thanks Phildunlap for your prompt answer. Yes we have many files hs_err ( I attached the .zip containing all this files). I have also copied the system time to hardware time following your suggestion.. I would like to have your opinion about the error files ...
            [0_1475608893007_hs-err.zip](Uploading 100%)

            1 Reply Last reply Reply Quote 0
            • L
              logicaltools
              last edited by

              0_1475608967530_hs-err.zip

              1 Reply Last reply Reply Quote 0
              • phildunlapP
                phildunlap
                last edited by

                It's difficult to say for sure what the cause is, but I would want to know the following things:

                1. How many data points do you have? Run 'select count(id) from dataPoints;' either in Mango's SQL console page, or by starting the H2 web server.
                2. What is the property db.nosql.shardStreamType set to in your /opt/mango/overrides/properties/env.properties

                Regardless of the answers though, I would try the following to resolve:

                1. Update Java. It looks like you have 1.8.0_33 installed, and the latest stable is 1.8.0_101. These instructions may be helpful: http://tecadmin.net/install-java-8-on-debian/
                2. Reinstall Mango per the manual upgrade instructions I mentioned in my previous post.
                1 Reply Last reply Reply Quote 0
                • L
                  logicaltools
                  last edited by

                  We have 70 points in the list but only 18 are active. This is the env.properties 0_1475654024425_env.properties
                  Following your suggestion I have updated Java without any problem and after rebooting MangoES I wait ...
                  The next step it will be reinstall Mango. I keep you informed. Thanks.

                  1 Reply Last reply Reply Quote 0
                  • First post
                    Last post