Error exporting new datasource

[apl]

I created a new datasource and got the following stack trace trying to export all:

ERROR 2009-12-14 14:48:17,570 (com.serotonin.web.dwr.ExceptionDetectionFilter.doFilter:29) - DWR invocation exception 
com.serotonin.ShouldNeverHappenException: com.serotonin.json.JsonException: Error reading 'alarmLevel' from value com.serotonin.mango.vo.dataSource.openv4j.OpenVDataSourceVO@39d0c448
        at com.serotonin.mango.web.dwr.EmportDwr.createExportData(EmportDwr.java:80)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.directwebremoting.impl.ExecuteAjaxFilter.doFilter(ExecuteAjaxFilter.java:34)
        at org.directwebremoting.impl.DefaultRemoter$1.doFilter(DefaultRemoter.java:428)
        at com.serotonin.mango.web.dwr.util.LoggedInAjaxFilter.doFilter(LoggedInAjaxFilter.java:39)
        at org.directwebremoting.impl.DefaultRemoter$1.doFilter(DefaultRemoter.java:428)
        at com.serotonin.web.dwr.LocalizationFilter.doFilter(LocalizationFilter.java:54)
        at org.directwebremoting.impl.DefaultRemoter$1.doFilter(DefaultRemoter.java:428)
        at com.serotonin.web.dwr.ExceptionDetectionFilter.doFilter(ExceptionDetectionFilter.java:23)
        at org.directwebremoting.impl.DefaultRemoter$1.doFilter(DefaultRemoter.java:428)
        at org.directwebremoting.impl.DefaultRemoter.execute(DefaultRemoter.java:431)
        at org.directwebremoting.impl.DefaultRemoter.execute(DefaultRemoter.java:283)
        at org.directwebremoting.servlet.PlainCallHandler.handle(PlainCallHandler.java:52)
        at org.directwebremoting.servlet.UrlProcessor.handle(UrlProcessor.java:101)
        at org.directwebremoting.servlet.DwrServlet.doPost(DwrServlet.java:146)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.netbeans.modules.web.monitor.server.MonitorFilter.doFilter(MonitorFilter.java:390)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
        at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:849)
        at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
        at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
        at java.lang.Thread.run(Thread.java:619)
Caused by: com.serotonin.json.JsonException: Error reading 'alarmLevel' from value com.serotonin.mango.vo.dataSource.openv4j.OpenVDataSourceVO@39d0c448
        at com.serotonin.json.JsonWriter.writeObjectImpl(JsonWriter.java:120)
        at com.serotonin.json.JsonWriter.writePropertyValue(JsonWriter.java:201)
        at com.serotonin.json.JsonWriter.writeListSet(JsonWriter.java:215)
        at com.serotonin.json.JsonWriter.writePropertyValue(JsonWriter.java:170)
        at com.serotonin.json.JsonWriter.writePropertyValue(JsonWriter.java:192)
        at com.serotonin.json.JsonWriter.write(JsonWriter.java:73)
        at com.serotonin.json.JsonWriter.write(JsonWriter.java:64)
        at com.serotonin.mango.web.dwr.EmportDwr.createExportData(EmportDwr.java:77)
        ... 34 more
Caused by: java.lang.NullPointerException
        at com.serotonin.json.JsonWriter.writeObjectImpl(JsonWriter.java:117)
        ... 41 more
Listening for transport dt_socket at address: 11555
WARN  2009-12-14 14:48:17,584 (org.directwebremoting.util.CommonsLoggingOutput.warn:67) - Method execution failed:  
com.serotonin.ShouldNeverHappenException: com.serotonin.json.JsonException: Error reading 'alarmLevel' from value com.serotonin.mango.vo.dataSource.openv4j.OpenVDataSourceVO@39d0c448
        at com.serotonin.mango.web.dwr.EmportDwr.createExportData(EmportDwr.java:80)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.directwebremoting.impl.ExecuteAjaxFilter.doFilter(ExecuteAjaxFilter.java:34)
        at org.directwebremoting.impl.DefaultRemoter$1.doFilter(DefaultRemoter.java:428)
        at com.serotonin.mango.web.dwr.util.LoggedInAjaxFilter.doFilter(LoggedInAjaxFilter.java:39)
        at org.directwebremoting.impl.DefaultRemoter$1.doFilter(DefaultRemoter.java:428)
        at com.serotonin.web.dwr.LocalizationFilter.doFilter(LocalizationFilter.java:54)
        at org.directwebremoting.impl.DefaultRemoter$1.doFilter(DefaultRemoter.java:428)
        at com.serotonin.web.dwr.ExceptionDetectionFilter.doFilter(ExceptionDetectionFilter.java:23)
        at org.directwebremoting.impl.DefaultRemoter$1.doFilter(DefaultRemoter.java:428)
        at org.directwebremoting.impl.DefaultRemoter.execute(DefaultRemoter.java:431)
        at org.directwebremoting.impl.DefaultRemoter.execute(DefaultRemoter.java:283)
        at org.directwebremoting.servlet.PlainCallHandler.handle(PlainCallHandler.java:52)
        at org.directwebremoting.servlet.UrlProcessor.handle(UrlProcessor.java:101)
        at org.directwebremoting.servlet.DwrServlet.doPost(DwrServlet.java:146)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.netbeans.modules.web.monitor.server.MonitorFilter.doFilter(MonitorFilter.java:390)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
        at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:849)
        at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
        at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454)
        at java.lang.Thread.run(Thread.java:619)
Caused by: com.serotonin.json.JsonException: Error reading 'alarmLevel' from value com.serotonin.mango.vo.dataSource.openv4j.OpenVDataSourceVO@39d0c448
        at com.serotonin.json.JsonWriter.writeObjectImpl(JsonWriter.java:120)
        at com.serotonin.json.JsonWriter.writePropertyValue(JsonWriter.java:201)
        at com.serotonin.json.JsonWriter.writeListSet(JsonWriter.java:215)
        at com.serotonin.json.JsonWriter.writePropertyValue(JsonWriter.java:170)
        at com.serotonin.json.JsonWriter.writePropertyValue(JsonWriter.java:192)
        at com.serotonin.json.JsonWriter.write(JsonWriter.java:73)
        at com.serotonin.json.JsonWriter.write(JsonWriter.java:64)
        at com.serotonin.mango.web.dwr.EmportDwr.createExportData(EmportDwr.java:77)
        ... 34 more
Caused by: java.lang.NullPointerException
        at com.serotonin.json.JsonWriter.writeObjectImpl(JsonWriter.java:117)
        ... 41 more
WARN  2009-12-14 14:48:17,588 (org.directwebremoting.util.CommonsLoggingOutput.warn:59) - --Erroring: batchId[3] message[com.serotonin.ShouldNeverHappenException: com.serotonin.json.JsonException: Error reading 'alarmLevel' from value com.serotonin.mango.vo.dataSource.openv4j.OpenVDataSourceVO@39d0c448] 
14.12.2009 14:48:19 org.apache.coyote.http11.Http11Protocol pause

I have no such property alarmLevel.

Any idea what happend?

The sources com.serotonin.json are missing (GPL violation?)

Thanks in advance

Arne

[mlohbihler]

Perhaps posting your source would help.

[apl]

package com.serotonin.mango.vo.dataSource.openv4j;

import com.serotonin.json.JsonException;
import com.serotonin.json.JsonObject;
import com.serotonin.json.JsonReader;
import com.serotonin.json.JsonRemoteProperty;
import com.serotonin.mango.Common;
import com.serotonin.mango.rt.dataSource.DataSourceRT;
import com.serotonin.mango.rt.dataSource.openv4j.OpenVDataSourceRT;
import com.serotonin.mango.rt.event.type.AuditEventType;
import com.serotonin.mango.util.ExportCodes;
import com.serotonin.mango.vo.dataSource.DataSourceVO;
import com.serotonin.mango.vo.dataSource.PointLocatorVO;
import com.serotonin.mango.vo.event.EventTypeVO;
import com.serotonin.util.SerializationHelper;
import com.serotonin.util.StringUtils;
import com.serotonin.web.dwr.DwrResponseI18n;
import com.serotonin.web.i18n.LocalizableMessage;
import java.io.IOException;
import java.io.ObjectInputStream;
import java.io.ObjectOutputStream;
import java.util.List;
import java.util.Map;
import net.sf.openv4j.Devices;
import net.sf.openv4j.Protocols;
import org.apache.commons.logging.Log;
import org.apache.commons.logging.LogFactory;

public class OpenVDataSourceVO extends DataSourceVO<OpenVDataSourceVO> {
    private final static Log LOG = LogFactory.getLog(OpenVDataSourceVO.class);

    private static final ExportCodes EVENT_CODES = new ExportCodes();

    static {
        EVENT_CODES.addElement(OpenVDataSourceRT.DATA_SOURCE_EXCEPTION_EVENT, "DATA_SOURCE_EXCEPTION");
        EVENT_CODES.addElement(OpenVDataSourceRT.POINT_READ_EXCEPTION_EVENT, "POINT_READ_EXCEPTION");
        EVENT_CODES.addElement(OpenVDataSourceRT.POINT_WRITE_EXCEPTION_EVENT, "POINT_WRITE_EXCEPTION");
    }
    @JsonRemoteProperty
    private String commPortId;
    private int updatePeriodType = Common.TimePeriods.MINUTES;
    @JsonRemoteProperty
    private int updatePeriods = 1;
    @JsonRemoteProperty
    private Devices device;
    @JsonRemoteProperty
    private Protocols protocol;

    @Override
    public Type getType() {
        return Type.OPEN_V_4_J;
    }

    @Override
    protected void addEventTypes(List<EventTypeVO> eventTypes) {
        eventTypes.add(createEventType(OpenVDataSourceRT.DATA_SOURCE_EXCEPTION_EVENT, new LocalizableMessage("event.ds.dataSource")));
        eventTypes.add(createEventType(OpenVDataSourceRT.POINT_READ_EXCEPTION_EVENT, new LocalizableMessage("event.ds.pointRead")));
        eventTypes.add(createEventType(OpenVDataSourceRT.POINT_WRITE_EXCEPTION_EVENT, new LocalizableMessage("event.ds.pointWrite")));
    }

    @Override
    public LocalizableMessage getConnectionDescription() {
        return new LocalizableMessage("common.default", commPortId);
    }

    @Override
    public PointLocatorVO createPointLocator() {
        return new OpenVPointLocatorVO();
    }

    @Override
    public DataSourceRT createDataSourceRT() {
        return new OpenVDataSourceRT(this);
    }

    @Override
    public ExportCodes getEventCodes() {
        return EVENT_CODES;
    }

    @Override
    protected void addPropertiesImpl(List<LocalizableMessage> list) {
        AuditEventType.addPropertyMessage(list, "dsEdit.openv4j.port", commPortId);
        AuditEventType.addPeriodMessage(list, "dsEdit.updatePeriod", updatePeriodType, updatePeriods);
    }

    @Override
    protected void addPropertyChangesImpl(List<LocalizableMessage> list, OpenVDataSourceVO from) {
        AuditEventType.maybeAddPropertyChangeMessage(list, "dsEdit.openv4j.port", from.commPortId, commPortId);
        AuditEventType.maybeAddPeriodChangeMessage(list, "dsEdit.updatePeriod", from.updatePeriodType,
                from.updatePeriods, updatePeriodType, updatePeriods);
    }

    public String getCommPortId() {
        return commPortId;
    }

    public void setCommPortId(String commPortId) {
        this.commPortId = commPortId;
    }

    public int getUpdatePeriodType() {
        return updatePeriodType;
    }

    public void setUpdatePeriodType(int updatePeriodType) {
        this.updatePeriodType = updatePeriodType;
    }

    public int getUpdatePeriods() {
        return updatePeriods;
    }

    public void setUpdatePeriods(int updatePeriods) {
        this.updatePeriods = updatePeriods;
    }

    @Override
    public void validate(DwrResponseI18n response) {
        super.validate(response);

        if (StringUtils.isEmpty(commPortId)) {
            response.addContextualMessage("commPortId", "validate.required");
        }
        if (!Common.TIME_PERIOD_CODES.isValidId(updatePeriodType)) {
            response.addContextualMessage("updatePeriodType", "validate.invalidValue");
        }
        if (updatePeriods <= 0) {
            response.addContextualMessage("updatePeriods", "validate.greaterThanZero");
        }
    }




    //
    ///
    /// Serialization
    ///
    //
    private static final long serialVersionUID = -1;
    private static final int version = 2;

    // Serialization for saveDataSource
    private void writeObject(ObjectOutputStream out) throws IOException {
        out.writeInt(version);
        out.writeInt(updatePeriodType);
        out.writeInt(updatePeriods);
                SerializationHelper.writeSafeUTF(out, commPortId);
                SerializationHelper.writeSafeUTF(out, device.name());
                SerializationHelper.writeSafeUTF(out, protocol.name());
    }

    private void readObject(ObjectInputStream in) throws IOException, ClassNotFoundException {
        int ver = in.readInt();

        // Switch on the version of the class so that version changes can be elegantly handled.
        switch (ver) {
            case 2:
                updatePeriodType = in.readInt();
                updatePeriods = in.readInt();
                                        commPortId = SerializationHelper.readSafeUTF(in);
                        device = Devices.valueOf(SerializationHelper.readSafeUTF(in));
                        protocol = Protocols.valueOf(SerializationHelper.readSafeUTF(in));

                break;
        }
    }

    @Override
    public void jsonDeserialize(JsonReader reader, JsonObject json) throws JsonException {
        LOG.info("WRITE TO JSON");
        super.jsonDeserialize(reader, json);
        LOG.info("SUPER TO JSON");
        Integer value = deserializeUpdatePeriodType(json);
        if (value != null)
            updatePeriodType = value;
        LOG.info("JSON OK");
    }

    @Override
    public void jsonSerialize(Map<String, Object> map) {
        super.jsonSerialize(map);
         serializeUpdatePeriodType(map, updatePeriodType);
   }

    /**
     * @return the device
     */
    public Devices getDevice() {
        return device;
    }

    /**
     * @param device the device to set
     */
    public void setDevice(Devices device) {
        this.device = device;
    }

    /**
     * @return the device
     */
    public Devices[] getDevices() {
        return Devices.values();
    }

    /**
     * @return the protocol
     */
    public Protocols getProtocol() {
        return protocol;
    }

    /**
     * @param protocol the protocol to set
     */
    public void setProtocol(Protocols protocol) {
        this.protocol = protocol;
    }

     /**
     * @return the protocols
     */
    public Protocols[] getProtocols() {
        return Protocols.values();
    }

}

[mlohbihler]

Annotate your class with "@JsonRemoteEntity". The JSON serializer is picking up the s/getAlarmLevel from the super class.

[apl]

Thanks,

it works. (I will have to look better doing past and copy next time:-))

Arne

[mlohbihler]

Are your data sources completed/tested? You did mbus and openv?

[apl]

No consider both as highly experimental...

Currently I work on openv read maybe write access.

If this is done I have to update the m-bus sources at mbus4j.sf.net to the latest specification (IEC).

Once this is done I plan to support primary adressing with no change of the data frame.
Later support for

• secondary addressing.
• rewrite JSP to make it more compact
• ability of changing frames.
• atmodem support (atmodem4j.sf.net).

My problem is currently that I have no direct access to m-bus hardware so this is mostly tested against dummys or mbus data from different readouts.

If anyone has access to hardware it will speedup development.

Arne

[mlohbihler]

If anyone has access to hardware it will speedup development.

Isn't that always the problem! I might as well make a shout out now for OPC XML-DA hardware. If anyone has any that they can make internet accessible for the purposes of data source testing, please let me know. I know there are some sample servers on the internet, but those i've found so far contain a single unchanging point. Not very useful...

[apl]

Maybe try using WinCC from SIEMENS that has XML-OPC capabilities - I never tested it...

I think you can grap a demo version vom your local dealer.

Or could you send me the code for initial testing?

Arne

[mlohbihler]

I haven't written any code yet. There was no point in starting without decent equipment to work against. You have some OPC XML-DA stuff? Any chance i could hit it up for a bit? Could you open just to a particular IP address?

[apl]

What about OPC UA (xml and binary protocol) I dont know the licence restrictions for any?

And for software see www.opcfoundation.org, there seem many servers and clients for demo available???

Arne

[mlohbihler]

And for software see www.opcfoundation.org, there seem many servers and clients for demo available???

That would be what i was referring to:

I know there are some sample servers on the internet, but those i've found so far contain a single unchanging point. Not very useful...

[apl]

What exact is your plan OPS server, client or both.

I looked at the Java6 implementation of the Web service or axis2 or....

if mango should act as a server we need a client first - I can test it against WinCC.
after that the server should be easily implemented.

Arne

[mlohbihler]

Mango is primarily intended to act as a server.

[apl]

So maybe implement at first the client into mango ;-) (one can use the get function to retrieve data from other (OPC-servers - which in turn could be simple devices...)
to have a testet client - and then do the server stuff.

what do you plan to use JAX-WS or Axis2?

Arne

[mlohbihler]

I use axis because i know it better, and it has ANT support (which i couldn't find in less than 5 minutes for JAX). But if someone else is doing the work it doesn't matter to me.