Virtual Serial Client

[MattFox]

I've got another idea, maybe a last ditch effort, but it would enable us to see everything...
Are you familiar with socat? Let's use that to test the RAW data coming in for you...

once installed fire it up:

socat /dev/null,ignoreeof TCP:localhost:9000,fork

This will spit everything into a black hole, but it may give us the info we need to parse everything...

[jcaballeroa]

The problem is that the integration I have to do it in a Windows environment, and as I think the socat tool does not exist in Windows.

Anyway tomorrow I will try in one of the Linux environments I have (now it is too late here), with the recommendation that you are making me, it will not be that the problem is because of Windows, and we are going crazy.

[MattFox]

Yes, I'm trying to go with being as generic and simple as possible, once we know what the RAW data is, we can definitely hit this sucker on the head.

Chat tomorrow!

Fox

[jcaballeroa]

Hi @mattfox ,

Sorry, finally yesterday I couldn' t do tests. I've taken it again today.

I just mounted my mango environment on my Centos7, to verify first that there was no problem with Windows when doing these tests. And after replicating the Virtual Serial Port, Data Source and Data Point configuration, the result remains the same.

As you recommended, I used the socat application to record the raw data that arrives from the peripheral. I have made a couple of changes regarding the instruction you sent me, the IP of the peripheral (192.168.1.155), and to display the information on the screen (/dev/stdin)

Below is a screenshot of the result. As you can see, socat does record the information that arrives from the peripheral, but the mango logs still do not.

[MattFox]

Agreed, something is definitely amiss here.
Have you tried sending all of this with the wildcard regex and the hex box unchecked?
I'm out of thoughts. With the knowledge I have I've tested all that comes to my mind.
@terrypacker You're up!
I'm gonna see what you find because I'm at a loss here...

[terrypacker]

@jcaballeroa go ahead and post the JSON export for this data source and its point(s). Also include the virtual serial port export JSON. I will setup a local test and see if I can replicate your problem.

Also:

1. What version of Mango are you using?
2. What is the version of the data source module?

[jcaballeroa]

@MattFox

Have you tried sending all of this with the wildcard regex and the hex box unchecked?

Yes, but the result is the same. No Data in log and no data in Data Point.

@terrypacker

What version of Mango are you using?
What is the version of the data source module?

I have tried in 2 versions of Mango: 3.5.6 and 3.7.4. Now I am using version 3.7.4

The version of Data Source Module: 3.7.0

Then the JSON with the requested information:

{
"virtualSerialPorts":[
{
"xid":"VSP_Client",
"address":"localhost",
"port":9000,
"portName":"1",
"type":"SERIAL_SOCKET_BRIDGE",
"timeout":0
}
],
"dataPoints":[
{
"purgePeriod":1,
"setExtremeLowLimit":-179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368,
"intervalLoggingType":"INSTANT",
"dataSourceXid":"DS_e4aa6461-15c2-4f52-8fc8-5deac4ecc66c",
"discardHighLimit":179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368,
"deviceName":"hdfhdh",
"enabled":true,
"rollup":"NONE",
"purgeOverride":false,
"chartRenderer":{
"limit":10,
"type":"TABLE"
},
"xid":"DP_97638d3f-6fb2-42dd-bad5-367219b78e98",
"eventDetectors":[
],
"textRenderer":{
"useUnitAsSuffix":false,
"type":"PLAIN",
"suffix":""
},
"loggingType":"ON_CHANGE",
"overrideIntervalLoggingSamples":false,
"defaultCacheSize":1,
"readPermission":"",
"setPermission":"",
"intervalLoggingPeriodType":"MINUTES",
"intervalLoggingSampleWindowSize":0,
"tolerance":0,
"purgeType":"YEARS",
"plotType":"STEP",
"intervalLoggingPeriod":1,
"discardExtremeValues":false,
"tags":{
},
"unit":"",
"pointLocator":{
"valueIndex":0,
"dataType":"ALPHANUMERIC",
"valueRegex":"(.*)",
"pointIdentifier":""
},
"discardLowLimit":-179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368,
"setExtremeHighLimit":179769313486231570814527423731704356798070567525844996598917476803157260780028538760589558632766878171540458953514382464234321326889464182768467546703537516986049910576551282076245490090389328944075868508455133942304583236903222948165808559332123348274797826204144723168738177180919299881250404026184124858368,
"name":"pyupyp",
"chartColour":"",
"preventSetExtremeValues":false,
"simplifyType":"NONE"
}
],
"dataSources":[
{
"purgePeriod":1,
"stopBits":"STOP_BITS_1",
"parity":"NONE",
"dataBits":"DATA_BITS_8",
"type":"SERIAL",
"flowControlIn":"NONE",
"enabled":true,
"logIO":true,
"purgeOverride":false,
"xid":"DS_e4aa6461-15c2-4f52-8fc8-5deac4ecc66c",
"messageRegex":"",
"hex":false,
"maxMessageSize":1024,
"editPermission":"",
"purgeType":"YEARS",
"commPortId":"1",
"maxHistoricalIOLogs":1,
"baudRate":9600,
"retries":1,
"pointIdentifierIndex":0,
"ioLogFileSizeMBytes":1,
"messageTerminator":"",
"alarmLevels":{
"POINT_READ_PATTERN_MISMATCH_EVENT":"URGENT",
"POINT_WRITE_EXCEPTION":"URGENT",
"DATA_SOURCE_EXCEPTION":"URGENT",
"POINT_READ_EXCEPTION":"URGENT"
},
"flowControlOut":"NONE",
"useTerminator":false,
"name":"hdfhdh"
}
]
}

[terrypacker]

Ok I think I've got it figured out. You are trying to do something that isn't supported by that combination of data source and virtual serial port type.

The Serial Data Source is event driven and will only work with the Serial Server type of virtual port as that is the only one that generates events. The Serial Client must be controlled by a polling data source to read and write out of the socket each poll. We probably could/should implement an event driven approach for this other type of port but I'll leave that for now.

Stepping back from the problem it seems the reason the queryable setting on the TcpIp data source works is because after it sends a command it reads the response out of the socket. Probably not ideal as it will be sending something out of the port each poll.

Is there no way to use a Virtual Server type serial port and have the device initiate the connection to a port on the Mango machine?

[jcaballeroa]

@terrypacker

Thank you very much for your answer.

The problem is that there is no way to make the peripheral establish the socket towards Mango. For me it is a black box, which I cannot touch, it is a commercial device that I have acquired. And his way of working is that, he expects the remote device (in this case Mango) to establish a client socket by opening the connection and only then begins to send information through this socket (without the need for any command to be sent for it) . We can discuss whether this method is good or bad, but it is the way it works, and it is not possible to change it unfortunately.

[MattFox]

Use socat then.
Make it act like a relay!
One socat service linking your server to a mango serial server!
If you can't use linux it can be done with a node js app or a c# app.

[jcaballeroa]

Yes, it is a very good idea. I had already thought of something similar, in my case I had thought to use Phyton. So that my python app would open a socket against the peripheral and listen to everything it receives, and then send it to Mango through a Virtual Serial Port configured as Server Port.

Thanks!!

[MattFox]

Anytime, that's what we're (the forum) here for.