I already solved it with node-red....

I agree that the data is easier to work with outside the PLC....but the network load is finite. I have lots of other ideas I want to apply....and if I have to read everything cyclic....I'm going to hit a ceiling quickly... I have a real world scenario where a customer was using ignition....they wanted "all of the data", and I gave them the tag list it was very very long......and it worked "ok" for asset 1....4 $15k usd PLCs that have gigabit ports and cisco switches on a new network infrastructure. However when they added asset 2, 4 more top dog PLCs, intermittent issues started happening....network ports and communication drop outs....PLC ports going dark or choking....even issues in the other area were occuring where programmers were having trouble with unrelated assets. The solution? Edge driven technology. They moved to having the PLC push data to a database on an event....instead of cyclic reading. This completely solved the issue, and they were running 4 assets in the end with no more trouble. This obviously only works with modern controllers though.... We can "emulate" this a bit by using a "flag" in the plc that triggers the data transaction....

i think for something like this you need to do custom programming. this custom programming then has the advantage: 1. smart, saves bandwith, etc. disadvantage: 1. maintainability. Usually in factories this is done by one person, and the other persons never touch it (in fear of breaking something). Also using something like Node-RED you need to consider that this needs to be kept up-to-date, and with Node-RED being based on NodeJS which releases two major versions per year, it is a significant effort to keep it updated our approach here is to always prefer maintainability over bandwith. better to spend some money on better infrastructure, than to costs of being never able to update your systems (e.g., security) or everyttime you want to do something you need to hire an SI. there are a lot of cases where PLCs cannot handle that load, in those cases a compromise needs to be done. the case you are talking about sounds interesting. gigabit can have over 100MB/sec. so something must have been really unoptimized here in order to reach that. I assume the PLCs simply cannot handle a lot of data pointsper second.

if anyone else has suggestions what the best way here is to find a good middleground, feel free to suggest

oh. this is exciting. So you basically want a benthos stream with multiple inputs. one input that reads cyclic for a trigger and another input that reads the data block. Whenever the triggers is true it should read input 2 and send to the DB, otherwise it should drop the message? this should be doable in benthos. It is also similar to the alarm plugin i did for benthos which reads an input and listen to a specific part of the message as a trigger. the input 2 is an interval trigger that sends a message every second. When the alarm condition are meet it sends an alarm and the interval trigger is used to have a timer that resends the message after a specific time.. it should not be so complicated to rewrite the plugin to suit your needs. For the choking of the network, it feels like there is some bad configuration. Are you trying to push realtime data and not just data?

I was able to solve it with node-red. I got a response from a guy at kepware who says he does this type of triggered reading and store to db all the time, it’s a feature that the product offers i guess. Litmus told me they can solve it with a flow triggering a read once to a tag defining a block read. Tatsoft said they can do it, but with 14,700 tags….each triggered individually. Everything above required some level of customization to achieve it, but appears manageable.

The choking of the network was an extreme example from my past, not this application. Yes, what you mentioned about using 2 bethos inputs, then a value triggers a data store. However I was avoiding reading the 14,700 word block cyclical. The data block is populated over 10s at a resolution of the PLC task time, of 0.9ms. It’s not real time, it populates then is at rest until the next test.

would using dual benthos streams and a a complex bloblang processor work or would it be better to have a custom processor that handles this? Can you program a processor your self? my alarm processor can be found at my github to use as a base.

This will not be the first time this will come up if you wanna wait for more requests before you develop it then fine but I suggest that you consider creating a processor that can help make this easier considering configuring the processor isn’t always the easiest for the user. I won’t be trying to create my own complex processor or creating my own processor. That’s just not where my focus lies.

i have personally not any use for this my self atm and i do not have the time to develop processors for others right now. I first need to finish some other projects i have.. I will have it in mind if i get some spare time. I am not a developer at UMH i am just a dedicated user.

i think implementation is not that straightforward, because it is quite dependent on the protocol itself (polling vs subscribe, stateless vs stateful protocols, etc.). what we at UMH want to do here, is not do it like everyone else, but instead figure out a way how one can do it while still having an overview over it all. this means it must be some additional to the bridges, namely the plugins. probably some similar syntax across all plugins, or maybe a processor plugin that triggers the existing input plugins once.

i was looking at dynamic inputs. if that could be an option.. have a trigger thats enable the input to pull data once and then disable it. https://docs.redpanda.com/redpanda-connect/configuration/dynamic_inputs_and_outputs/

Dynamic inputs would be my guess, but what you don't want benthos to do is maintain two connections to the same client. Not sure how the underlying tech handles this, but for benthos-umh plugins, maybe a batch tag group features would be appropriate. Or be able to define a group of tags in inputs, for say a specific processor to use.

I was looking before on something similar with batching. On some machine i poll data at a constant rate using OPC-UA and when a specific value is true, i save all tags to the DB. I solve this today using grouping of the data to one json output and node-red to handle the logic. I was looking in to using subscription of the tags an use a buffer in benthos to hold the latest values until the correct tag triggers the writing to db and then writes all the tags using the same timestamp.. This would basically work in the same way as @trentc is requesting. hmm.. maybe i need to write a custom processor for this, since the caching in benthos can be quite complex to setup.

Hey gang

Hello

https://github.com/crbnos/carbon found this here, maybe it is of any interest?

Yes, saw that! Looks cool! I think the Supabase pick is daring, but looks like a nice tech stack choice

Oh that does look cool.

Interesting. Do folks see UMH occupying the lower stack from PLC through to MES, and this being the QMS/MES/ERP layers?

We See UMH definitely on the lower side to fetch data from the shop floor and provide them in an organised way to higher end systems. Due to the broad definition of MES/Scada there is overlap of UMh with almost every other enterprise software our there (e.g., OEE, analytics, etc ) but definitely not on the ERP side of things.

Hey guys! I see you have a webinar coming up tomorrow. If it's of any support, I will promote it today a bit on LinkedIn with my own home demo setup. https://github.com/SheetMetalConnect/IoT-UMH-Homelab/ This is what built using UMH-Core with InfluxDB. I'm now also rendering a short video. Cheers 🙂

It also has some getting started guides, including all my flows and dashboard.

Here we go: https://www.linkedin.com/posts/lvanenkhuizen_iot-industrialiot-unifiednamespace-activity-7358950812313645057-iemr my first time trying this setup. Let me know what you think too 🙂

Good stuff!

Well done! Very clearly explained!

Hi, we just released a new article on learn.umh.app. Go check it out, and discuss it here! Title: Webinar: Getting started with UMH Core Excerpt: In this webinar we showcase UMH Core - a streamlined version of the UMH platform, packaged into a single Docker container with no need for Kubernetes. Link: https://learn.umh.app/course/webinar-getting-started-with-umh-core/

Hi, we just released a new article on learn.umh.app. Go check it out, and discuss it here! Title: AI and Computer Vision in Manufacturing - Beyond the Hype Cycle | EP11 - The Connected Factory Podcast Excerpt: Alex talks with Heiko, co-founder of Anticipate, about how AI and computer vision improve quality inspection. They cover the shift from rule-based to deep learning, challenges of legacy integration, and why starting small with pilots builds momentum for scalable shop-floor impact. Link: https://learn.umh.app/course/ai-and-computer-vision-in-manufacturing-beyond-the-hype-cycle-ep11-the-connected-factory-podcast/

What is currently your go-to solution for a (very) simple MES interface? I want to create a simple UI where operators can see their workload, maybe drill down to a schedule, and ideally start/stop their job. Nothing fancy. On top of UMH. What would you recommend?