Dynamic Configuration Reload for app-service-configurable in EdgeX

[janhung1]

Hi EdgeX Team,

I am using app-service-configurable (version 3.1.1) and trying to dynamically update its configuration by modifying key/value pairs in Consul at:http://127.0.0.1:8500/ui/dc1/kv/edgex/v3/app-rules-engine/Writable/Pipeline/Functions

It seems that app-service-configurable detects the updates (logs show configuration updates), but the changes do not take effect immediately. To make the new configuration work, I need to restart the app-service-configurable container.

Is there a way to automatically reload and apply the updated configuration without restarting the container?

Thank you for your help.

level=INFO ts=2025-02-24T07:04:11.8443102Z app=app-rules-engine source=config.go:969 msg="Writable configuration has been updated from the Configuration Provider"
level=INFO ts=2025-02-24T07:04:11.8444092Z app=app-rules-engine source=configupdates.go:60 msg="Processing App Service configuration updates"
level=DEBUG ts=2025-02-24T07:04:11.8444354Z app=app-rules-engine source=service.go:325 msg="'pipeline' Function Pipeline Execution Order: [FilterByDeviceName1,MQTTExport]"
level=DEBUG ts=2025-02-24T07:04:11.8445646Z app=app-rules-engine source=service.go:401 msg="FilterByDeviceName1 function added to 'pipeline' configurable pipeline with parameters: [filterout='false', devicenames='Random-Integer-Device']"
level=DEBUG ts=2025-02-24T07:04:11.8446896Z app=app-rules-engine source=service.go:401 msg="MQTTExport function added to 'pipeline' configurable pipeline with parameters: [persistonerror='false', willretained='false', autoreconnect='true', connecttimeout='', willenabled='false', willpayload='', retain='false', willqos='0', willtopic='', qos='0', topic='test/topic/edgex', authmode='none', clientid='MQTT-Export', secretname='mqtt', skipverify='false', brokeraddress='tcp://test.mosquitto.org:1883', keepalive='']"
level=INFO ts=2025-02-24T07:04:11.8447441Z app=app-rules-engine source=runtime.go:122 msg="Transforms set for pipeline pipeline"
level=INFO ts=2025-02-24T07:04:11.8447646Z app=app-rules-engine source=runtime.go:136 msg="Topics '[events/device/+/+/Random-Integer-Device/Int16]' set for pipeline pipeline"
level=INFO ts=2025-02-24T07:04:11.8447758Z app=app-rules-engine source=configupdates.go:148 msg="Configurable Pipeline successfully reloaded from new configuration"

[cloudxxx8]

It depends on what configuration you changed. Only the configuration uncer the Writable section supports dynamically config update.

[janhung1]

I already under the Writable section, but it not work after I change the value. It need to restart the app-service-configurable containter that can apply new configuration. Is there a way to automatically reload and apply the updated configuration without restarting the container?

level=INFO ts=2025-03-04T09:00:32.5231605Z app=app-rules-engine source=configupdates.go:60 msg="Processing App Service configuration updates"
level=DEBUG ts=2025-03-04T09:00:32.5232395Z app=app-rules-engine source=service.go:325 msg="'gr1000-pipeline' Function Pipeline Execution Order: [FilterByDeviceName1,MQTTExport-aaaaa, MQTTExport-bbbbb]"
level=DEBUG ts=2025-03-04T09:00:32.523504Z app=app-rules-engine source=service.go:401 msg="FilterByDeviceName1 function added to 'gr1000-pipeline' configurable pipeline with parameters: [devicenames='Random-Integer-Device', filterout='false']"
level=DEBUG ts=2025-03-04T09:00:32.5236339Z app=app-rules-engine source=service.go:401 msg="MQTTExport-aaaaa function added to 'gr1000-pipeline' configurable pipeline with parameters: [willtopic='', clientid='MQTT-Export1', skipverify='false', autoreconnect='true', connecttimeout='', topic='test/topic/edgex/12', willretained='false', keepalive='', secretname='mqtt', willenabled='false', qos='0', persistonerror='false', willqos='0', retain='false', willpayload='', authmode='none', brokeraddress='tcp://test.mosquitto.org:1883']"
level=DEBUG ts=2025-03-04T09:00:32.5237429Z app=app-rules-engine source=service.go:401 msg="MQTTExport-bbbbb function added to 'gr1000-pipeline' configurable pipeline with parameters: [persistonerror='false', secretname='mqtt', autoreconnect='true', willtopic='', brokeraddress='tcp://test.mosquitto.org:1883', qos='0', topic='test/topic/edgex/2', clientid='MQTT-Export2', willenabled='false', willretained='false', authmode='none', connecttimeout='', willqos='0', keepalive='', retain='false', skipverify='false', willpayload='']"
level=INFO ts=2025-03-04T09:00:32.5238135Z app=app-rules-engine source=runtime.go:122 msg="Transforms set for `gr1000-pipeline` pipeline"
level=INFO ts=2025-03-04T09:00:32.5238409Z app=app-rules-engine source=runtime.go:136 msg="Topics '[events/device/+/+/Random-Integer-Device/Int16]' set for `gr1000-pipeline` pipeline"
level=INFO ts=2025-03-04T09:00:32.5238542Z app=app-rules-engine source=configupdates.go:148 msg="Configurable Pipeline successfully reloaded from new configuration"

[janhung1]

@cloudxxx8 Is there anything else that needs to be set?

[cloudxxx8]

@janhung1 What you did is correct, and it also triggered the config update.
Since the changed config didn't apply to the runtime function, it's a bug.
Please open an issue in app-functions-sdk-go, and see if there is anyone from the community could help fix this issue.

[cloudxxx8]

I just noticed the issue is opened
edgexfoundry/app-service-configurable#720

Thanks for reporting it.