Dynamic skill settings

I am making an intercom skill, and want to be able to dynamically add another device to the web ui settings page.

For instance:

A button that says “Add Device”
When clicked, it adds a section with a name and ip address.

Is there a way to do this, or does each just have to be entered into the local settings