Allow some settings managed by UI to be in conf.d

Hi Benjamin!

Just as we have been chatting in #222 (closed)

Would be good thing to have settings like Admin group/users that are managed with UI in separate dir like conf.d, so we don't break/conflic with some automated deployment tasks actually performed with Ansible (but some other could think in other ways of automation).