Saltstack load all files in pillars dir - salt-stack

Question

I am having one large .yml config file, which gets loaded in pillar .sls file and later used in states. To refactor that config file and make it a bit readable, I would like to split it into multiple files, which would be placed in one directory.
Current structure of pillars is:
pillar
|- app_configuration.sls
|- config.yml
Desired structure is:
pillar
|- app_configuration.sls
|- config_files
|- config1.yml
|- config2.yml
|- config3.yml
Current code in app_configuration.sls loads yaml file config.yml like this:
{% import_yaml 'config.yml' as app_config %}
But with updated configuration structure I need to pass directory path config_files and traverse all files in that directory and merge their content together. How can such behavior be achieved in Saltstack? The most important thing for me is how to list all files in config_files directory. I've already managed to create a for loop with merging code in Jinja, but when I try to use salt.file.find function with relative path (config_files), it does not work. Only when I specify absolute path, which is really really long and it does not look right for me. I also thought about enumerating those config files, but I would like to avoid that, because when new config is added, it may happen, that it is forgotten to be added in enumeration. That is not really scalable.

Answer 1

There are two options for this, you can use include statement inside a pillar SLS file, or load files using top.sls pillar file.
Example of using top.sls for base environment for all minions:
base:
'*':
- app_configuration
- config_files.*
Or, without editing the top.sls file, include files from config_files directory in app_configuration.sls.
At the top of app_configuration.sls:
include:
- config_files.*
Another alternative is to use map.jinja files (see documentation on Formulas).