Limitations about files?

[Bierchermuesli]

I have a folder with multiple pictures per day....

path: /config/www/timelapses/
filter: **/*.jpg
number_of_files: 10936
bytes: 340396584
fileList: /config/www/timelapses/20210303/202103031954.jpg, / ....(list of 10k files)

State Engine works so far, just a bit slow... :-)

recorder/mysql has some limitations - an recorder exclusion could help but I guess my Use case is beyond what this cpmponent was planned for.

home-assistant    | 2021-04-14 21:46:29 ERROR (Recorder) [homeassistant.components.recorder] Unexpected error saving events: (MySQLdb._exceptions.DataError) (1406, "Data too long for column 'attributes' at row 1")
home-assistant    | [SQL: INSERT INTO states (domain, entity_id, state, attributes, event_id, last_changed, last_updated, created, old_state_id) VALUES (%s, %s, %s, %s, %s, %s, %s, %s, %s)]
home-assistant    | [parameters: ('sensor', 'sensor.balkon_jpg', '340.4', '{"path": "/config/www/timelapses/", "filter": "**/*.jpg", "number_of_files": 10936, "bytes": 340396584, "fileList": ["/config/www/timelapses/20210303 ... (568608 characters truncated) ... ses/20210414/202104142013.jpg"], "sort": "date", "recursive": true, "unit_of_measurement": "MB", "friendly_name": "balkon-jpg", "icon": "mdi:folder"}', 13928857, datetime.datetime(2021, 4, 14, 19, 46, 26, 686915, tzinfo=datetime.timezone.utc), datetime.datetime(2021, 4, 14, 19, 46, 26, 686915, tzinfo=datetime.timezone.utc), datetime.datetime(2021, 4, 14, 19, 46, 26, 686915, tzinfo=datetime.timezone.utc), None)]
home-assistant    | (Background on this error at: http://sqlalche.me/e/13/9h9h)

Can the fileList attribut removed or shortened? or is it madatory for the Frontend component?

[TarheelGrad1998]

Wow, yes, you broke me. By far. :)

The fileList attribute is what feeds the front end Gallery card, to know what files to display. So it is mandatory.

I have a maximum files config for the front end but not on the files component...sounds like from your use case I should add one here as well.

In the meantime you could try the Media Source configuration by adding your folder as a media source in HA, then selecting that for the Gallery card along with a maximum file config. It might give you problems as well though fetching a list of 10k files via the API.

[Bierchermuesli]

Yeah, my case is probably a bit stupid. I would never check all the files.

Im going to process the timeleapse gif/mpeg and keep the last 10 in the folder. Anyway a maximum attribute would make sense ;-)

[TarheelGrad1998]

That is probably the best solution all around. It should work that way and be much faster as well.

I'll keep this issue open and add the attribute when I have time.