@x_bin I unfortunately still don't quite undestand why skills require lots of attachments and will make the atlas grow. Could you provide an example of what a skill actually is, and what the skeleton then shows, then it's a bit easier to help.
In general it depends on how often and at what time you change your SkeletonDataAsset
and reload your skeleton. If that's at non-critical timepoints, it might not be a problem at all. The best answer is anyway to profile the scenario on your target device (e.g. with a stress test of the worst-case scenario), then you can say how much performance it really costs.