All ideas are welcome. Just because the Idea doesn't make it into the product immediately does not make it a bad idea.
It's my understanding that the concept of partitioning is just virtual within the logic for multi-threading and it doesn't actually affect the data storage. Currently, you have to manually enter all of the individual partition filters. It would be convenient if you could specify a field/expression and the application would automatically generate partitions based on the results of that field/expression. For example, if I selected a Company field, it would automatically create partitions by the Company field. If/when a Company is added, another partition would be added. If/when a Company was deleted, that partition would be deleted automatically. I envision it simply as a button on the Partition dialog that reads live data, grouping by the field/expression, and creates/deletes the partitions filters. As it is currently implemented, you have to either make sure that you maintain the filters as the data changes or write filters that use ranges to handle any data changes.
Guest
Thanks for logging the idea. We agree on the direction and approach that you have specified here, it would definitely be beneficial to have this kind of auto partitioning or at least the ability to pick a field and profile the value / distribution analysis before deciding on the partitioning. Actually automating the creation of partitions when new data arrives could be dangerous in terms of the number of threads it may create but we'll investigate this option also. We've moved this into our development backlog and will consider this as part of the solution improvements when we bring this to the SKP Cloud solution based on profiling that we already support in that solution.
