I am doing a project where I am using Particle Swarm Optimization (PSO) for a design optimization problem. Naturally, in there I had to conduct hyperparameter optimization to find the most optimal values of the hyperparameters. I was asked a question by someone that whether the same set of optimal hyperparameters can still work if I increase the system size (i.e. increase search dimensionality) or do I need to do a fresh optimal hyperparameter search.
My response was, ideally yes, we would want to do a separate hyperparameter optimization since the problem changes the objective function landscape. I am looking forwards to your answers. Am I correct in saying this? If not, then what could be a more better response ?