Suppose function $\mu_i(y):\mathbb{R} \rightarrow \mathbb{R}$ is a logit function, $\mu_i(y)=1/(1+\exp(-y))$. Also, we assume that $\mathbf{x}_i\in \mathbb{R}^d$ and $\theta \in \mathbb{R}^d$. I am wondering how it is possible to find the robust counterpart of the following problem? \begin{equation} \begin{split} \min_{\theta \in \mathbb{R}^d} &\left\{\sum_{i=1}^{n} a_i \mu_i(\mathbf{x}^T \theta)\: \:\: s.t. \:\:\:\|\theta-\hat{\theta}\|_H \le \gamma \right\} \ge b \end{split} \end{equation}

where $H$ is a positive definite matrix and $a_i, \gamma, b$ are positive numbers. If it is not possible to find an exact robust counterpart, I would be thankful for any idea about how to find a conservative approximation.

I crossposted to Math.SE as well: Dual of sum of two sigmoid functions.

  • $\begingroup$ You're looking for the convex conjugate (Fenchel Dual) of this problem? Your logit function is close to some found in the table here: en.wikipedia.org/wiki/Convex_conjugate $\endgroup$
    – Brannon
    Commented Oct 27, 2022 at 17:00


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.