I am wondering if the objective function in the following problem makes sense. The question is posted in CrossValidated, stack exchange as well.
I know there is a physical system having an underlying deterministic relationship: $$ \mathbf{y}_t = \mathbf{A} \mathbf{x}_t $$ where $\mathbf{y}_t$ and $\mathbf{x}_t$ are column vectors with same numbers of rows. They represent some measured values of a fixed number of entities. We know the number of rows, and want to estimate $\mathbf{A}$ based on observations. All entries in $\mathbf{A}$ are positive.
The major obstacle is that I only have partial observations for $\mathbf{y}_t$ and $\mathbf{x}_t$ at entries $i \in I_{\text{obs}}$. That is, observations for some entries, $i \in I_{\text{hidden}}$, are missing all the time.
For example, if there are 3 entities. Let's say observations at the third entity are missing. I only have observations of $(x_{t, 1}, y_{t, 1})$, $(x_{t, 2}, y_{t, 2})$ for $t \in T$.
I can obtain some candidates $\mathbf{\hat{A}}$ (through heuristic algorithms). The task is to evaluate if these candidates are good representations of $\mathbf{A}$.
For every candidate $\mathbf{\hat{A}}$, I find a column vector $\mathbf{b}$ to max the following problem (call it vector-b problem): $$\begin{aligned} \max_{\mathbf{b}} \quad & \mathbf{b}^{\top} \mathbf{\hat{A}} \mathbf{x}_{\text{binary}} \\ \text{s.t.} \quad & b_i = 0 \quad \forall i \in I_{\text{missing}} \end{aligned} $$ where $\mathbf{x}_{\text{binary}}$ is a column vector with binary values, -1 and 1. The value is -1 if the observation is missing. Corresponding to the previous example, $\mathbf{x}_{\text{binary}} = \left[1 \quad 1 \quad -1 \right]^{\top}$, because we don't have observations for $x_{t, 3}$. The reason for this step is to minimise the impact of missing observations. The fact that entries in $\mathbf{A}$ are positive is essential in this problem.
With the optimal value, $\mathbf{\hat{b}} = \arg \max \mathbf{b}^{\top} \mathbf{\hat{A}} \mathbf{x}_{\text{binary}}$, the performance of $\mathbf{\hat{A}}$ is evaluated by a scalar: $$ \begin{aligned} \sum_{t \in T} \left[\mathbf{\hat{b}}^{\top} \mathbf{y}_{t, \text{obs}} - \mathbf{\hat{b}}^{\top} \mathbf{\hat{A}} \mathbf{x}_{t, \text{obs}} \right]^2 \end{aligned} $$ where entries $i \in I_{\text{missing}}$ of $\mathbf{x}_{t, \text{obs}}$ are 0. Entries $i \in I_{\text{missing}}$ of $\mathbf{y}_{t, \text{obs}}$ don't matter because $b_i = 0, \forall i \in I_{\text{missing}}$.
That is, I am trying to minimise the deviation between observed aggregated $y$ values and calculated aggregated $y$ values, which I am not sure if it makes sense.
The task can be done by multiple regression. However, for entries in the same rows of $\mathbf{A}$, I know most of them are similar. Because all variables in $\mathbf{x}$ are correlated with each other and some variables are hidden, some statistical issues like multicollinearity will distort the estimation results. For example, some coefficients will become negative. Besides, there is no way to have results for those coefficients not obtained from the multiple regression.
But I am not interested in predictions. This is a physical system, and I want to explain it by $\mathbf{A}$. The advantage of using heuristics is that meaningful $\mathbf{A}$ comes first and then we talk about their performance. Right now, I have a way to get meaningful candidates, but not sure about the way to evaluate them.