Skip to content

Commit 5c5f88b

Browse files
committed
header levels
1 parent 126be2f commit 5c5f88b

1 file changed

Lines changed: 5 additions & 5 deletions

File tree

docs/src/math_background.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
### Decomposition
1+
# Decompositions
22

33
In DLL, the primal constraints (dual variables) are decomposed into a predicted set and a completed set.
44
Consider the primal-dual pair:
@@ -69,7 +69,7 @@ Then, the completion model is:
6969
To train the neural network, we need the gradient of the optimal value with respect to the predicted $y$. This is $\nabla_y = -b-Ax$ where $x$ is the optimal dual solution corresponding to the affine constraints in the completion model. In the special cases below, we specify just the expression for $x$ in this formula.
7070

7171

72-
#### Bounded Decomposition
72+
## Bounded Decomposition
7373

7474
When all primal variables have finite upper and lower bounds, a natural way to decompose the constraints is to have $z$ correspond to the bound constraints, and $y$ correspond to the main constraints, i.e.
7575

@@ -116,7 +116,7 @@ Then, the completion model is:
116116
This model admits a closed form solution, $z_l = |c-A^\top y|^+$ and $z_u = -|c-A^\top y|^-$. Furthermore, the $x$ that defines the (sub-)gradient is given element-wise by $l$ if $c-A^\top y > 0$, $u$ if $c-A^\top y < 0$, and $x\in[l,u]$ otherwise.
117117

118118

119-
#### (Strictly) Convex QP
119+
## (Strictly) Convex QP
120120

121121
In the convex QP case, the primal has a strictly convex quadratic objective function, i.e. $Q\succ 0$. In that case it is natural to use the main constraints as the predicted set and to complete the quadratic slack dual variables.
122122

@@ -162,7 +162,7 @@ Then, the completion model is:
162162

163163
This model admits a closed form solution, $z = \frac{1}{2}Q^{-1}(c - A^\top y)$. Furthermore, the closed form dual solution in this case is $x=z$.
164164

165-
### Decomposition detection
165+
# Decomposition detection
166166

167167
!!! warning
168168
The decomposition detection is very basic, based on minimizing the number of predicted dual variables. In some cases, it may actually be preferred to to predict more dual variables, if they are for some reason easier to learn. In that case, users should manually specify the decomposition.
@@ -176,7 +176,7 @@ The current detection logic is as follows:
176176

177177
The order of preference is to maximize the number of completed dual variables among the closed-form solutions, and if no closed-form solution is available, to use the generic decomposition. Thus, the bounded decomposition is preferred over the convex QP decomposition, as illustrated by the following example.
178178

179-
#### Bounded with quadratic objective
179+
## Bounded with quadratic objective
180180

181181
In the case where bounded decomposition is used with a model that has a quadratic objective, L2ODLL prefers the bounded decomposition, leading to the following models.
182182
```math

0 commit comments

Comments
 (0)