Directory
Meaning of Symbols
Symbol | Quantity |
---|---|
min \min min | Minimize. |
max \max max | Maximize. |
sup \sup sup | supremum. |
inf \inf inf | infimum. |
Some Specific Sets
Symbol | Quantity |
---|---|
R \mathbf{R} R | Real numbers. |
R n \mathbf{R}^n Rn | Real n n n-vectors ( n × 1 n × 1 n×1 matrices). |
R m × n \mathbf{R}^{m \times n} Rm×n | Real m × n m \times n m×n matrices. |
R + , R + + \mathbf{R}_{+}, \mathbf{R}_{++} R+,R++ | Nonnegative, positive real numbers. |
C \mathbf{C} C | Complex numbers. |
C n \mathbf{C}^n Cn | Complex$ n$-vectors. |
C m × n \mathbf{C}^{m \times n } Cm×n | Complex m × n matrices. |
Z \mathbf{Z} Z | Integers. |
Z + \mathbf{Z}_{+} Z+ | Nonnegative integers. |
S n \mathbf{S}^n Sn | Symmetric n × n n \times n n×n matrices. |
S n , S + + n \mathbf{S}^n,\mathbf{S}^n_{++} Sn,S++n | Symmetric positive semidefinite, positive definite, n × n n \times n n×n matrices… |
Vectors and Matrices
Symbol | Quantity |
---|---|
1 \mathbf{1} 1 | Vector with all components one. |
e i \mathbf{e}_i ei | i i ith standard basis vector. |
I \mathbf{I} I | Identity matrix. |
X T \mathbf{X}^T XT | Transpose of matrix X \mathbf{X} X |
X H \mathbf{X}^H XH | Hermitian (complex conjugate) transpose of matrix X \mathbf{X} X. |
t r X \mathbf{tr~} \mathbf{X} tr X | Trace of matrix X \mathbf{X} X. |
λ i ( X ) \lambda_i(\mathbf{X}) λi(X) | i i ith largest eigenvalue of symmetric matrix X. |
λ max ( X ) , λ min ( X ) \lambda_{\max}(\mathbf{X}),\lambda_{\min}(\mathbf{X}) λmax(X),λmin(X) | Maximum, minimum eigenvalue of symmetric matrix X \mathbf{X} X. |
σ max i ( X ) \sigma_{\max}^{i}(\mathbf{X}) σmaxi(X) | i i ith largest singular value of matrix X \mathbf{X} X. |
σ max ( X ) , σ min ( X ) \sigma_{\max}(\mathbf{X}),\sigma_{\min}(\mathbf{X}) σmax(X),σmin(X) | Maximum, minimum singular value of matrix X \mathbf{X} X. |
X † \mathbf{X}^{\dagger} X† | Moore-Penrose or pseudo-inverse of matrix X \mathbf{X} X. |
x ⊥ y x \perp y x⊥y | Vectors x x x and y y y are orthogonal: x T y = 0. |
V ⊥ \mathbf{V}^{\perp} V⊥ | Orthogonal complement of subspace V \mathbf{V} V. |
d i a g ( x ) \mathbf{diag}(x) diag(x) | Diagonal matrix with diagonal entries x 1 , . . . , x n x_1 ,...,x_n x1,...,xn . |
d i a g ( X \mathbf{diag}(\mathbf{X} diag(X, Y , . . . ) \mathbf{Y},...) Y,...) | Block diagonal matrix with diagonal blocks X \mathbf{X} X, Y \mathbf{Y} Y,… |
r a n k ( A ) \mathbf{rank}(\mathbf{A}) rank(A) | Rank of matrix A \mathbf{A} A. |
R ( A ) \mathcal{R}(\mathbf{A}) R(A) | Range of matrix A \mathbf{A} A. |
N ( A ) \mathcal{N}(\mathbf{A}) N(A) | Nullspace of matrix A \mathbf{A} A. |
Norms and Distances
Symbol | Quantity |
---|---|
∥ ⋅ ∥ \| \cdot \| ∥⋅∥ | A norm. |
∥ ⋅ ∥ ∗ \| \cdot \|_* ∥⋅∥∗ | Dual of norm ∥ ⋅ ∥ \| \cdot \| ∥⋅∥. |
∥ x ∥ 2 \| x\|_2 ∥x∥2 | Euclidean (or ℓ 2 ℓ_2 ℓ2-) norm of vector x x x. |
∥ x ∥ 1 \| x\|_1 ∥x∥1 | ℓ 1 ℓ_1 ℓ1-norm of vector x x x. |
∥ x ∥ ∞ \| x \|_\infty ∥x∥∞ | ℓ ∞ ℓ_\infty ℓ∞-norm of vector x x x. |
∥ X ∥ 2 \| \mathbf{X}\|_2 ∥X∥2 | Spectral norm (maximum singular value) of matrix X \mathbf{X} X. |
B ( c , r ) B(c,r) B(c,r) | Ball with center c and radius r r r. |
d i s t ( A , B ) \mathbf{dist(A,B)} dist(A,B) | Distance between sets (or points) A \mathbf{A} A and B \mathbf{B} B. |
Generalized Inequalities
Symbol | Quantity |
---|---|
x ⪯ y x \preceq y x⪯y | Componentwise inequality between vectors x x x and y y y. |
x ≺ y x \prec y x≺y | Strict componentwise inequality between vectors x x x and y y y. |
X ⪯ Y \mathbf{X} \preceq \mathbf{Y} X⪯Y | Matrix inequality between symmetric matrices X \mathbf{X} X and Y \mathbf{Y} Y. |
X ≺ Y \mathbf{X} \prec \mathbf{Y} X≺Y | Strict matrix inequality between symmetric matrices X \mathbf{X} X and Y \mathbf{Y} Y. |
x ⪯ K y x \preceq_{K} y x⪯Ky | Generalized inequality induced by proper cone K K K. |
x ≺ K y x \prec_{K} y x≺Ky | Strict generalized inequality induced by proper cone K K K. |
x ⪯ K ∗ y x \preceq_{K^*} y x⪯K∗y | Dual generalized inequality. |
x ≺ K ∗ y x \prec_{K^*} y x≺K∗y | Dual strict generalized inequality. |
Topology and Convex Analysis
Symbol | Quantity |
---|---|
c a r d C \mathbf{card}~C card C | Cardinality of set C C C. |
i n t C \mathbf{int}~C int C | Interior of set C C C. |
r e l i n t C \mathbf{relint}~C relint C | Relative interior of set C C C. |
c l C \mathbf{cl}~C cl C | Closure of set C C C. |
b d C \mathbf{bd}~C bd C | Boundary of set C : b d C = c l C \ i n t C C: \mathbf{bd} ~C = \mathbf{cl} ~C~\mathbf{\backslash} ~ int~C C:bd C=cl C \ int C. |
c o n v C \mathbf{conv}~C conv C | Convex hull of set C C C. |
a f f C \mathbf{aff}~C aff C | Affine hull of set C C C. |
K ∗ K^* K∗ | Dual cone associated with K K K. |
I C I_C IC | Indicator function of set C C C. |
S C S_C SC | Support function of set C C C. |
f ∗ f^* f∗ | Conjugate function of f f f. |
Probability
Symbol | Quantity |
---|---|
E x \mathbf{E~x} E x | Expected value of random vector x \mathbf{x} x. |
p r o b S \mathbf{prob}~ S prob S | Probability of event S S S. |
v a r x \mathbf{var}~x var x | Variance of scalar random variable x x x. |
N ( c , ∑ ) \mathcal{N}(c,\sum) N(c,∑) | Gaussian distribution with mean c c c, covariance (matrix) ∑ \sum ∑. |
Φ \Phi Φ | Cumulative distribution function of N ( 0 , 1 ) \mathcal{N}(0,1) N(0,1) random variable. |
Functions and derivatives
Symbol | Quantity |
---|---|
f : A → B f:A \rightarrow B f:A→B | f f f is a function on the set d o m f ⊆ A \mathbf{dom} f \subseteq A domf⊆A into the set B B B. |
d o m f \mathbf{dom}~f dom f | Domain of function f f f. |
e p i f \mathbf{epi}~f epi f | Epigraph of function f f f. |
∇ f \nabla f ∇f | Gradient of function f f f. |
∇ 2 f \nabla^2 f ∇2f | Hessian of function f f f. |
D f D~f D f | Derivative (Jacobian) matrix of function f f f. |