words: 106

The term is not very clear, as it could either mean:

a real number function whose graph is a line, i.e.:
$f (x) = a x + b$
(1)
or for higher dimensions, a hyperplane:
$f (x_{1}, x_{2}, \dots, x_{n}) = c_{1} x_{1} + c_{2} x_{2} + \dots + c_{n} x_{n} + b$
(2)
a linear map. Note that the above linear functions are not linear maps unless $b = 0$ (known as the homogeneous case), because e.g.:
$f (x + y) = a x + a y + b$
(3)
but
$f (x) + f (y) = a x + b + a y + b$
(4)
For this reason, it is better never to refer to linear maps as linear functions.

Linear map (linear operator)

words: 1k articles: 27

A linear map is a function

f : V_{1} (F) \to V_{2} (F)

where

V_{1} (F)

and

V_{2} (F)

are two vector spaces over underlying fields

F

such that:

\forall v_{1}, v_{2} \in V_{1}, c_{1}, c_{2} \in F f (c_{1} v_{1} + c_{2} v_{2}) = c_{1} f (v_{1}) + c_{2} f (v_{2})

(5)

A common case is

F = R

V_{1} = R_{m}

and

V_{2} = R_{n}

One thing that makes such functions particularly simple is that they can be fully specified by specifyin how they act on all possible combinations of input basis vectors: they are therefore specified by only a finite number of elements of

F

Every linear map in finite dimension can be represented by a matrix, the points of the domain being represented as vectors.

As such, when we say "linear map", we can think of a generalization of matrix multiplication that makes sense in infinite dimensional spaces like Hilbert spaces, since calling such infinite dimensional maps "matrices" is stretching it a bit, since we would need to specify infinitely many rows and columns.

The prototypical building block of infinite dimensional linear map is the derivative. In that case, the vectors being operated upon are functions, which cannot therefore be specified by a finite number of parameters, e.g.

For example, the left side of the time-independent Schrödinger equation is a linear map. And the time-independent Schrödinger equation can be seen as a eigenvalue problem.

Form (mathematics)

words: 12

A form is a function from a vector space to elements of the underlying field of the vector space.

Examples:

linear form
bilinear form
multilinear form

 Tagged

Minkowski inner product

Linear form

words: 362 articles: 3

A Linear map where the image is the underlying field of the vector space, e.g.

R^{n} \to R

The set of all linear forms over a vector space forms another vector space called the dual space.

Matrix representation of a linear form

words: 36

For the typical case of a linear form over

R^{n}

, the form can be seen just as a row vector with n elements, the full form being specified by the value of each of the basis vectors.

Dual space ( $V^{*}$ )

words: 302 articles: 1

The dual space of a vector space

V

, sometimes denoted

V^{*}

, is the vector space of all linear forms over

V

with the obvious addition and scalar multiplication operations defined.

Since a linear form is completely determined by how it acts on a basis, and since for each basis element it is specified by a scalar, at least in finite dimension, the dimension of the dual space is the same as the

V

, and so they are isomorphic because all vector spaces of the same dimension on a given field are isomorphic, and so the dual is quite a boring concept in the context of finite dimension.

Infinite dimension seems more interesting however, see: en.wikipedia.org/w/index.php?title=Dual_space&oldid=1046421278#Infinite-dimensional_case

One place where duals are different from the non-duals however is when dealing with tensors, because they transform differently than vectors from the base space

V

Dual vector ( $e^{i}$ )

words: 174

Dual vectors are the members of a dual space.

In the context of tensors , we use raised indices to refer to members of the dual basis vs the underlying basis:

e_{1} e_{2} e_{3} e^{1} e^{2} e^{3} \in V \in V \in V \in V^{*} \in V^{*} \in V^{*}

(6)

The dual basis vectors

e^{i}

are defined to "pick the corresponding coordinate" out of elements of V. E.g.:

e^{1} (4, - 3, 6) e^{2} (4, - 3, 6) e^{3} (4, - 3, 6) = 4 = - 3 = 6

(7)

By expanding into the basis, we can put this more succinctly with the Kronecker delta as:

e^{i} (e_{j}) = δ_{i j}

(8)

Note that in Einstein notation, the components of a dual vector have lower indices. This works well with the upper case indices of the dual vectors, allowing us to write a dual vector

f

as:

f = f_{i} e^{i}

(9)

In the context of quantum mechanics, the bra notation is also used for dual vectors.

Linear operator

words: 85 articles: 1

We define it as a linear map where the domain is the same as the image, i.e. an endofunction.

Examples:

a 2x2 matrix can represent a linear map from $R^{2}$ to $R^{2}$ , so which is a linear operator
the derivative is a linear map from $C^{\infty}$ to $C^{\infty}$ , so which is also a linear operator

Adjoint operator ( $A^{†}$ )

words: 40

Given a linear operator

A

over a space

S

that has a inner product defined, we define the adjoint operator

A^{†}

(the

†

symbol is called "dagger") as the unique operator that satisfies:

\forall v, w \in S, < A v, w > = < v, A^{†} w >

(10)

Self-adjoint operator

Multilinear map

words: 808 articles: 18

Bilinear map

words: 98

Linear map of two variables.

More formally, given 3 vector spaces X, Y, Z over a single field, a bilinear map is a function from:

f : X \times Y \to Z

(11)

that is linear on the first two arguments from X and Y, i.e.:

f (a_{1} x_{1} + a_{2} x_{2}, y) = a_{1} f (x_{1}, y) + a_{2} f (x_{2}, y)

(12)

Note that the definition only makes sense if all three vector spaces are over the same field, because linearity can mix up each of them.

The most important example by far is the dot product from

R^{n} \times R^{n} \to R

, which is more specifically also a symmetric bilinear form.

Bilinear form ( $B (x, y)$ )

words: 294 articles: 2

Analogous to a linear form, a bilinear form is a Bilinear map where the image is the underlying field of the vector space, e.g.

R^{n} \times R^{m} \to R

Some definitions require both of the input spaces to be the same, e.g.

R^{n} \times R^{n} \to R

, but it doesn't make much different in general.

The most important example of a bilinear form is the dot product. It is only defined if both the input spaces are the same.

Matrix representation of a bilinear form

words: 223 articles: 1

As usual, it is useful to think about how a bilinear form looks like in terms of vectors and matrices.

Unlike a linear form, which was a vector, because it has two inputs, the bilinear form is represented by a matrix

M

which encodes the value for each possible pair of basis vectors.

In terms of that matrix, the form

B (x, y)

is then given by:

B (x, y) = x^{T} M y

(13)

Effect of a change of basis on the matrix of a bilinear form ( $B_{2} = C^{T} B C$ )

words: 157

C

is the change of basis matrix, then the matrix representation of a bilinear form

M

that looked like:

B (x, y) = x^{T} M y

(14)

then the matrix in the new basis is:

C^{T} M C

(15)

Sylvester's law of inertia then tells us that the number of positive, negative and 0 eigenvalues of both of those matrices is the same.

Proof: the value of a given bilinear form cannot change due to a change of basis, since the bilinear form is just a function, and does not depend on the choice of basis. The only thing that change is the matrix representation of the form. Therefore, we must have:

x^{T} M y = x_{n e w}^{T} M_{n e w} y_{n e w}

(16)

and in the new basis:

x = C x_{n e w} y = C y_{n e w} x_{n e w}^{T} M_{n e w} y_{n e w} = x^{T} M y = (C x_{n e w})^{T} M (C y_{n e w}) = x_{n e w}^{T} (C^{T} M C) y_{n e w}

(17)

and so since:

\forall x_{n e w}, y_{n e w} x_{n e w}^{T} M_{n e w} y_{n e w} = x_{n e w}^{T} (C^{T} M C) y_{n e w} ⟹ M_{n e w} = C^{T} M C

(18)

proofwiki.org/wiki/Matrix_of_Bilinear_Form_Under_Change_of_Basis

Multilinear form

words: 25

See form.

Analogous to a linear form, a multilinear form is a Multilinear map where the image is the underlying field of the vector space, e.g.

R^{n_{1}} \times R^{n_{2}} \times R^{n_{2}} \to R

Symmetric bilinear map

words: 373 articles: 9

Subcase of symmetric multilinear map:

f (x, y) = f (y, x)

(19)

Requires the two inputs

x

and

y

to be in the same vector space of course.

The most important example is the dot product, which is also a positive definite symmetric bilinear form.

Symmetric bilinear form

words: 76 articles: 1

symmetric bilinear maps that is also a bilinear form.

Matrix representation of a symmetric bilinear form

words: 71

Like the matrix representation of a bilinear form, it is a matrix, but now the matrix has to be a symmetric matrix.

We can then immediately see that the matrix is symmetric, then so is the form. We have:

B (x, y) = x^{T} M y

(20)

But because

B (x, y)

is a scalar, we have:

B (x, y) = B (x, y)^{T}

(21)

and:

B (x, y) = B (x, y)^{T} = (x^{T} M y)^{T} = y^{T} M^{T} x = y^{T} M^{T} x = y^{T} M x = B (y, x)

(22)

Hermitian form

words: 52 articles: 1

The complex number analogue of a symmetric bilinear form.

The prototypical example of it is the complex dot product.

Note that this form is neither strictly symmetric, it satisfies:

< x, y > = \overline{< y, x >}

(23)

where the over bar indicates the complex conjugate, nor is it linear for complex scalar multiplication on the second argument.

Bibliography:

mathworld.wolfram.com/HermitianForm.html

Matrix representation of a Hermitian form

words: 3

;

A Hermitian matrix.

Quadratic form

words: 181

Multivariate polynomial where each term has degree 2, e.g.:

f (x, y) = 2 y^{2} + 10 y x + x^{2}

(24)

is a quadratic form because each term has degree 2:

$y^{2}$
$x y$
$x^{2}$

but e.g.:

f (x, y) = 2 y^{2} + 10 y x + x^{3}

(25)

is not because the term

x^{3}

has degree 3.

More generally for any number of variables it can be written as:

f (x_{1}, x_{2}, \dots, x_{n}) = \sum_{i, j} a_{i} a_{j} x_{i} x_{j}

(26)

There is a 1-to-1 relationship between quadratic forms and symmetric bilinear forms. In matrix representation, this can be written as:

x^{T} B x

(27)

where

x

contains each of the variabes of the form, e.g. for 2 variables:

x = [x, y]

(28)

Strictly speaking, the associated bilinear form would not need to be a symmetric bilinear form, at least for the real numbers or complex numbers which are commutative. E.g.:

[x y] [0210] [x y] = [x y] [y 2 x] = x y + 2 y x = 3 x y

(29)

But that same matrix could also be written in symmetric form as:

[0 1.5 1.5 0]

(30)

so why not I guess, its simpler/more restricted.

Positive definite symmetric bilinear form

words: 17 articles: 1

Symmetric bilinear form that is also positive definite, i.e.:

\forall x, B (x, x) > 0

(31)

Matrix representation of a positive definite symmetric bilinear form

words: 6

A positive definite matrix that is also a symmetric matrix.

Skew-symmetric bilinear map

words: 8

Subcase of antisymmetric multilinear map:

f (x, y) = - f (y, x)

(32)

Skew-symmetric bilinear form

words: 5

Skew-symmetric bilinear map that is also a bilinear form.

Symmetric multilinear map

words: 16 articles: 1

Same value if you swap any input arguments.

Antisymmetric multilinear map

words: 8

Change sign if you swap two input values.

Alternating multilinear map

words: 2

Implies antisymmetric multilinear map.

Dot product

words: 177 articles: 3

The definition of the "dot product" of a general space varies quite a lot with different contexts.

Most definitions tend to be bilinear forms.

We use the unqualified generally refers to the dot product of Real coordinate spaces, which is a positive definite symmetric bilinear form. Other important examples include:

the complex dot product, which is not strictly symmetric nor linear, but it is positive definite
Minkowski inner product, sometimes called" "Minkowski dot product is not positive definite

The rest of this section is about the

R^{n}

case.

The positive definite part of the definition likely comes in because we are so familiar with metric spaces, which requires a positive norm in the norm induced by an inner product.

The default Euclidean space definition, we use the matrix representation of a symmetric bilinear form as the identity matrix, e.g. in

R^{3}

M = ⎣ ⎢ ⎡ 100010001 ⎦ ⎥ ⎤

(33)

so that:

x \cdot y = [x_{1} x_{2} x_{3}] ⎣ ⎢ ⎡ 100010001 ⎦ ⎥ ⎤ ⎣ ⎢ ⎡ y_{1} y_{2} y_{3} ⎦ ⎥ ⎤ = x_{1} y_{1} + x_{2} y_{2} + x_{3} y_{3}

(34)

Orthogonality

articles: 1

Orthonormality

Angle

Cross product ( $x \times y$ )

articles: 1

Jacobi identity

Index picking function

words: 96 articles: 3

Kronecker delta ( $δ_{i j}$ )

Levi-Civita symbol ( $ε$ )

words: 96 articles: 1

Denoted by the Greek letter epsilon with \varepsilon encoding in LaTeX.

Definition:

odd permutation: -1
even permutation: 1
not a permutation: 0. This happens iff two more more indices are repeated

Levi-Civita symbol as a tensor

words: 70

An Introduction to Tensors and Group Theory for Physicists by Nadir Jeevanjee (2011) shows that this is a tensor that represents the volume of a parallelepiped.

It takes as input three vectors, and outputs one real number, the volume. And it is linear on each vector. This perfectly satisfied the definition of a tensor of order (3,0).

Given a basis

(e_{i}, e_{j}, e_{k})

and a function that return the volume of a parallelepiped given by three vectors

V (v_{1}, v_{2}, v_{3})

ε_{i k j} = V (e_{i}, e_{j}, e_{k})

Projection (mathematics)

Matrix

words: 1k articles: 55

Matrix operation

words: 81 articles: 6

Determinant ( $d e t$ )

words: 23

Name origin: likely because it "determines" if a matrix is invertible or not, as a matrix is invertible iff determinant is not zero.

Matrix inverse ( $M^{- 1}$ )

words: 38 articles: 1

When it exists, which is not for all matrices, only invertible matrix, the inverse is denoted:

M^{- 1}

(35)

Invertible matrix

words: 22

The set of all invertible matrices forms a group: the general linear group with matrix multiplication. Non-invertible matrices don't form a group due to the lack of inverse.

Transpose ( $M^{T}$ )

words: 20 articles: 2

Transpose of a matrix multiplication

words: 14

When it distributes it inverts the order of the matrix multiplication:

(M N)^{T} = N^{T} M^{T}

(36)

Inverse of the transpose

words: 6

The transpose and matrix inverse commute:

(M^{T}) - 1 = (M^{- 1})^{T}

(37)

Matrix multiplication

words: 163 articles: 9

Since a matrix

M

can be seen as a linear map

f_{M} (x)

, the product of two matrices

M N

can be seen as the composition of two linear maps:

f_{M} (f_{N} (x))

(38)

One cool thing about linear functions is that we can easily pre-calculate this product only once to obtain a new matrix, and so we don't have to do both multiplications separately each time.

System of linear equations

words: 91 articles: 4

Application of systems of linear equations

words: 15

No 2x2 examples please. I'm talking about large matrices that would be used in supercomputers.

System of linear equations algorithm

words: 76 articles: 2

 Tagged

Quantum algorithm for linear systems of equations

LINPACK benchmarks

Conjugate gradient method

words: 76

For positive definite matrices only.

TODO application.

TODO speedup over algorithm for general matrices.

www.studentclustercompetition.us/ comments:

The HPCG benchmark uses a preconditioned conjugate gradient (PCG) algorithm to measure the performance of HPC platforms with respect to frequently observed but challenging patterns of computing, communication, and memory access. While HPL provides an optimistic performance target for applications, HPCG can be considered as a lower bound on performance. Many of the top 500 supercomputers also provide their HPCG performance as a reference.

Application of matrix multiplication

words: 2

math.stackexchange.com/questions/41706/practical-uses-of-matrix-multiplication/4647422#4647422 highlights deep learning applications.

Matrix multiplication algorithm

words: 11 articles: 1

math.stackexchange.com/questions/30330/fast-algorithm-for-solving-system-of-linear-equations/259372#259372

General Matrix Matrix Multipliation (GEMM)

words: 11

The terminology GEMM is present on BLAS, and has stuck pretty much.

Matrix decomposition

Eigenvalues and eigenvectors

words: 592 articles: 19

Applications of eigenvalues and eigenvectors

Characteristic polynomial

Eigenvalue

words: 56 articles: 2

See: eigenvalues and eigenvectors.

Spectrum (functional analysis)

words: 54 articles: 1

Set of eigenvalues of a linear operator.

Continuous spectrum (functional analysis)

words: 49

Unlike the simple case of a matrix, in infinite dimensional vector spaces, the spectrum may be continuous.

The quintessential example of that is the spectrum of the position operator in quantum mechanics, in which any real number is a possible eigenvalue, since the particle may be found in any position. The associated eigenvectors are the corresponding Dirac delta functions.

Eigendecomposition of a matrix

words: 494 articles: 7

Every invertible matrix

M

can be written as:

M = Q D Q^{- 1}

(39)

where:

$D$ is a diagonal matrix containing the eigenvalues of $M$
columns of $Q$ are eigenvectors of $M$

Note therefore that this decomposition is unique up to swapping the order of eigenvectors. We could fix a canonical form by sorting eigenvectors from smallest to largest in the case of a real number.

Intuitively, Note that this is just the change of basis formula, and so:

$Q^{- 1}$ changes basis to align to the eigenvectors
$D$ multiplies eigenvectors simply by eigenvalues
$Q$ changes back to the original basis

Eigendecomposition of a real symmetric matrix

words: 24

The general result from eigendecomposition of a matrix:

M = Q D Q^{- 1}

(40)

becomes:

M = O D O^{T}

(41)

where

O

is an orthogonal matrix, and therefore has

O^{- 1} = O^{T}

Sylvester's law of inertia

words: 383 articles: 5

The main interest of this theorem is in classifying the indefinite orthogonal groups, which in turn is fundamental because the Lorentz group is an indefinite orthogonal groups, see: all indefinite orthogonal groups of matrices of equal metric signature are isomorphic.

It also tells us that a change of basis does not the alter the metric signature of a bilinear form, see matrix congruence can be seen as the change of basis of a bilinear form.

The theorem states that the number of 0, 1 and -1 in the metric signature is the same for two symmetric matrices that are congruent matrices.

For example, consider:

A = [2223]

(42)

The eigenvalues of

A

are

1

and

4

, and the associated eigenvectors are:

v_{1} = [- 2, 1]^{T} v_{4} = [2 / 2, 1]^{T}

(43)

symPy code:

A = Matrix([[2, sqrt(2)], [sqrt(2), 3]])
A.eigenvects()

and from the eigendecomposition of a real symmetric matrix we know that:

A = P D P^{T} = [- 2 1 2 / 2 1] [1004] [- 2 2 / 2 11]

(44)

Now, instead of

P

, we could use

P E

, where

E

is an arbitrary diagonal matrix of type:

[e_{1} 0 0 e_{2}]

(45)

With this, would reach a new matrix

B

B = (P E) D (P E)^{T} = P (E D E^{T}) P^{T} = P (E E D) P^{T}

(46)

Therefore, with this congruence, we are able to multiply the eigenvalues of

A

by any positive number

e_{1}^{2}

and

e_{2}^{2}

. Since we are multiplying by two arbitrary positive numbers, we cannot change the signs of the original eigenvalues, and so the metric signature is maintained, but respecting that any value can be reached.

Note that the matrix congruence relation looks a bit like the eigendecomposition of a matrix:

D = S M S^{T}

(47)

but note that

D

does not have to contain eigenvalues, unlike the eigendecomposition of a matrix. This is because here

S

is not fixed to having eigenvectors in its columns.

But because the matrix is symmetric however, we could always choose

S

to actually diagonalize as mentioned at eigendecomposition of a real symmetric matrix. Therefore, the metric signature can be seen directly from eigenvalues.

Also, because

D

is a diagonal matrix, and thus symmetric, it must be that:

S^{T} = S^{- 1}

(48)

What this does represent, is a general change of basis that maintains the matrix a symmetric matrix.

Congruent matrix

words: 63 articles: 1

Two symmetric matrices

A

and

B

are defined to be congruent if there exists an

S

G L (n)

such that:

A = S B S^{T}

(49)

Matrix congruence can be seen as the change of basis of a bilinear form

words: 41

From effect of a change of basis on the matrix of a bilinear form, remember that a change of basis

C

modifies the matrix representation of a bilinear form as:

C^{T} M C

(50)

So, by taking

S = C^{T}

, we understand that two matrices being congruent means that they can both correspond to the same bilinear form in different bases.

Matrix similarity

Metric signature

articles: 1

Metric signature matrix

Eigenvector

words: 2

See: eigenvalues and eigenvectors.

Eigenvectors and eigenvalues of the identity matrix

math.stackexchange.com/questions/1507290/linear-algebra-identity-matrix-and-its-relation-to-eigenvalues-and-eigenvectors/3934023#3934023

Spectral theorem

words: 40 articles: 3

Hermitian matrix (complex analogue of symmetric matrix)

words: 40 articles: 2

Hermitian operator

words: 40 articles: 1

This is the possibly infinite dimensional version of a Hermitian matrix, since linear operators are the possibly infinite dimensional version of matrices.

There's a catch though: now we don't have explicit matrix indices here however in general, the generalized definition is shown at: en.wikipedia.org/w/index.php?title=Hermitian_adjoint&oldid=1032475701#Definition_for_bounded_operators_between_Hilbert_spaces

Riesz representation theorem

Kronecker product

Named matrix

words: 207 articles: 16

 Tagged

Dense and sparse matrices

words: 80 articles: 2

A good definition is that the sparse matrix has non-zero entries proportional the number of rows. Therefore this is Big O notation less than something that has

N^{2}

non zero entries. Of course, this only makes sense when generalizing to larger and larger matrices, otherwise we could take the constant of proportionality very high for one specific matrix.

Of course, this only makes sense when generalizing to larger and larger matrices, otherwise we could take the constant of proportionality very high for one specific matrix.

Dense matrix

Sparse matrix

Diagonal matrix

words: 10 articles: 2

Forms a normal subgroup of the general linear group.

Scalar matrix ( $Z (V)$ )

words: 5 articles: 1

Forms a normal subgroup of the general linear group.

Identity matrix ( $I_{n}$ )

Square matrix

words: 28 articles: 1

Matrix ring (Matrix ring of degree n, $M_{n}$ , Set of all n-by-y square matrices)

words: 28

The matrix ring of degree n

M_{n}

is the set of all n-by-n square matrices together with the usual vector space and matrix multiplication operations.

This set forms a ring.

Related terminology:

math.stackexchange.com/questions/412200/what-is-the-notation-for-the-set-of-all-m-times-n-matrices

Orthogonal matrix

words: 23 articles: 1

Members of the orthogonal group.

Unitary matrix

words: 19

Complex analogue of orthogonal matrix.

Applications:

in quantum computers programming basically comes down to creating one big unitary matrix as explained at: quantum computing is just matrix multiplication

Triangular matrix

Symmetric matrix

words: 66 articles: 4

A matrix that equals its transpose:

M = M^{T}

(51)

Can represent a symmetric bilinear form as shown at matrix representation of a symmetric bilinear form, or a quadratic form.

Definite matrix

words: 27 articles: 1

The definition implies that this is also a symmetric matrix.

Positive definite matrix

words: 18

The dot product is a positive definite matrix, and so we see that those will have an important link to familiar geometry.

Skew-symmetric matrix (Antisymmetric matrix)

words: 21 articles: 1

WTF is a skew? "Antisymmetric" is just such a better name! And it also appears in other definitions such as antisymmetric multilinear map.

Skew-symmetric form

Vector space

words: 300 articles: 10

Basis (linear algebra)

words: 199 articles: 4

Change of basis

words: 199 articles: 2

N = B M B^{- 1}

(52)

where:

$M$ : matrix in the old basis
$N$ : matrix in the new basis
$B$ : change of basis matrix

Change of basis matrix

words: 152

The change of basis matrix

C

is the matrix that allows us to express the new basis in an old basis:

x_{o l d} = C x_{n e w}

(53)

Mnemonic is as follows: consider we have an initial basis

(x_{o l d}, y_{o l d})

. Now, we define the new basis in terms of the old basis, e.g.:

x_{n e w} y_{n e w} = 1 x_{o l d} + 2 y_{o l d} = 3 x_{o l d} + 4 y_{o l d}

(54)

which can be written in matrix form as:

[x_{n e w} y_{n e w}] = [1324] [x_{o l d} y_{o l d}]

(55)

and so if we set:

M = [1324]

(56)

we have:

x_{n e w} = M x_{o l d}

(57)

The usual question then is: given a vector in the new basis, how do we represent it in the old basis?

The answer is that we simply have to calculate the matrix inverse of

M

x_{o l d} = M^{- 1} x_{n e w}

(58)

That

M^{- 1}

is the matrix inverse.

Change of basis between symmetric matrices

words: 23

When we have a symmetric matrix, a change of basis keeps symmetry iff it is done by an orthogonal matrix, in which case:

N = B M B^{- 1} = O M O^{T}

(59)

Linear independence

Classification of vector spaces

en.wikipedia.org/wiki/Dimension_(vector_space)#Facts

Underlying field of a vector space

words: 74

Every vector space is defined over a field.

E.g. in

R^{3}

, the underlying field is

R

, the real numbers. And in

C^{2}

the underlying field is

C

, the complex numbers.

Any field can be used, including finite field. But the underlying thing has to be a field, because the definitions of a vector need all field properties to hold to make sense.

Elements of the underlying field of a vector space are known as scalar.

Tensor product ( $\otimes$ )

 Tagged

Tensor product in quantum computing

Vector (mathematics)

words: 27 articles: 1

Scalar (mathematics)

words: 27

A member of the underlying field of a vector space. E.g. in

R^{3}

, the underlying field is

R

, and a scalar is a member of

R

, i.e. a real number.

Tensor

words: 694 articles: 17

A multilinear form with a domain that looks like:

V^{m} \times V *^{n} \to R

(60)

where

V *

is the dual space.

Because a tensor is a multilinear form, it can be fully specified by how it act on all combinations of basis sets, which can be done in terms of components. We refer to each component as:

T_{i_{1} \dots i_{m}}^{j_{1} \dots j_{n}} = T (e_{i_{1}}, \dots, e_{i_{m}}, e^{j_{1}}, \dots, e^{j_{m}})

(61)

where we remember that the raised indices refer dual vector.

Some examples:

Levi-Civita symbol as a tensor
a linear map is a (1,1) tensor

 Tagged

Levi-Civita symbol as a tensor

A linear map is a (1,1) tensor

words: 51

A linear map

A

can be seen as a (1,1) tensor because:

T (w, v *) = v * A w

(62)

is a number,

v *

. is a dual vector, and W is a vector. Furthermoe,

T

is linear in both

v *

and

w

. All of this makes

T

fullfill the definition of a (1,1) tensor.

Tensor space ( $T^{(m, n)}$ )

words: 7 articles: 1

Bibliography:

mathworld.wolfram.com/TensorSpace.html

Order of a tensor

words: 6

T^{(m, n)}

has order

(m, n)

Einstein notation (Einstein summation convention)

words: 562 articles: 13

The Wikipedia page of this article is basically a masterclass why Wikipedia is useless for learning technical subjects. They are not even able to teach such a simple subject properly there!

Bibliography:

www.maths.cam.ac.uk/postgrad/part-iii/files/misc/index-notation.pdf gives a definition that does not consider upper and lower indexes, it only counts how many times the indices appear
Their definition of the Laplacian is a bit wrong as only one $i$ appears in it, they likely meant to have written $\frac{\partial}{\partial x _{i}} \frac{\partial F}{\partial x _{i}}$ instead of $\frac{\partial ^{2} F}{\partial x _{i}^{2}}$ , related:

Raised and lowered indices

words: 72 articles: 3

TODO what is the point of them? Why not just sum over every index that appears twice, regardless of where it is, as mentioned at: www.maths.cam.ac.uk/postgrad/part-iii/files/misc/index-notation.pdf.

Vectors with the index on top such as

x^{i}

are the "regular vectors", they are called covariant vectors.

Those in indices on bottom are called contravariant vectors.

It is possible to change between them by Raising and lowering indices.

The values are different only when the metric signature matrix is different from the identity matrix.

E.g., in a context considering the common Minkowski inner product matrix where the

η

4x4 matrix and

μ

is a vector in

R^{4}

x^{μ} x_{μ} = x^{μ} η_{μ ν} x^{ν} = - x_{0}^{2} + x_{1}^{2} + x_{2}^{2} + x_{3}^{2};

(63)

which leads to the change of sign of some terms.

Einstein notation for partial derivatives

words: 352 articles: 4

The Einstein summation convention works will with partial derivatives and it is widely used in particle physics.

In particular, the divergence and the Laplacian can be succintly expressed in this notation:

Section "Divergence in Einstein notation ( $\partial_{i}$ )"
Section "Laplacian in Einstein notation ( $\partial_{i} \partial^{i}$ )"

In order to expresse partial derivatives, we must use what Ciro Santilli calls the "partial index partial derivative notation", which refers to variales with indices such as