Change matrix (and any other) allocation/member from:
double[][]
to:
double[] OR double[,]
and handle indexing etc internally. Not having matrix data as one continuous memory area is not a good thing for e.g. interop. Additionally, allocation is a lot slower for many rows.