A useless non-RIP Gaussian matrix

Recently, for some unrelated reasons, I discovered that it is actually very easy to generate a Gaussian matrix Φ that does not respect the restricted isometry property (RIP) [1]. I recall that such a matrix is RIP if  there exists a (restricted isometry) constant 0<δ<1 such that, for any K-sparse vector wRN,

(1δ)w2Φw2(1+δ)w2.

This is maybe obvious and it probably serves to nothing but here is anyway the argument.

Take a K-sparse vector x in R and generate randomly two Gaussian matrices U and V in RM×N with i.i.d. entries drawn from N(0,1). From the vectors a=Ux and b=Vx, you can form two new vectors c and s such that ci=ai/ai2+bi2 and si=bi/ai2+bi2. Then, it is easy to show that matrix \Phi = {\rm diag}(c) V - {\rm diag}(s)U\qquad(1)&s=2 is actually Gaussian except in the direction of x (where it vanishes to 0). This can be seen more clearly in the case where x=(1,0,,0)T. Then the first column of Φ is 0 and the rest of the matrix is independent of diag(c) and diag(s). Conditionally to the value of these two diagonal matrices, this part of Φ is therefore Gaussian with each ij entry (j2) of variance ci2+si2=1. Then, the condition can be removed by expectation rule to lead to the cdf of Φ, and then to the pdf by differentiation, recovering the Gaussian distribution in the orthogonal space of x. However, Φ cannot be RIP. First, obviously since Φx=0 which shows, by construction, that at least one K-sparse vector (that is, x) is in the null space of Φ. Second, by taking vectors in x+ΣK=x+{u:u0K}, we clearly have Φ(x+u)=Φu for any uΣK. Therefore, we can alway take the norm of u sufficiently small so that Φ(x+u) is far from x+u. Of course, for the space of K-sparse vectors orthogonal to x, the matrix is still RIP. It is easy to follow the argument above for proving that Φ is Gaussian in this space and then to use classical RIP proof [2]. All this is also very close from the “Cancel-then-Recover” strategy developed in [3]. The only purpose of this post to prove the (useless) result that combining two Gaussian matrices as in (1) leads to a non-RIP matrix. References: [1] Candes, Emmanuel J., and Terence Tao. “Decoding by linear programming.” Information Theory, IEEE Transactions on 51.12 (2005): 4203-4215. [2] Baraniuk, Richard, et al. “A simple proof of the restricted isometry property for random matrices.” Constructive Approximation 28.3 (2008): 253-263. [3] Davenport, Mark A., et al. “Signal processing with compressive measurements.” Selected Topics in Signal Processing, IEEE Journal of 4.2 (2010): 445-460.

Laurent Jacques
Laurent Jacques
FNRS Senior Research Associate and Professor