It's a bit wasteful to invert just to take the 2-norm afterwards. Instead, recall that the 2-norm of $\mathbf A^{-1}$ is the reciprocal of the smallest singular value of $\mathbf A$, which is about the same amount of effort as computing the 2-norm (largest singular value) of $\mathbf A$. To accentuate the positions of the singularities (i.e. the eigenvalues), you can then take a logarithm:
mat = SparseArray[ToeplitzMatrix[UnitVector[5, 5], UnitVector[5, 2]]];
Plot3D[-Log[First[SingularValueList[SparseArray[Band[{1, 1}] -> x + I y, {5, 5}] - mat,
-1, Tolerance -> 0]]], {x, -2, 2}, {y, -2, 2},
BoxRatios -> Automatic, ClippingStyle -> None,
ColorFunction -> (ColorData["SolarColors", #3] &)]

(I also use this identity in this answer involving the $\varepsilon$-pseudospectrum.)
It should perhaps also be noted that Embree's example also happens to be the companion matrix of the polynomial $z^5-1$, which should explain why the eigenvalues are arranged that way.
A
like this:A=RotateLeft[IdentityMatrix[5]]
. $\endgroup$