If your wetsuit has such a inner layer, just patch the outer layer and don't bother patching the inner layer - it won't stick to that type of non-standard, non-shiny, non-smooth fabric. Tape can't stick to non-smooth textured fabrics because it can't get a firm hold into the little pores and ridges of non-smooth textured fabrics.
eBay