Regarding faulty wiring?

Recently I had my flat rewired by a qualified electrician. Everything is OK with the exception in one area. There are three four plugs installed in the room. Even after switching off the plugs, the tester shows presence of electricity, if it is put inside the plug hole (most probably the negative hole). Is this dangerous, because I am using a geyser from one of the plugs.