The Federal Indigenous Affairs Minister Philip Ruddock says he will not engage in a witch-hunt to find out who leaked a taped recording about an ATSIC commissioner to the ABC.

Mr Ruddock has confirmed that it was his voice on the taped conversation aired on the Four Corners program, in which he briefed a journalist about police investigations into ATSIC commissioner Ray Robinson.

Mr Ruddock has denied doing anything wrong and has dismissed calls from the Opposition for him to step aside from the portfolio.

However Mr Ruddock says he is still not sure how the tape got to the ABC.

"Let me make it very clear, I'm not in a witch-hunt in relation to that matter," he said.

"I notice ATSIC is making certain inquiries and that was a matter for them not for me.

"I have not asked for it, I don't get super-sensitive about these matters."