The time when the right of Judgment is handed onto the Elders [Saints] is given by John as the binding of Satan, and just before the Millennium.
Revelation 20:4
"I saw Thrones, and they [the First Resurrection Saints - Elders] sat upon them, and Judgment was given unto them."