From then on Pilate sought to release him, but the Jews cried out, “If you release this man, you are not Caesar's friend. Everyone who makes himself a king opposes Caesar.”
John 19:12

Pilate was on a sort of probation with Caesar because he had repeatedly antagonized the Jews into rebellion. In saying, "You are not Caesar's friend", they were threatening his relationship with Caesar and therefore his position as governor.