According to media reports, the actor wanted to change the very “fabric of the film”