HUNTERS and graziers are fighting over a deserted island off the Gippsland coast.