Studies of Z gamma production in association with a high-mass dijet system in pp collisions at root s=8 TeV with the ATLAS detector