Study of cold and hot nuclear matter effects on jets with direct photon-triggered correlations from PHENIX