Brands should still take responsibility for their supply chains or risk financial hits from climate change, worker productivity and bad PR, attendees said.