CoPilot has been demonstrated to lift code verbatim (including swearing comments): https://twitter.com/mitsuhiko/status/1410886329924194309

So even if it is legal to create a commercial product which outputs GPL code as its main value-add, it still seems like it could put the user in an awkward position of auto-completing big chunks of GPL licensed code into their project.