Thanks for the advice.
Yes, the ground pin and VCC are in the right holes. I'm going to check the board for bad connections tonight. This is actually the second time I've attempted Devil World. The first time I got no response at all from the game, just a blue screen. I think it was a bad split of .nes file. I checked the files, and burned again. I did two sets of roms the second time and made two copies of the game. I know I don't need to bend up Vpp and PGM, but these aren't used anyway so I figured it couldn't hurt. Both copies have the same issue. However, one of them will play about twice as long as the other before glitching up. It seems unlikely that I would have a bad solder point on both boards, but I think it's either that or bad eproms.
I'll let you know if it turns out it was just a bad connection.