I beat him the first time I saw him, with Oblivion. I actually didn't have that hard of a time with him.
Because of this, I was confused by this thread.
Until today when I was chock-full of points, my cheats were all set to the hardest level, and he came around a corner and devastated me in one hit.