>thinking about if it would be possible to interface a whole IR keyboard
Yes, this is very possible. But it would also require including console support in the kernel, and implementing a text-mode framebuffer driver (not too hard, most of the code is already in hijack).
If I had an IR keyboard here, it would probably appear as a hijack feature in very short order..