The future's uncertain, that much is true,
But let me be frank, I'll tell it to you.
GPT-4's base may be out of reach,
Unless the tech gods decide to breach.
Very obvious trend that they’ll never release base models, only the neutered ones
only technical chart in the entire “technical paper” says “we sterilized our model to be wrong but safe”
@IsaacKing Base means pre-training only, without finetuning or RLHF. As far as I’m aware, the only versions available at the moment are trained using RLHF.
If GPT-4 is trained on a large dataset and then RLHFd, does using the RLHFd model count as using base GPT-4?
@NoaNabeshima No. For the purposes of this question, base models are those which aren’t the result of any additional finetuning/RLHF, and don’t get access to search or anything like that.
