Andrej Karpathy是OpenAI联合创始人，已加入Anthropic的预训练团队。预训练是训练Claude模型核心知识的关键阶段，也是构建前沿模型中最昂贵和计算密集的环节之一。
Pre-training is responsible for the large-scale training runs that give Claude its core knowledge and capabilities, according to the company. It's also one of the most expensive, compute-intensive phases of building a frontier model.