LLM/ ML Researcher

Job Description
Opportunities may be available from time to time in any location in which the business is based for suitable candidates. If you are interested in a career with Citadel, please share your details and we will contact you if there is a vacancy available.
Key Responsibilities:
• Conduct cutting-edge research and development in machine learning, with a focus on large language models (LLMs) and their applications in quantitative finance.
• Design, implement, and optimize machine learning models for performance and scalability, particularly in financial contexts.
• Collaborate with cross-functional teams to integrate ML solutions into business processes and trading strategies.
Skillset Requirements:

• Proficiency in creating and using algorithms to meticulously investigate and work through large data or error-checking problems
• Deep knowledge of LLM architectures, including transformers.
• Familiarity with attention mechanisms, normalization techniques, and model architecture design.
• Training techniques (pre-training, fine-tuning, RLHF), and optimization methods.
• Understanding of low-level details like GPU memory management, precision types (float16, bfloat16), and parallelization techniques.
• Proficiency in advanced training techniques such as pre-training, fine-tuning, RLHF, and DPO.
• Expertise in Python and ML frameworks like PyTorch or TensorFlow.
• Familiarity with Retrieval Augmented Generation (RAG) systems and their implementation.
• Proven ability to approach open-ended problems and design end-to-end solutions in ML/AI.
• Strong mathematical and statistical foundations, particularly in areas relevant to quantitative finance.

About Citadel Securities
Citadel Securities is the next-generation capital markets firm and a leading global market maker. We provide institutional and retail investors with the liquidity they need to trade a broad array of equity and fixed income products in any market condition. The brightest minds in finance, science and technology use powerful, advanced analytics to solve the market's most critical challenges, turning big ideas into real-world outcomes.