GENERATIVE AI SOFTWARE ENGINEER - Global Investment Firm
1 day ago
New York
Job Description GENERATIVE AI SOFTWARE ENGINEER - Global Investment Firm J Harlan Group is currently conducting a search for a GENERATITIVE AI SOFTWARE ENGINEER at a prominent Global Investment Firm in NYC. Technology is foundational to everything this firm does. They are seeking exceptional engineers with a strong computer science background and hands-on experience building Generative AI systems. As a Software Developer specializing in GenAI, you will design and develop the firm's next generation of generative AI applications and underlying infrastructure—helping make AI accessible, reliable, and impactful for both technical and non-technical users across the organization. You will work alongside highly talented engineers, quants, and domain experts to create advanced, data-intensive AI systems. This is a role for individuals who enjoy building real, production-grade AI/ML systems, experimenting with cutting-edge technologies, and influencing the adoption of generative AI at scale. The firm values individuals who are agile, intellectually curious, creative, and hands-on, and who thrive in a fast-paced, collaborative environment. PRINCIPAL RESPONSIBILITIES: As a Generative AI Software Engineer, you will help design, build, and scale the firm's GAI capabilities. Responsibilities include: Core GenAI Engineering • Develop and maintain shared generative AI infrastructure, including internal LLM platforms, AI orchestration layers, and firm-wide tools enabling safe, scalable model usage., • Build foundational components such as vector databases, embedding pipelines, LLM gateways, evaluation frameworks, and retrieval systems to support AI-powered applications across the firm., • Work on greenfield GenAI applications, from concept to prototype to production deployment, tailored to internal users such as researchers, technologists, investment teams, and operations groups., • Prototype and evaluate new models, techniques, and frameworks—such as RAG, multi-agent systems, and model-to-model orchestration—and collaborate with colleagues to determine where they can create real business value., • Partner closely with engineering teams, quants, operations, and business stakeholders to understand workflows and design AI solutions aligned with firm needs. The ideal candidate combines excellence in software engineering with a deep interest in AI/ML and a practical, experimental approach to generative AI. Technical Qualifications • Strong computer science fundamentals, including algorithms, systems, and data structures., • Hands-on experience with LLMs, embeddings, RAG pipelines, vector databases, or related GenAI systems., • Deep comfort building production-quality software in Python or other high-level languages., • Historically, successful developers at the firm have been top performers in their academic programs (CS, EE, Math, Physics, etc.)., • A “tinkerer's mindset”—curious, hands-on, eager to experiment with new models and techniques., • Thrives in a collegial, collaborative, fast-paced environment., • Strong ownership mentality: desire to build systems that matter, not just prototypes., • Excellent communication skills and the ability to work with diverse users—including traders, researchers, engineers, and investment professionals. An individual who loves solving deep and complex technical and business problems and wants to have an outsized impact with the services/ products they deliver. An individual with a passion for Generative AI, a high level of intellectual curiosity, a commitment to excellence and an unparalleled drive to deliver world-class services. If you or anyone in your network would be interested in this opportunity, please send resume to Jerry Goldberg at or directly contact us at (212) 792-0099 ABOUT THE CLIENT: The firm is a prominent multinational investment management firm. The company manages a variety of investment funds that make extensive use of quantitative methods and proprietary computational technology to support fundamental research in the management of its investments. They have a relentless focus on innovation and integration: innovation in new products, markets and businesses as well as new tools, models and technology management and performance structures; integration of fundamental research, quantitative strategies and technical analysis, all supported by an intensive focus on operational excellence and comprehensive risk management. The talent and dedication of their people is critical to their success. They offer an opportunity for developing one's professional career while working with individuals trained in a variety of disciplines in a collegial and dynamic environment. They offer a broad range of competitive benefits on a global basis. They seek candidates who are high-energy self-starters who want to join an investment management firm on the leading edge of the global markets. The management team needs individuals of the highest professional caliber w ho are leaders, problem solvers, analytic, detail-oriented, and entrepreneurial. Everyone at the firm works side-by-side with the firm's senior management in a highly collaborative and charged environment. Successful candidates are: • Analytic and relentless in pursuit of the right answer, • Strong communicators who excel at rapid synthesis, • Able to demonstrate sound business judgment, • Able to digest complexity while maintaining an understanding of the “big picture” of business needs SALARY RANGE: The expected annual base salary for this position is $200,000 to $250,000. Our compensation and benefits package includes variable compensation in the form of a year-end bonus, guaranteed in the first year of hire, and benefits including medical and prescription drug coverage, 401(k) contribution matching, wellness reimbursement, family building benefits, and a charitable gift match program. 'J Harlan Group, LLC' is an executive search and advisory firm specializing in recruiting for Financial Services, Management Consulting and Public Accounting companies. The organization is a global leader in professional staffing and consulting services working with major companies in the US and Global investment capitals around the world. Built by industry leaders to meet the talent demand needs for highly professional and specialized roles, J Harlan Group, LLC operates under the highest level of professional and quality standards providing a customized project approach for each client and search assignment.