Analyze GitHub issues and evaluate LLM performance in real-world code. About the Role: We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project.
About the role
Analyze GitHub issues and evaluate LLM performance in real-world code. About the Role: We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality
Why Join Us? Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. You’ll be at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This is a unique opportunity to blend practical software engineering with AI research.
What does day-to-day look like :
Analyze and triage GitHub issues across trending open-source libraries.
Set up and configure code repositories, including Dockerization and environment setup.
Evaluating unit test coverage and quality.
Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Opportunities to lead a team of junior engineers to collaborate on projects.
Required Skills:
Minimum 3+ years of overall experience
Strong experience with at least one of the following languages: C++
Proficiency with Git, Docker, and basic software pipeline setup.
Ability to understand and navigate complex codebases.
Comfortable running, modifying, and testing real-world projects locally.
Experience contributing to or evaluating open-source projects is a plus.
Nice to Have:
Previous participation in LLM research or evaluation projects.
Experience building or testing developer tools or automation agents.
Perks of Freelancing With Turing:
Work in a fully remote environment.
Opportunity to work on cutting-edge AI projects with leading LLM companies.
Offer Details: …
Posted 3 times
Turing posted this role 3 times, usually once per city or country. We show it once. The pay shown covers all of them.
Official source: work.turing.com. Details can change; the platform's page is the final word. How we check listings.
