About the Role
About the Opportunity
This opportunity is for experienced Software Engineers with expertise in Python, Java, C++, Rust, Go, TypeScript, algorithms, and large-scale software development to contribute to advanced AI research and evaluation projects. You'll apply your engineering expertise to create realistic software engineering environments that help evaluate and improve the capabilities of next-generation AI systems.
No prior AI experience is required. Your software engineering expertise and problem-solving skills are the primary qualifications for success in this role. Engineers with strong backgrounds in debugging, feature development, codebase refactoring, performance optimization, and distributed systems are especially encouraged to apply.
Responsibilities
- Design and develop Reinforcement Learning (RL) environments that evaluate AI systems on real-world software engineering tasks.
- Create engineering challenges involving bug fixing, feature implementation, code refactoring, and performance optimization.
- Build reproducible testing environments and deterministic evaluation frameworks for software engineering tasks.
- Develop golden reference solutions and validation mechanisms to measure AI performance accurately.
- Apply expertise in algorithms, data structures, and software architecture to create complex engineering scenarios.
- Evaluate AI-generated code for correctness, maintainability, efficiency, and scalability.
- Utilize Model Context Protocol (MCP) tools and real-world software systems to design realistic problem-solving environments.
- Collaborate with technical teams to improve AI reasoning, coding ability, and software engineering performance.
Required Qualifications
- Strong proficiency in at least one of the following languages: Python, Java, C++, Rust, Go, or TypeScript.
- Deep understanding of algorithms, data structures, system design, and performance optimization.
- Demonstrated experience debugging complex software issues and delivering maintainable solutions.
- Strong background in feature development, software architecture, and codebase refactoring.
- Experience optimizing applications for performance, scalability, and reliability.
- Excellent analytical, problem-solving, and technical communication skills.
- Strong attention to detail and ability to work independently in a remote environment.
Preferred Qualifications
- Bachelor's degree or higher in Computer Science, Software Engineering, or a related technical field.
- Experience working with large-scale, distributed systems and complex production codebases.
- Strong understanding of software testing, CI/CD pipelines, and engineering best practices.
- Experience participating in code reviews and maintaining high engineering quality standards.
- Familiarity with AI, machine learning, LLMs, or AI-assisted development tools.
- Experience designing technical assessments, coding challenges, or engineering evaluation frameworks.
- Experience collaborating with distributed or remote engineering teams.
Compensation
- Competitive compensation of $50–$150/hour.
- Weekly payments.
- Independent contractor engagement.
Requirements
Proficiency in programming languages
Strong proficiency in at least one of Python, Java, C++, Rust, Go, or TypeScript is required.
Algorithms and data structures
A deep understanding of algorithms, data structures, system design, and performance optimization is essential.
Debugging experience
Demonstrated experience debugging complex software issues and delivering maintainable solutions is necessary.
Feature development
A strong background in feature development, software architecture, and codebase refactoring is required.
Nice to Have
A Bachelor's degree or higher in Computer Science, Software Engineering, or a related technical field is preferred.
Experience working with large-scale, distributed systems and complex production codebases is a plus.
Familiarity with AI, machine learning, LLMs, or AI-assisted development tools is advantageous.
Benefits
Competitive compensation
Offers competitive compensation of $50–$150/hour.
Weekly payments
Employees receive weekly payments.
Independent contractor engagement
The role is structured as an independent contractor engagement.