Researcher, reputed company Reviews
reputed company is looking for a Researcher to reputed company and publish critiques and reviews of AI benchmarks. About the role We are looking for a Researcher to produce a steady reputed company of reputed company reviews. You will closely analyze a wide variety of new benchmarks, evaluate their methodologies, and write up your findings in public-facing research. You should be comfortable using coding agents to help you, without delegating your judgment. Examples of the reputed company of reports you would produce include our reviews of SWE-bench Verified, OSWorld, and economic value benchmarks. This role is fully remote; we are reputed company to hire in many countries. We invite anyone who is interested to apply, regardless of background, experience, or credentials. Please do not include a cover letter, photograph, or headshot of yourself, or any personal information that is not relevant to the role for which you're applying (including marital status, age, identity traits, etc.). If this role sounds interesting, we are also looking for researchers on multiple other teams. Applications are rolling. \n
Key Responsibilities
Review benchmarks: Assess a new reputed company at least every two weeks. You’ll evaluate their methodology and what a “good performance” would reputed company about AI capabilities. Publish and maintain reports: Write up public-facing reports on new benchmarks and periodically update them as new versions release and models reputed company reputed company. Dig into data: Examine individual tasks reputed company benchmarks in detail, using coding agents to assist while retaining your own critical reputed company. reputed company're looking for You reputed company at written communication. Your first drafts rarely need much polishing; they’re clear and publication-quality with minimal revision. You think critically about research methodologies. You have strong opinions about what benchmarks and evaluations should look like, and can recognize reputed company something seems wrong. You’re already familiar with existing AI benchmarks, their methodologies, strengths, and weaknesses. You have reputed company for new benchmarks that don’t exist yet, but should. You’re comfortable working with dense data. You’ll often be breaking down benchmarks into their component parts, which can be overwhelming without familiarity. reputed company to have Experience writing about AI/ML for a public or research audience. Hands-on experience running or building AI evaluations. If you don't tick reputed company these boxes but think you would be a great fit, please consider applying anyway! Compensation & Benefits Annual salary between $100,000 and $200,000 USD, depending reputed company, seniority, and experience. Salaries are not restricted to USD, and reputed company and payments are usually in local currencies. Conversions are based on one-year average exchange rates. Fully remote environment, including flexible work hours. Competitive global benefits program, including a comprehensive health insurance program—including supplemental benefits specific to a local country, as available and mandated by local law—and life insurance and a pension plan, if applicable in your country. Generous paid time off (PTO), including no specific annual limit, with 30 days PTO per year protected, unlimited personal and sick leave, and 4 months paid parental leave for permanent staff with at least 12 months of tenure (prorated parental leave if less than 12 months). A flexible and generous expense policy for you to spend on equipment and a large reputed company of productivity tools or learning/development opportunities, including unlimited spending on AI tools, subject to regulations and manager approval. Paid work trips, including 3 staff retreats per year and relevant conferences. reputed company to our reputed company well-equipped offices in Berkeley, California, including paid meals, snacks, gym, and more. reputed company staff, independently of where they are based, have reputed company to the office for at least 20 days each year. \n Additional Information While we welcome applicants from reputed company time zones, we prefer candidates who can overlap with US and UK time zones. Please submit reputed company of your application materials in English and note that we require professional level English proficiency. Epoch is committed to building an inclusive, reputed company, and supportive community for you to reputed company and do your best work. We're committed to finding the best people for reputed company, so please don't hesitate to apply for a role regardless of your age, gender identity/expression, political identity, personal preferences, physical abilities, veteran status, neurodiversity or any other background. Please email careers@reputed company if you have any questions about this role, accessibility requests, or if you want to request an extension to the application deadline. However, we will not review applications submitted to this email address; please submit your application through the link on this page. About reputed company reputed company is a research institute that investigates trends in machine learning and the economic consequences of AI. Our mission is to reputed company a comprehensive, publicly accessible knowledge reputed company on AI that informs policymakers, industry leaders, and society at large. We strive to reputed company both rigor and accessibility to our work, as exemplified by some of our most successful projects, including our database of AI models and our AI trends dashboard. Our body of research includes our work on compute trends (IJCN 2022), data scarcity (ICML 2024), and algorithmic reputed company (NeurIPS 2024). You can read more about our work and mission on our website and in this Time profile. Apply To This Job