Mediabistro logo
job logo

SaidGig is hiring: Basque Audio Evaluator for AI Research in United States

SaidGig · Multiple locations ·

Job type:
Full Time

Contribute to a high-impact audio AI research project as a Basque Audio Generalist Evaluator Expert. This role involves transcription, annotation, and evaluation tasks that are essential for training and benchmarking advanced language models. Ideal candidates will possess strong academic or analytical backgrounds, be fluent in Basque (Euskara) and English, and have a passion for translating complex audio and visual information into precise, well-structured text. Key Responsibilities

  • Transcribe and Optimize Audio & Video
    • Listen to, analyze, and transcribe audio and video content in Basque (Euskara), adhering to detailed constraints and instructions.
    • Produce high-quality written outputs in Basque, with supporting work in English when necessary.
    • Ensure clarity, accuracy, and strict adherence to formatting and stylistic guidelines.
    • Capture nuances such as tone, intent, formal vs. informal register, dialectal variations, regional expressions, and contemporary Basque usage where relevant.
  • Define and Document Evaluation Standards
    • Establish clear expectations for correct and high-quality responses in general consumer audio contexts.
    • Develop detailed evaluation rubrics and grading guidelines in Basque and English.
    • Document standards to ensure consistency across reviewers and model evaluations.
    • Identify linguistic nuances, grammatical complexities, dialectal differences, colloquialisms, and edge cases specific to Basque.
  • Conduct Model Testing and Grading
    • Run prompts through language models and assess generated outputs.
    • Evaluate responses against predefined criteria for accuracy, completeness, fluency, and instructional clarity.
    • Provide structured feedback to improve model performance in Basque audio tasks.
  • Support Benchmarking and Quality Assurance
    • Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet quality standards.
    • Maintain consistency and reliability before datasets are integrated into official benchmarks.
    • Collaborate with project leads to resolve ambiguities and improve task design.
Qualifications
  • Minimum Qualifications
    • Strong writing, editing, and critical thinking skills.
    • Ability to work independently, manage time effectively, and meet deadlines.
    • Native or near-native fluency in Basque (spoken and written) and professional fluency in English.
    • Strong familiarity with spoken Basque, regional vocabulary, dialects (euskalkiak), and contemporary language usage.
    • Ability to accurately transcribe and analyze Basque audio content across general consumer contexts.
    • Available to commit 10, 20 hours per week.
  • Preferred Qualifications
    • College students or recent graduates.
    • Background in linguistics, humanities, social sciences, journalism, translation/localization, or technical disciplines.
    • Prior experience with transcription, annotation, localization, evaluation, or research workflows in Basque.
    • Familiarity with differences between Standard Basque (Euskara Batua) and regional dialects.
    • Interest in AI, language models, or applied research environments.
Work Terms

Hourly engagement, requiring a commitment of 10, 20 hours per week.

Compensation

Hourly rate of $50.

Eligibility

Fluency in Basque and English is required. Candidates must be able to work remotely.