AI Content Analyst in RUSSIAN Language
Gramian Consulting Group, Poland, NY, United States
Role Overview
We are looking for RUSSIAN-speaking AI Content Analysts to support evaluation of a new personalization capability within a leading AI assistant platform.
In this role, you will design realistic conversational prompts based on your own context and experiences, then rigorously evaluate how effectively the AI uses personal signals (such as prior conversations or activity context) to produce relevant, grounded, and helpful responses.
This position combines creative prompt design, analytical evaluation, and structured quality assessment , making it ideal for candidates with experience in AI evaluation, annotation, content review, or analytical research roles.
Responsibilities
Design and run short multi-turn conversations (typically 1–5 turns) intended to test AI personalization behavior
Create prompts grounded in realistic personal scenarios to evaluate contextual understanding
Review AI responses to determine whether personalization is correctly applied
Check grounding quality to ensure the model does not invent unsupported claims about the user
Evaluate integration quality — confirming personal signals are used naturally (not forced or robotic)
Compare two responses side‑by‑side and determine which is more helpful, natural, and relevant
Write clear, structured rationales explaining rankings and referencing specific conversation turns
Verify debug information showing whether correct data sources were used
Maintain strict workflow hygiene (including deleting evaluation conversations when required)
Notes
The role is 100% remote, but you MUST be residing in POLAND
30-40 hours/week commitment. Paid by hours logged and approved.
Contracting Model
Duration: 1 month (possible extension)
Qualifications
Strong RUSSIAN proficiency (reading & writing required) — RUSSIAN is the primary evaluation language
BS/BA degree or equivalent experience in a relevant field (e.g., Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or a related analytical field)
Strong analytical thinking and ability to assess nuanced AI outputs
Excellent written communication skills with ability to produce structured evaluation notes
High attention to detail when comparing similar responses
Ability to work independently in a fully remote environment
Reliable desktop/laptop and stable internet connection
Willingness to use your primary personal Google account and enable personal data sources for evaluation purposes
#J-18808-Ljbffr
We are looking for RUSSIAN-speaking AI Content Analysts to support evaluation of a new personalization capability within a leading AI assistant platform.
In this role, you will design realistic conversational prompts based on your own context and experiences, then rigorously evaluate how effectively the AI uses personal signals (such as prior conversations or activity context) to produce relevant, grounded, and helpful responses.
This position combines creative prompt design, analytical evaluation, and structured quality assessment , making it ideal for candidates with experience in AI evaluation, annotation, content review, or analytical research roles.
Responsibilities
Design and run short multi-turn conversations (typically 1–5 turns) intended to test AI personalization behavior
Create prompts grounded in realistic personal scenarios to evaluate contextual understanding
Review AI responses to determine whether personalization is correctly applied
Check grounding quality to ensure the model does not invent unsupported claims about the user
Evaluate integration quality — confirming personal signals are used naturally (not forced or robotic)
Compare two responses side‑by‑side and determine which is more helpful, natural, and relevant
Write clear, structured rationales explaining rankings and referencing specific conversation turns
Verify debug information showing whether correct data sources were used
Maintain strict workflow hygiene (including deleting evaluation conversations when required)
Notes
The role is 100% remote, but you MUST be residing in POLAND
30-40 hours/week commitment. Paid by hours logged and approved.
Contracting Model
Duration: 1 month (possible extension)
Qualifications
Strong RUSSIAN proficiency (reading & writing required) — RUSSIAN is the primary evaluation language
BS/BA degree or equivalent experience in a relevant field (e.g., Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or a related analytical field)
Strong analytical thinking and ability to assess nuanced AI outputs
Excellent written communication skills with ability to produce structured evaluation notes
High attention to detail when comparing similar responses
Ability to work independently in a fully remote environment
Reliable desktop/laptop and stable internet connection
Willingness to use your primary personal Google account and enable personal data sources for evaluation purposes
#J-18808-Ljbffr