Remote | E-Commerce Model Prompt Evaluator — $35–$50/hour
24-MAG, San Francisco, CA, United States
We are sharing a specialised part‑time consulting opportunity for experienced e‑commerce professionals with strong commercial judgement, analytical thinking, and the ability to author and verify high‑quality open‑ended prompts for AI model evaluation. This role supports an exciting collaboration with leading AI companies focused on improving frontier language models through high‑quality prompt authoring, verification, and evaluation workflows across core e‑commerce and performance marketing domains.
Prompt Authoring for AI Evaluation
Create original, open‑ended e‑commerce prompts from assigned subdomains at varying difficulty levels
Develop prompts that require human judgment to evaluate the quality of AI responses
Help ensure that prompts are clear, practical, and suitable for model evaluation
Prompt Verification & Quality Review
Review authored prompts for clarity, scope alignment, difficulty accuracy, and uniqueness
Edit prompts and difficulty ratings where needed
Help maintain high standards for precision, quality, and consistency across evaluation tasks
E‑Commerce Reasoning Assessment
Apply expert judgment to assess the depth and quality of e‑commerce reasoning required
Work across areas such as strategic analysis, campaign design, pricing decisions, and data‑driven commercial reasoning
Help improve model quality through carefully designed and verified business prompts
Ideal Profile
A Master's degree or higher in Business, Marketing, Economics, Data Science, or a closely related field
2–6 years of professional experience in e‑commerce, digital marketing, retail analytics, or a related field
Strong understanding of pricing strategy, sales funnel analytics, and performance marketing
Excellent written English and ability to craft precise, well‑scoped technical questions
Preferred Qualifications
Experience with platforms such as Amazon Seller Central, Shopify, or major advertising platforms
Strong familiarity with e‑commerce subdomains such as pricing, sales analytics, digital marketing, customer acquisition, retention, and campaign management
High attention to detail and strong consistency in technical evaluation workflows
Ability to edit prompts and difficulty assignments with sound business judgment
Contract Details
Independent contractor role
Fully remote with flexible scheduling
Hourly compensation of $35–$50 per hour
Expected commitment of 10+ hours per week
Asynchronous work format
Assignments may involve either authoring or verification tasks depending on project needs
Projects may be extended, shortened, or concluded early depending on project needs and performance
Weekly payments via Stripe or Wise
Work will not involve access to confidential or proprietary information from any employer, client, or institution
Unable to support H1‑B or STEM OPT candidates at this time
Start date: Immediate
#J-18808-Ljbffr
Prompt Authoring for AI Evaluation
Create original, open‑ended e‑commerce prompts from assigned subdomains at varying difficulty levels
Develop prompts that require human judgment to evaluate the quality of AI responses
Help ensure that prompts are clear, practical, and suitable for model evaluation
Prompt Verification & Quality Review
Review authored prompts for clarity, scope alignment, difficulty accuracy, and uniqueness
Edit prompts and difficulty ratings where needed
Help maintain high standards for precision, quality, and consistency across evaluation tasks
E‑Commerce Reasoning Assessment
Apply expert judgment to assess the depth and quality of e‑commerce reasoning required
Work across areas such as strategic analysis, campaign design, pricing decisions, and data‑driven commercial reasoning
Help improve model quality through carefully designed and verified business prompts
Ideal Profile
A Master's degree or higher in Business, Marketing, Economics, Data Science, or a closely related field
2–6 years of professional experience in e‑commerce, digital marketing, retail analytics, or a related field
Strong understanding of pricing strategy, sales funnel analytics, and performance marketing
Excellent written English and ability to craft precise, well‑scoped technical questions
Preferred Qualifications
Experience with platforms such as Amazon Seller Central, Shopify, or major advertising platforms
Strong familiarity with e‑commerce subdomains such as pricing, sales analytics, digital marketing, customer acquisition, retention, and campaign management
High attention to detail and strong consistency in technical evaluation workflows
Ability to edit prompts and difficulty assignments with sound business judgment
Contract Details
Independent contractor role
Fully remote with flexible scheduling
Hourly compensation of $35–$50 per hour
Expected commitment of 10+ hours per week
Asynchronous work format
Assignments may involve either authoring or verification tasks depending on project needs
Projects may be extended, shortened, or concluded early depending on project needs and performance
Weekly payments via Stripe or Wise
Work will not involve access to confidential or proprietary information from any employer, client, or institution
Unable to support H1‑B or STEM OPT candidates at this time
Start date: Immediate
#J-18808-Ljbffr