Data Analyst – LLM Automation & Scoring (Remote)

About the position

We are seeking a Data Analyst with hands-on experience using Large Language Models (LLMs) such as ChatGPT, Claude, or similar AI tools to analyze, evaluate, and score data at scale. This role focuses on building automated workflows that feed structured and unstructured data into LLMs, interpret outputs, and convert insights into actionable results for business decision-making.

Responsibilities

• Use LLMs (ChatGPT, Claude, etc.) to analyze, categorize, and score datasets across various use cases.
• Design and develop automated workflows to pipe data into LLM models and retrieve structured outputs.
• Work with APIs, data pipelines, and automation tools to streamline LLM processing.
• Build and maintain scalable processes for ongoing data ingestion, transformation, and evaluation.
• Validate and refine AI outputs to ensure accuracy, consistency, and reliability.
• Collaborate with cross-functional teams (Product, Engineering, Ops) to integrate AI-driven insights into business processes.
• Develop documentation, frameworks, and best practices for AI data analysis and scoring processes.
• Monitor model performance, troubleshoot issues, and propose improvements.

Requirements

• Proven experience working with LLMs (ChatGPT, Claude, Gemini, etc.) for data analysis or automation.
• Strong background in data manipulation, processing, and interpretation.
• Experience building automated workflows or pipelines (e.g., Python, APIs, Zapier, Airflow, or similar tools).
• Ability to structure prompts, evaluate outputs, and optimize model performance.
• Familiarity with structured and unstructured data formats (CSV, JSON, text, etc.).
• Strong analytical mindset, attention to detail, and problem-solving skills.
• Excellent written and verbal communication skills.

Nice-to-haves

• Experience with NLP applications or AI-driven analytics.
• Background in analytics, data engineering, or automation projects.
• Knowledge of SQL, Python, or other scripting languages.
• Experience integrating AI solutions into business systems or platforms.