This a Full Remote job, the offer is available from: United States, New York (USA)

We are sharing a specialised consulting opportunity for experienced GitHub professionals with strong hands-on expertise in Git, version control, repository management, pull requests, collaboration workflows, and CI/CD to contribute to an advanced AI training and workflow-evaluation project.

Selected professionals will complete realistic GitHub workflows, document technical steps, create evaluation prompts and rubrics, and review task outputs for accuracy. The role is designed for practitioners who can independently navigate GitHub and clearly explain the technical reasoning behind common version-control and collaboration processes.

Key Responsibilities

Repository & Version Control Workflows

• Complete assigned workflows directly within GitHub
• Create, edit, and manage repositories according to project instructions
• Work with branches, commits, merges, and other version-control operations
• Apply practical Git knowledge to realistic development scenarios
• Maintain accurate repository history and workflow execution

Pull Requests & Collaboration

• Create, review, and manage pull requests
• Navigate issues, comments, and collaborative project workflows
• Evaluate changes before merging and identify potential workflow problems
• Apply professional repository-management practices
• Support structured collaboration across common GitHub scenarios

GitHub Actions & CI/CD

• Work with GitHub Actions and related CI/CD workflows where required
• Review automated workflow behaviour and execution results
• Understand how repository events trigger automated processes
• Identify configuration or workflow issues affecting CI/CD tasks
• Apply practical judgement to common automation and integration scenarios

Workflow Recording & Documentation

• Record the screen while completing assigned GitHub workflows
• Clearly demonstrate each action taken during task execution
• Document workflow steps in a reproducible format
• Explain GitHub tools, features, and technical actions used
• Produce clear technical documentation supporting evaluation and review

Prompt, Rubric & Quality Evaluation

• Create realistic prompts based on completed GitHub workflows
• Develop detailed rubrics for evaluating task quality and correctness
• Review task outputs for accuracy and alignment with project guidelines
• Identify incomplete, incorrect, or inconsistent workflow results
• Maintain consistent quality while working independently in a remote environment

Ideal Profile

• Strong hands-on experience using GitHub in professional, project-based, or open-source environments
• Practical knowledge of Git and version-control fundamentals
• Experience with repositories, branches, commits, merges, pull requests, and issues
• Familiarity with GitHub Actions and CI/CD workflows
• Comfortable creating, reviewing, and managing common GitHub workflows independently
• Current access to GitHub
• Comfortable recording and sharing screen-based workflow demonstrations
• Strong attention to detail across technical tasks
• Ability to explain GitHub actions and version-control workflows clearly
• Strong written technical communication skills
• Prior human-data experience such as annotation, labelling, RLHF, AI-response evaluation, or model evaluation is advantageous
• Ability to work independently while following detailed project instructions
• Experience documenting technical workflows is beneficial
• No prior AI-training or model-evaluation experience is required

Engagement Details

• Independent contractor engagement
• Fully remote
• Compensation: $90–$175/hour
• Work will involve GitHub workflows, Git version control, repository management, collaboration tasks, and CI/CD-related activities
• Screen recording is required while completing assigned workflows
• Assignments may include repository creation, branching, commits, merges, pull requests, issue management, GitHub Actions, and workflow evaluation
• Strong practical GitHub experience is central to this engagement
• Current access to GitHub is preferred for independent task completion
• Project scope, workflows, and evaluation requirements may evolve depending on project needs
• Work must be completed without using confidential or proprietary information belonging to any employer, client, organisation, institution, or other third party

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: